00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2407 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3668 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.181 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.181 The recommended git tool is: git 00:00:00.181 using credential 00000000-0000-0000-0000-000000000002 00:00:00.183 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.203 Fetching changes from the remote Git repository 00:00:00.206 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.224 Using shallow fetch with depth 1 00:00:00.224 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.224 > git --version # timeout=10 00:00:00.243 > git --version # 'git version 2.39.2' 00:00:00.243 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.258 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.258 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.489 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.502 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.513 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.514 > git config core.sparsecheckout # timeout=10 00:00:06.526 > git read-tree -mu HEAD # timeout=10 00:00:06.542 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.567 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.567 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.676 [Pipeline] Start of Pipeline 00:00:06.690 [Pipeline] library 00:00:06.691 Loading library shm_lib@master 00:00:06.692 Library shm_lib@master is cached. Copying from home. 00:00:06.711 [Pipeline] node 00:00:06.722 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.723 [Pipeline] { 00:00:06.733 [Pipeline] catchError 00:00:06.734 [Pipeline] { 00:00:06.744 [Pipeline] wrap 00:00:06.753 [Pipeline] { 00:00:06.760 [Pipeline] stage 00:00:06.761 [Pipeline] { (Prologue) 00:00:07.085 [Pipeline] sh 00:00:07.369 + logger -p user.info -t JENKINS-CI 00:00:07.386 [Pipeline] echo 00:00:07.388 Node: GP11 00:00:07.395 [Pipeline] sh 00:00:07.694 [Pipeline] setCustomBuildProperty 00:00:07.703 [Pipeline] echo 00:00:07.704 Cleanup processes 00:00:07.709 [Pipeline] sh 00:00:07.994 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.994 761481 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.009 [Pipeline] sh 00:00:08.296 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.296 ++ grep -v 'sudo pgrep' 00:00:08.296 ++ awk '{print $1}' 00:00:08.296 + sudo kill -9 00:00:08.296 + true 00:00:08.310 [Pipeline] cleanWs 00:00:08.318 [WS-CLEANUP] Deleting project workspace... 00:00:08.319 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.325 [WS-CLEANUP] done 00:00:08.329 [Pipeline] setCustomBuildProperty 00:00:08.341 [Pipeline] sh 00:00:08.623 + sudo git config --global --replace-all safe.directory '*' 00:00:08.731 [Pipeline] httpRequest 00:00:09.162 [Pipeline] echo 00:00:09.163 Sorcerer 10.211.164.20 is alive 00:00:09.173 [Pipeline] retry 00:00:09.175 [Pipeline] { 00:00:09.188 [Pipeline] httpRequest 00:00:09.192 HttpMethod: GET 00:00:09.192 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.193 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.212 Response Code: HTTP/1.1 200 OK 00:00:09.212 Success: Status code 200 is in the accepted range: 200,404 00:00:09.212 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.841 [Pipeline] } 00:00:12.859 [Pipeline] // retry 00:00:12.867 [Pipeline] sh 00:00:13.153 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.174 [Pipeline] httpRequest 00:00:13.614 [Pipeline] echo 00:00:13.616 Sorcerer 10.211.164.20 is alive 00:00:13.624 [Pipeline] retry 00:00:13.626 [Pipeline] { 00:00:13.639 [Pipeline] httpRequest 00:00:13.643 HttpMethod: GET 00:00:13.644 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.644 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.670 Response Code: HTTP/1.1 200 OK 00:00:13.670 Success: Status code 200 is in the accepted range: 200,404 00:00:13.670 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:19.590 [Pipeline] } 00:01:19.612 [Pipeline] // retry 00:01:19.619 [Pipeline] sh 00:01:19.908 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:22.453 [Pipeline] sh 00:01:22.739 + git -C spdk log --oneline -n5 00:01:22.739 c13c99a5e test: Various fixes for Fedora40 00:01:22.739 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:22.739 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:22.739 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:22.739 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:22.751 [Pipeline] } 00:01:22.764 [Pipeline] // stage 00:01:22.772 [Pipeline] stage 00:01:22.774 [Pipeline] { (Prepare) 00:01:22.789 [Pipeline] writeFile 00:01:22.803 [Pipeline] sh 00:01:23.087 + logger -p user.info -t JENKINS-CI 00:01:23.099 [Pipeline] sh 00:01:23.384 + logger -p user.info -t JENKINS-CI 00:01:23.396 [Pipeline] sh 00:01:23.681 + cat autorun-spdk.conf 00:01:23.681 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.681 SPDK_TEST_NVMF=1 00:01:23.681 SPDK_TEST_NVME_CLI=1 00:01:23.681 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.681 SPDK_TEST_NVMF_NICS=e810 00:01:23.681 SPDK_RUN_UBSAN=1 00:01:23.681 NET_TYPE=phy 00:01:23.689 RUN_NIGHTLY=1 00:01:23.693 [Pipeline] readFile 00:01:23.716 [Pipeline] withEnv 00:01:23.718 [Pipeline] { 00:01:23.730 [Pipeline] sh 00:01:24.018 + set -ex 00:01:24.018 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:24.018 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:24.018 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.018 ++ SPDK_TEST_NVMF=1 00:01:24.018 ++ SPDK_TEST_NVME_CLI=1 00:01:24.018 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.018 ++ SPDK_TEST_NVMF_NICS=e810 00:01:24.018 ++ SPDK_RUN_UBSAN=1 00:01:24.018 ++ NET_TYPE=phy 00:01:24.018 ++ RUN_NIGHTLY=1 00:01:24.018 + case $SPDK_TEST_NVMF_NICS in 00:01:24.018 + DRIVERS=ice 00:01:24.018 + [[ tcp == \r\d\m\a ]] 00:01:24.018 + [[ -n ice ]] 00:01:24.018 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:24.018 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:24.018 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:24.018 rmmod: ERROR: Module irdma is not currently loaded 00:01:24.018 rmmod: ERROR: Module i40iw is not currently loaded 00:01:24.018 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:24.018 + true 00:01:24.018 + for D in $DRIVERS 00:01:24.018 + sudo modprobe ice 00:01:24.018 + exit 0 00:01:24.027 [Pipeline] } 00:01:24.043 [Pipeline] // withEnv 00:01:24.048 [Pipeline] } 00:01:24.062 [Pipeline] // stage 00:01:24.072 [Pipeline] catchError 00:01:24.074 [Pipeline] { 00:01:24.086 [Pipeline] timeout 00:01:24.086 Timeout set to expire in 1 hr 0 min 00:01:24.088 [Pipeline] { 00:01:24.101 [Pipeline] stage 00:01:24.103 [Pipeline] { (Tests) 00:01:24.117 [Pipeline] sh 00:01:24.403 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.403 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.403 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.403 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:24.403 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.403 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.403 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:24.403 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.403 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.403 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.403 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:24.403 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.403 + source /etc/os-release 00:01:24.403 ++ NAME='Fedora Linux' 00:01:24.403 ++ VERSION='39 (Cloud Edition)' 00:01:24.403 ++ ID=fedora 00:01:24.403 ++ VERSION_ID=39 00:01:24.403 ++ VERSION_CODENAME= 00:01:24.403 ++ PLATFORM_ID=platform:f39 00:01:24.403 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:24.403 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:24.403 ++ LOGO=fedora-logo-icon 00:01:24.403 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:24.403 ++ HOME_URL=https://fedoraproject.org/ 00:01:24.403 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:24.403 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:24.403 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:24.403 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:24.403 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:24.403 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:24.403 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:24.403 ++ SUPPORT_END=2024-11-12 00:01:24.403 ++ VARIANT='Cloud Edition' 00:01:24.403 ++ VARIANT_ID=cloud 00:01:24.403 + uname -a 00:01:24.403 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:24.403 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:25.345 Hugepages 00:01:25.345 node hugesize free / total 00:01:25.345 node0 1048576kB 0 / 0 00:01:25.345 node0 2048kB 0 / 0 00:01:25.345 node1 1048576kB 0 / 0 00:01:25.345 node1 2048kB 0 / 0 00:01:25.345 00:01:25.345 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:25.345 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:25.345 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:25.345 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:25.345 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:25.345 + rm -f /tmp/spdk-ld-path 00:01:25.345 + source autorun-spdk.conf 00:01:25.345 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.345 ++ SPDK_TEST_NVMF=1 00:01:25.345 ++ SPDK_TEST_NVME_CLI=1 00:01:25.345 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.345 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.345 ++ SPDK_RUN_UBSAN=1 00:01:25.345 ++ NET_TYPE=phy 00:01:25.345 ++ RUN_NIGHTLY=1 00:01:25.345 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:25.345 + [[ -n '' ]] 00:01:25.345 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.345 + for M in /var/spdk/build-*-manifest.txt 00:01:25.345 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:25.345 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.345 + for M in /var/spdk/build-*-manifest.txt 00:01:25.345 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:25.345 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.345 + for M in /var/spdk/build-*-manifest.txt 00:01:25.345 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:25.345 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.345 ++ uname 00:01:25.345 + [[ Linux == \L\i\n\u\x ]] 00:01:25.345 + sudo dmesg -T 00:01:25.345 + sudo dmesg --clear 00:01:25.345 + dmesg_pid=762783 00:01:25.345 + [[ Fedora Linux == FreeBSD ]] 00:01:25.345 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.345 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.345 + sudo dmesg -Tw 00:01:25.345 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:25.345 + [[ -x /usr/src/fio-static/fio ]] 00:01:25.345 + export FIO_BIN=/usr/src/fio-static/fio 00:01:25.345 + FIO_BIN=/usr/src/fio-static/fio 00:01:25.345 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:25.345 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:25.345 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:25.345 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.345 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.345 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:25.345 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.345 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.345 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.345 Test configuration: 00:01:25.345 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.345 SPDK_TEST_NVMF=1 00:01:25.345 SPDK_TEST_NVME_CLI=1 00:01:25.345 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.345 SPDK_TEST_NVMF_NICS=e810 00:01:25.345 SPDK_RUN_UBSAN=1 00:01:25.345 NET_TYPE=phy 00:01:25.345 RUN_NIGHTLY=1 08:09:11 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:25.345 08:09:11 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:25.345 08:09:11 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:25.345 08:09:11 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:25.345 08:09:11 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:25.345 08:09:11 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.345 08:09:11 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.345 08:09:11 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.345 08:09:11 -- paths/export.sh@5 -- $ export PATH 00:01:25.345 08:09:11 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.345 08:09:11 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.345 08:09:11 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.345 08:09:11 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732604951.XXXXXX 00:01:25.345 08:09:11 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732604951.mRGQk4 00:01:25.345 08:09:11 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.345 08:09:11 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:25.345 08:09:11 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:25.345 08:09:11 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.345 08:09:11 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.345 08:09:11 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.345 08:09:11 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:25.345 08:09:11 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.345 08:09:11 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:25.345 08:09:11 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.345 08:09:11 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.345 08:09:11 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.345 08:09:11 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.345 Tue Nov 26 07:09:11 AM UTC 2024 00:01:25.345 08:09:11 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:25.345 LTS-67-gc13c99a5e 00:01:25.345 08:09:11 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:25.345 08:09:11 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:25.345 08:09:11 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:25.345 08:09:11 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:25.345 08:09:11 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:25.345 08:09:11 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.345 ************************************ 00:01:25.345 START TEST ubsan 00:01:25.345 ************************************ 00:01:25.345 08:09:11 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:25.345 using ubsan 00:01:25.345 00:01:25.346 real 0m0.000s 00:01:25.346 user 0m0.000s 00:01:25.346 sys 0m0.000s 00:01:25.346 08:09:11 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:25.346 08:09:11 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.346 ************************************ 00:01:25.346 END TEST ubsan 00:01:25.346 ************************************ 00:01:25.604 08:09:11 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:25.604 08:09:11 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:25.604 08:09:11 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:25.604 08:09:11 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:25.604 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:25.604 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:25.862 Using 'verbs' RDMA provider 00:01:36.115 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:46.113 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:46.113 Creating mk/config.mk...done. 00:01:46.113 Creating mk/cc.flags.mk...done. 00:01:46.113 Type 'make' to build. 00:01:46.113 08:09:31 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:46.113 08:09:31 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:46.113 08:09:31 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:46.113 08:09:31 -- common/autotest_common.sh@10 -- $ set +x 00:01:46.113 ************************************ 00:01:46.113 START TEST make 00:01:46.113 ************************************ 00:01:46.113 08:09:31 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:46.113 make[1]: Nothing to be done for 'all'. 00:01:56.125 The Meson build system 00:01:56.125 Version: 1.5.0 00:01:56.125 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:56.125 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:56.125 Build type: native build 00:01:56.125 Program cat found: YES (/usr/bin/cat) 00:01:56.125 Project name: DPDK 00:01:56.125 Project version: 23.11.0 00:01:56.125 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:56.125 C linker for the host machine: cc ld.bfd 2.40-14 00:01:56.125 Host machine cpu family: x86_64 00:01:56.125 Host machine cpu: x86_64 00:01:56.125 Message: ## Building in Developer Mode ## 00:01:56.125 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:56.125 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:56.125 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:56.125 Program python3 found: YES (/usr/bin/python3) 00:01:56.125 Program cat found: YES (/usr/bin/cat) 00:01:56.125 Compiler for C supports arguments -march=native: YES 00:01:56.125 Checking for size of "void *" : 8 00:01:56.125 Checking for size of "void *" : 8 (cached) 00:01:56.125 Library m found: YES 00:01:56.125 Library numa found: YES 00:01:56.125 Has header "numaif.h" : YES 00:01:56.125 Library fdt found: NO 00:01:56.125 Library execinfo found: NO 00:01:56.125 Has header "execinfo.h" : YES 00:01:56.125 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:56.125 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:56.125 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:56.125 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:56.125 Run-time dependency openssl found: YES 3.1.1 00:01:56.125 Run-time dependency libpcap found: YES 1.10.4 00:01:56.125 Has header "pcap.h" with dependency libpcap: YES 00:01:56.125 Compiler for C supports arguments -Wcast-qual: YES 00:01:56.125 Compiler for C supports arguments -Wdeprecated: YES 00:01:56.125 Compiler for C supports arguments -Wformat: YES 00:01:56.125 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:56.125 Compiler for C supports arguments -Wformat-security: NO 00:01:56.125 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:56.125 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:56.125 Compiler for C supports arguments -Wnested-externs: YES 00:01:56.125 Compiler for C supports arguments -Wold-style-definition: YES 00:01:56.125 Compiler for C supports arguments -Wpointer-arith: YES 00:01:56.125 Compiler for C supports arguments -Wsign-compare: YES 00:01:56.125 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:56.125 Compiler for C supports arguments -Wundef: YES 00:01:56.125 Compiler for C supports arguments -Wwrite-strings: YES 00:01:56.125 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:56.125 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:56.125 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:56.125 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:56.125 Program objdump found: YES (/usr/bin/objdump) 00:01:56.125 Compiler for C supports arguments -mavx512f: YES 00:01:56.125 Checking if "AVX512 checking" compiles: YES 00:01:56.125 Fetching value of define "__SSE4_2__" : 1 00:01:56.125 Fetching value of define "__AES__" : 1 00:01:56.125 Fetching value of define "__AVX__" : 1 00:01:56.125 Fetching value of define "__AVX2__" : (undefined) 00:01:56.125 Fetching value of define "__AVX512BW__" : (undefined) 00:01:56.125 Fetching value of define "__AVX512CD__" : (undefined) 00:01:56.125 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:56.125 Fetching value of define "__AVX512F__" : (undefined) 00:01:56.125 Fetching value of define "__AVX512VL__" : (undefined) 00:01:56.125 Fetching value of define "__PCLMUL__" : 1 00:01:56.125 Fetching value of define "__RDRND__" : 1 00:01:56.125 Fetching value of define "__RDSEED__" : (undefined) 00:01:56.125 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:56.125 Fetching value of define "__znver1__" : (undefined) 00:01:56.125 Fetching value of define "__znver2__" : (undefined) 00:01:56.125 Fetching value of define "__znver3__" : (undefined) 00:01:56.125 Fetching value of define "__znver4__" : (undefined) 00:01:56.125 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:56.125 Message: lib/log: Defining dependency "log" 00:01:56.125 Message: lib/kvargs: Defining dependency "kvargs" 00:01:56.125 Message: lib/telemetry: Defining dependency "telemetry" 00:01:56.125 Checking for function "getentropy" : NO 00:01:56.125 Message: lib/eal: Defining dependency "eal" 00:01:56.125 Message: lib/ring: Defining dependency "ring" 00:01:56.125 Message: lib/rcu: Defining dependency "rcu" 00:01:56.125 Message: lib/mempool: Defining dependency "mempool" 00:01:56.125 Message: lib/mbuf: Defining dependency "mbuf" 00:01:56.125 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:56.125 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:56.125 Compiler for C supports arguments -mpclmul: YES 00:01:56.125 Compiler for C supports arguments -maes: YES 00:01:56.125 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:56.125 Compiler for C supports arguments -mavx512bw: YES 00:01:56.125 Compiler for C supports arguments -mavx512dq: YES 00:01:56.125 Compiler for C supports arguments -mavx512vl: YES 00:01:56.125 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:56.125 Compiler for C supports arguments -mavx2: YES 00:01:56.125 Compiler for C supports arguments -mavx: YES 00:01:56.125 Message: lib/net: Defining dependency "net" 00:01:56.125 Message: lib/meter: Defining dependency "meter" 00:01:56.125 Message: lib/ethdev: Defining dependency "ethdev" 00:01:56.125 Message: lib/pci: Defining dependency "pci" 00:01:56.126 Message: lib/cmdline: Defining dependency "cmdline" 00:01:56.126 Message: lib/hash: Defining dependency "hash" 00:01:56.126 Message: lib/timer: Defining dependency "timer" 00:01:56.126 Message: lib/compressdev: Defining dependency "compressdev" 00:01:56.126 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:56.126 Message: lib/dmadev: Defining dependency "dmadev" 00:01:56.126 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:56.126 Message: lib/power: Defining dependency "power" 00:01:56.126 Message: lib/reorder: Defining dependency "reorder" 00:01:56.126 Message: lib/security: Defining dependency "security" 00:01:56.126 Has header "linux/userfaultfd.h" : YES 00:01:56.126 Has header "linux/vduse.h" : YES 00:01:56.126 Message: lib/vhost: Defining dependency "vhost" 00:01:56.126 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:56.126 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:56.126 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:56.126 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:56.126 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:56.126 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:56.126 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:56.126 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:56.126 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:56.126 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:56.126 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:56.126 Configuring doxy-api-html.conf using configuration 00:01:56.126 Configuring doxy-api-man.conf using configuration 00:01:56.126 Program mandb found: YES (/usr/bin/mandb) 00:01:56.126 Program sphinx-build found: NO 00:01:56.126 Configuring rte_build_config.h using configuration 00:01:56.126 Message: 00:01:56.126 ================= 00:01:56.126 Applications Enabled 00:01:56.126 ================= 00:01:56.126 00:01:56.126 apps: 00:01:56.126 00:01:56.126 00:01:56.126 Message: 00:01:56.126 ================= 00:01:56.126 Libraries Enabled 00:01:56.126 ================= 00:01:56.126 00:01:56.126 libs: 00:01:56.126 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:56.126 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:56.126 cryptodev, dmadev, power, reorder, security, vhost, 00:01:56.126 00:01:56.126 Message: 00:01:56.126 =============== 00:01:56.126 Drivers Enabled 00:01:56.126 =============== 00:01:56.126 00:01:56.126 common: 00:01:56.126 00:01:56.126 bus: 00:01:56.126 pci, vdev, 00:01:56.126 mempool: 00:01:56.126 ring, 00:01:56.126 dma: 00:01:56.126 00:01:56.126 net: 00:01:56.126 00:01:56.126 crypto: 00:01:56.126 00:01:56.126 compress: 00:01:56.126 00:01:56.126 vdpa: 00:01:56.126 00:01:56.126 00:01:56.126 Message: 00:01:56.126 ================= 00:01:56.126 Content Skipped 00:01:56.126 ================= 00:01:56.126 00:01:56.126 apps: 00:01:56.126 dumpcap: explicitly disabled via build config 00:01:56.126 graph: explicitly disabled via build config 00:01:56.126 pdump: explicitly disabled via build config 00:01:56.126 proc-info: explicitly disabled via build config 00:01:56.126 test-acl: explicitly disabled via build config 00:01:56.126 test-bbdev: explicitly disabled via build config 00:01:56.126 test-cmdline: explicitly disabled via build config 00:01:56.126 test-compress-perf: explicitly disabled via build config 00:01:56.126 test-crypto-perf: explicitly disabled via build config 00:01:56.126 test-dma-perf: explicitly disabled via build config 00:01:56.126 test-eventdev: explicitly disabled via build config 00:01:56.126 test-fib: explicitly disabled via build config 00:01:56.126 test-flow-perf: explicitly disabled via build config 00:01:56.126 test-gpudev: explicitly disabled via build config 00:01:56.126 test-mldev: explicitly disabled via build config 00:01:56.126 test-pipeline: explicitly disabled via build config 00:01:56.126 test-pmd: explicitly disabled via build config 00:01:56.126 test-regex: explicitly disabled via build config 00:01:56.126 test-sad: explicitly disabled via build config 00:01:56.126 test-security-perf: explicitly disabled via build config 00:01:56.126 00:01:56.126 libs: 00:01:56.126 metrics: explicitly disabled via build config 00:01:56.126 acl: explicitly disabled via build config 00:01:56.126 bbdev: explicitly disabled via build config 00:01:56.126 bitratestats: explicitly disabled via build config 00:01:56.126 bpf: explicitly disabled via build config 00:01:56.126 cfgfile: explicitly disabled via build config 00:01:56.126 distributor: explicitly disabled via build config 00:01:56.126 efd: explicitly disabled via build config 00:01:56.126 eventdev: explicitly disabled via build config 00:01:56.126 dispatcher: explicitly disabled via build config 00:01:56.126 gpudev: explicitly disabled via build config 00:01:56.126 gro: explicitly disabled via build config 00:01:56.126 gso: explicitly disabled via build config 00:01:56.126 ip_frag: explicitly disabled via build config 00:01:56.126 jobstats: explicitly disabled via build config 00:01:56.126 latencystats: explicitly disabled via build config 00:01:56.126 lpm: explicitly disabled via build config 00:01:56.126 member: explicitly disabled via build config 00:01:56.126 pcapng: explicitly disabled via build config 00:01:56.126 rawdev: explicitly disabled via build config 00:01:56.126 regexdev: explicitly disabled via build config 00:01:56.126 mldev: explicitly disabled via build config 00:01:56.126 rib: explicitly disabled via build config 00:01:56.126 sched: explicitly disabled via build config 00:01:56.126 stack: explicitly disabled via build config 00:01:56.126 ipsec: explicitly disabled via build config 00:01:56.126 pdcp: explicitly disabled via build config 00:01:56.126 fib: explicitly disabled via build config 00:01:56.126 port: explicitly disabled via build config 00:01:56.126 pdump: explicitly disabled via build config 00:01:56.126 table: explicitly disabled via build config 00:01:56.126 pipeline: explicitly disabled via build config 00:01:56.126 graph: explicitly disabled via build config 00:01:56.126 node: explicitly disabled via build config 00:01:56.126 00:01:56.126 drivers: 00:01:56.126 common/cpt: not in enabled drivers build config 00:01:56.126 common/dpaax: not in enabled drivers build config 00:01:56.126 common/iavf: not in enabled drivers build config 00:01:56.126 common/idpf: not in enabled drivers build config 00:01:56.126 common/mvep: not in enabled drivers build config 00:01:56.126 common/octeontx: not in enabled drivers build config 00:01:56.126 bus/auxiliary: not in enabled drivers build config 00:01:56.126 bus/cdx: not in enabled drivers build config 00:01:56.126 bus/dpaa: not in enabled drivers build config 00:01:56.126 bus/fslmc: not in enabled drivers build config 00:01:56.126 bus/ifpga: not in enabled drivers build config 00:01:56.126 bus/platform: not in enabled drivers build config 00:01:56.126 bus/vmbus: not in enabled drivers build config 00:01:56.126 common/cnxk: not in enabled drivers build config 00:01:56.126 common/mlx5: not in enabled drivers build config 00:01:56.126 common/nfp: not in enabled drivers build config 00:01:56.126 common/qat: not in enabled drivers build config 00:01:56.126 common/sfc_efx: not in enabled drivers build config 00:01:56.126 mempool/bucket: not in enabled drivers build config 00:01:56.126 mempool/cnxk: not in enabled drivers build config 00:01:56.126 mempool/dpaa: not in enabled drivers build config 00:01:56.126 mempool/dpaa2: not in enabled drivers build config 00:01:56.126 mempool/octeontx: not in enabled drivers build config 00:01:56.126 mempool/stack: not in enabled drivers build config 00:01:56.126 dma/cnxk: not in enabled drivers build config 00:01:56.126 dma/dpaa: not in enabled drivers build config 00:01:56.126 dma/dpaa2: not in enabled drivers build config 00:01:56.126 dma/hisilicon: not in enabled drivers build config 00:01:56.126 dma/idxd: not in enabled drivers build config 00:01:56.126 dma/ioat: not in enabled drivers build config 00:01:56.126 dma/skeleton: not in enabled drivers build config 00:01:56.126 net/af_packet: not in enabled drivers build config 00:01:56.126 net/af_xdp: not in enabled drivers build config 00:01:56.126 net/ark: not in enabled drivers build config 00:01:56.126 net/atlantic: not in enabled drivers build config 00:01:56.126 net/avp: not in enabled drivers build config 00:01:56.126 net/axgbe: not in enabled drivers build config 00:01:56.126 net/bnx2x: not in enabled drivers build config 00:01:56.126 net/bnxt: not in enabled drivers build config 00:01:56.126 net/bonding: not in enabled drivers build config 00:01:56.126 net/cnxk: not in enabled drivers build config 00:01:56.126 net/cpfl: not in enabled drivers build config 00:01:56.126 net/cxgbe: not in enabled drivers build config 00:01:56.126 net/dpaa: not in enabled drivers build config 00:01:56.126 net/dpaa2: not in enabled drivers build config 00:01:56.126 net/e1000: not in enabled drivers build config 00:01:56.126 net/ena: not in enabled drivers build config 00:01:56.126 net/enetc: not in enabled drivers build config 00:01:56.126 net/enetfec: not in enabled drivers build config 00:01:56.126 net/enic: not in enabled drivers build config 00:01:56.126 net/failsafe: not in enabled drivers build config 00:01:56.126 net/fm10k: not in enabled drivers build config 00:01:56.126 net/gve: not in enabled drivers build config 00:01:56.126 net/hinic: not in enabled drivers build config 00:01:56.126 net/hns3: not in enabled drivers build config 00:01:56.126 net/i40e: not in enabled drivers build config 00:01:56.126 net/iavf: not in enabled drivers build config 00:01:56.126 net/ice: not in enabled drivers build config 00:01:56.126 net/idpf: not in enabled drivers build config 00:01:56.126 net/igc: not in enabled drivers build config 00:01:56.126 net/ionic: not in enabled drivers build config 00:01:56.126 net/ipn3ke: not in enabled drivers build config 00:01:56.126 net/ixgbe: not in enabled drivers build config 00:01:56.126 net/mana: not in enabled drivers build config 00:01:56.126 net/memif: not in enabled drivers build config 00:01:56.126 net/mlx4: not in enabled drivers build config 00:01:56.126 net/mlx5: not in enabled drivers build config 00:01:56.126 net/mvneta: not in enabled drivers build config 00:01:56.126 net/mvpp2: not in enabled drivers build config 00:01:56.126 net/netvsc: not in enabled drivers build config 00:01:56.126 net/nfb: not in enabled drivers build config 00:01:56.127 net/nfp: not in enabled drivers build config 00:01:56.127 net/ngbe: not in enabled drivers build config 00:01:56.127 net/null: not in enabled drivers build config 00:01:56.127 net/octeontx: not in enabled drivers build config 00:01:56.127 net/octeon_ep: not in enabled drivers build config 00:01:56.127 net/pcap: not in enabled drivers build config 00:01:56.127 net/pfe: not in enabled drivers build config 00:01:56.127 net/qede: not in enabled drivers build config 00:01:56.127 net/ring: not in enabled drivers build config 00:01:56.127 net/sfc: not in enabled drivers build config 00:01:56.127 net/softnic: not in enabled drivers build config 00:01:56.127 net/tap: not in enabled drivers build config 00:01:56.127 net/thunderx: not in enabled drivers build config 00:01:56.127 net/txgbe: not in enabled drivers build config 00:01:56.127 net/vdev_netvsc: not in enabled drivers build config 00:01:56.127 net/vhost: not in enabled drivers build config 00:01:56.127 net/virtio: not in enabled drivers build config 00:01:56.127 net/vmxnet3: not in enabled drivers build config 00:01:56.127 raw/*: missing internal dependency, "rawdev" 00:01:56.127 crypto/armv8: not in enabled drivers build config 00:01:56.127 crypto/bcmfs: not in enabled drivers build config 00:01:56.127 crypto/caam_jr: not in enabled drivers build config 00:01:56.127 crypto/ccp: not in enabled drivers build config 00:01:56.127 crypto/cnxk: not in enabled drivers build config 00:01:56.127 crypto/dpaa_sec: not in enabled drivers build config 00:01:56.127 crypto/dpaa2_sec: not in enabled drivers build config 00:01:56.127 crypto/ipsec_mb: not in enabled drivers build config 00:01:56.127 crypto/mlx5: not in enabled drivers build config 00:01:56.127 crypto/mvsam: not in enabled drivers build config 00:01:56.127 crypto/nitrox: not in enabled drivers build config 00:01:56.127 crypto/null: not in enabled drivers build config 00:01:56.127 crypto/octeontx: not in enabled drivers build config 00:01:56.127 crypto/openssl: not in enabled drivers build config 00:01:56.127 crypto/scheduler: not in enabled drivers build config 00:01:56.127 crypto/uadk: not in enabled drivers build config 00:01:56.127 crypto/virtio: not in enabled drivers build config 00:01:56.127 compress/isal: not in enabled drivers build config 00:01:56.127 compress/mlx5: not in enabled drivers build config 00:01:56.127 compress/octeontx: not in enabled drivers build config 00:01:56.127 compress/zlib: not in enabled drivers build config 00:01:56.127 regex/*: missing internal dependency, "regexdev" 00:01:56.127 ml/*: missing internal dependency, "mldev" 00:01:56.127 vdpa/ifc: not in enabled drivers build config 00:01:56.127 vdpa/mlx5: not in enabled drivers build config 00:01:56.127 vdpa/nfp: not in enabled drivers build config 00:01:56.127 vdpa/sfc: not in enabled drivers build config 00:01:56.127 event/*: missing internal dependency, "eventdev" 00:01:56.127 baseband/*: missing internal dependency, "bbdev" 00:01:56.127 gpu/*: missing internal dependency, "gpudev" 00:01:56.127 00:01:56.127 00:01:56.127 Build targets in project: 85 00:01:56.127 00:01:56.127 DPDK 23.11.0 00:01:56.127 00:01:56.127 User defined options 00:01:56.127 buildtype : debug 00:01:56.127 default_library : shared 00:01:56.127 libdir : lib 00:01:56.127 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:56.127 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:56.127 c_link_args : 00:01:56.127 cpu_instruction_set: native 00:01:56.127 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:56.127 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:56.127 enable_docs : false 00:01:56.127 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:56.127 enable_kmods : false 00:01:56.127 tests : false 00:01:56.127 00:01:56.127 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:56.127 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:56.127 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:56.127 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:56.127 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:56.127 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:56.127 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:56.127 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:56.127 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:56.127 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:56.127 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:56.127 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:56.127 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:56.127 [12/265] Linking static target lib/librte_kvargs.a 00:01:56.127 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:56.127 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:56.127 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:56.127 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:56.127 [17/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:56.127 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:56.127 [19/265] Linking static target lib/librte_log.a 00:01:56.127 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:56.127 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:56.127 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.389 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:56.389 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:56.389 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:56.389 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:56.389 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:56.389 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:56.389 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:56.389 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:56.389 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:56.389 [32/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:56.389 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:56.389 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:56.389 [35/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:56.389 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:56.389 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:56.389 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:56.389 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:56.389 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:56.389 [41/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:56.389 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:56.389 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:56.389 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:56.389 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:56.389 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:56.389 [47/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:56.389 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:56.654 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:56.654 [50/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:56.654 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:56.654 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:56.654 [53/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:56.654 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:56.654 [55/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:56.654 [56/265] Linking static target lib/librte_telemetry.a 00:01:56.654 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:56.654 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:56.654 [59/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:56.654 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:56.654 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:56.654 [62/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:56.654 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:56.654 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:56.654 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:56.913 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:56.913 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.913 [68/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:56.913 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:56.913 [70/265] Linking static target lib/librte_pci.a 00:01:56.913 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:56.913 [72/265] Linking target lib/librte_log.so.24.0 00:01:56.913 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:56.913 [74/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:56.913 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:56.913 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:56.913 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:56.913 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:56.913 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:57.174 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:57.174 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:57.174 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:57.174 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:57.174 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:57.174 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:57.174 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:57.174 [87/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:57.174 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:57.174 [89/265] Linking target lib/librte_kvargs.so.24.0 00:01:57.174 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:57.174 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:57.433 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:57.433 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:57.433 [94/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.433 [95/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:57.433 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:57.433 [97/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:57.433 [98/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:57.433 [99/265] Linking static target lib/librte_eal.a 00:01:57.433 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:57.433 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:57.433 [102/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:57.433 [103/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:57.433 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:57.433 [105/265] Linking static target lib/librte_ring.a 00:01:57.433 [106/265] Linking static target lib/librte_meter.a 00:01:57.433 [107/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:57.698 [108/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:57.698 [109/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:57.698 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:57.698 [111/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:57.698 [112/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:57.698 [113/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:57.698 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:57.698 [115/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:57.698 [116/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:57.698 [117/265] Linking static target lib/librte_rcu.a 00:01:57.698 [118/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.698 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:57.698 [120/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:57.698 [121/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:57.698 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:57.698 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:57.698 [124/265] Linking target lib/librte_telemetry.so.24.0 00:01:57.698 [125/265] Linking static target lib/librte_mempool.a 00:01:57.961 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:57.961 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:57.961 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:57.961 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:57.961 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:57.961 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:57.961 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:57.961 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:57.961 [134/265] Linking static target lib/librte_cmdline.a 00:01:57.961 [135/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.961 [136/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:57.961 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:58.223 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:58.223 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:58.223 [140/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:58.223 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:58.223 [142/265] Linking static target lib/librte_net.a 00:01:58.223 [143/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.223 [144/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:58.223 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:58.223 [146/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.223 [147/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:58.223 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:58.223 [149/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:58.223 [150/265] Linking static target lib/librte_timer.a 00:01:58.484 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:58.484 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:58.484 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:58.484 [154/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:58.484 [155/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.484 [156/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:58.484 [157/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:58.484 [158/265] Linking static target lib/librte_dmadev.a 00:01:58.484 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:58.484 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:58.484 [161/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:58.742 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.742 [163/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:58.742 [164/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:58.742 [165/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:58.742 [166/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:58.742 [167/265] Linking static target lib/librte_compressdev.a 00:01:58.742 [168/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:58.742 [169/265] Linking static target lib/librte_hash.a 00:01:58.742 [170/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.742 [171/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:58.742 [172/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:58.742 [173/265] Linking static target lib/librte_power.a 00:01:58.742 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:58.742 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:59.000 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:59.000 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:59.000 [178/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.000 [179/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:59.000 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:59.000 [181/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.000 [182/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:59.000 [183/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:59.000 [184/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:59.000 [185/265] Linking static target lib/librte_reorder.a 00:01:59.000 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:59.000 [187/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:59.000 [188/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:59.000 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:59.000 [190/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:59.000 [191/265] Linking static target lib/librte_mbuf.a 00:01:59.259 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:59.259 [193/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:59.259 [194/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:59.259 [195/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.259 [196/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:59.259 [197/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.259 [198/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.259 [199/265] Linking static target drivers/librte_bus_vdev.a 00:01:59.259 [200/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.259 [201/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.259 [202/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.259 [203/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:59.259 [204/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:59.516 [205/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:59.516 [206/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:59.516 [207/265] Linking static target lib/librte_security.a 00:01:59.516 [208/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.516 [209/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.516 [210/265] Linking static target drivers/librte_bus_pci.a 00:01:59.516 [211/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.516 [212/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:59.516 [213/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:59.516 [214/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.516 [215/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.516 [216/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.516 [217/265] Linking static target drivers/librte_mempool_ring.a 00:01:59.804 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:59.804 [219/265] Linking static target lib/librte_ethdev.a 00:01:59.804 [220/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.804 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:59.804 [222/265] Linking static target lib/librte_cryptodev.a 00:01:59.804 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.740 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.116 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:03.490 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.490 [227/265] Linking target lib/librte_eal.so.24.0 00:02:03.748 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.748 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:03.748 [230/265] Linking target lib/librte_ring.so.24.0 00:02:03.748 [231/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:03.748 [232/265] Linking target lib/librte_timer.so.24.0 00:02:03.748 [233/265] Linking target lib/librte_meter.so.24.0 00:02:03.748 [234/265] Linking target lib/librte_dmadev.so.24.0 00:02:03.748 [235/265] Linking target lib/librte_pci.so.24.0 00:02:04.007 [236/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:04.007 [237/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:04.007 [238/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:04.007 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:04.007 [240/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:04.007 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:04.007 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:04.007 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:04.007 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:04.007 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:04.007 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:04.007 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:04.265 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:04.265 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:04.265 [250/265] Linking target lib/librte_net.so.24.0 00:02:04.265 [251/265] Linking target lib/librte_compressdev.so.24.0 00:02:04.265 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:04.266 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:04.266 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:04.526 [255/265] Linking target lib/librte_cmdline.so.24.0 00:02:04.526 [256/265] Linking target lib/librte_hash.so.24.0 00:02:04.526 [257/265] Linking target lib/librte_security.so.24.0 00:02:04.526 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:04.526 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:04.526 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:04.526 [261/265] Linking target lib/librte_power.so.24.0 00:02:07.827 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:07.827 [263/265] Linking static target lib/librte_vhost.a 00:02:08.767 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.767 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:08.767 INFO: autodetecting backend as ninja 00:02:08.767 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:09.702 CC lib/ut_mock/mock.o 00:02:09.702 CC lib/log/log.o 00:02:09.702 CC lib/log/log_flags.o 00:02:09.702 CC lib/log/log_deprecated.o 00:02:09.702 CC lib/ut/ut.o 00:02:09.702 LIB libspdk_ut_mock.a 00:02:09.702 SO libspdk_ut_mock.so.5.0 00:02:09.702 LIB libspdk_ut.a 00:02:09.702 LIB libspdk_log.a 00:02:09.702 SO libspdk_ut.so.1.0 00:02:09.702 SO libspdk_log.so.6.1 00:02:09.702 SYMLINK libspdk_ut_mock.so 00:02:09.702 SYMLINK libspdk_ut.so 00:02:09.702 SYMLINK libspdk_log.so 00:02:09.962 CXX lib/trace_parser/trace.o 00:02:09.962 CC lib/ioat/ioat.o 00:02:09.962 CC lib/dma/dma.o 00:02:09.962 CC lib/util/base64.o 00:02:09.962 CC lib/util/bit_array.o 00:02:09.962 CC lib/util/cpuset.o 00:02:09.962 CC lib/util/crc16.o 00:02:09.962 CC lib/util/crc32.o 00:02:09.962 CC lib/util/crc32c.o 00:02:09.962 CC lib/util/crc32_ieee.o 00:02:09.962 CC lib/util/crc64.o 00:02:09.962 CC lib/util/dif.o 00:02:09.962 CC lib/util/fd.o 00:02:09.962 CC lib/util/file.o 00:02:09.962 CC lib/util/hexlify.o 00:02:09.962 CC lib/util/iov.o 00:02:09.962 CC lib/util/math.o 00:02:09.962 CC lib/util/pipe.o 00:02:09.962 CC lib/util/strerror_tls.o 00:02:09.962 CC lib/util/string.o 00:02:09.962 CC lib/util/uuid.o 00:02:09.962 CC lib/util/fd_group.o 00:02:09.962 CC lib/util/xor.o 00:02:09.962 CC lib/util/zipf.o 00:02:09.962 CC lib/vfio_user/host/vfio_user_pci.o 00:02:09.962 CC lib/vfio_user/host/vfio_user.o 00:02:09.962 LIB libspdk_dma.a 00:02:10.234 SO libspdk_dma.so.3.0 00:02:10.234 SYMLINK libspdk_dma.so 00:02:10.234 LIB libspdk_ioat.a 00:02:10.234 SO libspdk_ioat.so.6.0 00:02:10.234 LIB libspdk_vfio_user.a 00:02:10.234 SO libspdk_vfio_user.so.4.0 00:02:10.234 SYMLINK libspdk_ioat.so 00:02:10.234 SYMLINK libspdk_vfio_user.so 00:02:10.528 LIB libspdk_util.a 00:02:10.528 SO libspdk_util.so.8.0 00:02:10.528 SYMLINK libspdk_util.so 00:02:10.811 CC lib/vmd/vmd.o 00:02:10.811 CC lib/rdma/common.o 00:02:10.811 CC lib/conf/conf.o 00:02:10.811 CC lib/idxd/idxd.o 00:02:10.811 CC lib/json/json_parse.o 00:02:10.811 CC lib/env_dpdk/env.o 00:02:10.811 CC lib/vmd/led.o 00:02:10.811 CC lib/env_dpdk/memory.o 00:02:10.811 CC lib/json/json_util.o 00:02:10.811 CC lib/env_dpdk/pci.o 00:02:10.811 CC lib/idxd/idxd_user.o 00:02:10.811 CC lib/rdma/rdma_verbs.o 00:02:10.811 CC lib/json/json_write.o 00:02:10.811 CC lib/env_dpdk/init.o 00:02:10.811 CC lib/idxd/idxd_kernel.o 00:02:10.811 CC lib/env_dpdk/threads.o 00:02:10.811 CC lib/env_dpdk/pci_ioat.o 00:02:10.811 CC lib/env_dpdk/pci_virtio.o 00:02:10.811 CC lib/env_dpdk/pci_vmd.o 00:02:10.811 CC lib/env_dpdk/pci_idxd.o 00:02:10.811 CC lib/env_dpdk/pci_event.o 00:02:10.811 CC lib/env_dpdk/sigbus_handler.o 00:02:10.811 CC lib/env_dpdk/pci_dpdk.o 00:02:10.811 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:10.811 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:10.811 LIB libspdk_trace_parser.a 00:02:10.811 SO libspdk_trace_parser.so.4.0 00:02:11.069 LIB libspdk_conf.a 00:02:11.069 SYMLINK libspdk_trace_parser.so 00:02:11.069 SO libspdk_conf.so.5.0 00:02:11.069 SYMLINK libspdk_conf.so 00:02:11.069 LIB libspdk_json.a 00:02:11.069 LIB libspdk_rdma.a 00:02:11.069 SO libspdk_json.so.5.1 00:02:11.069 SO libspdk_rdma.so.5.0 00:02:11.069 SYMLINK libspdk_json.so 00:02:11.069 SYMLINK libspdk_rdma.so 00:02:11.328 CC lib/jsonrpc/jsonrpc_server.o 00:02:11.328 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:11.328 CC lib/jsonrpc/jsonrpc_client.o 00:02:11.328 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:11.328 LIB libspdk_idxd.a 00:02:11.328 SO libspdk_idxd.so.11.0 00:02:11.328 SYMLINK libspdk_idxd.so 00:02:11.328 LIB libspdk_vmd.a 00:02:11.328 SO libspdk_vmd.so.5.0 00:02:11.328 SYMLINK libspdk_vmd.so 00:02:11.588 LIB libspdk_jsonrpc.a 00:02:11.588 SO libspdk_jsonrpc.so.5.1 00:02:11.588 SYMLINK libspdk_jsonrpc.so 00:02:11.588 CC lib/rpc/rpc.o 00:02:11.848 LIB libspdk_rpc.a 00:02:11.848 SO libspdk_rpc.so.5.0 00:02:11.848 SYMLINK libspdk_rpc.so 00:02:12.106 CC lib/notify/notify.o 00:02:12.106 CC lib/notify/notify_rpc.o 00:02:12.106 CC lib/sock/sock.o 00:02:12.106 CC lib/trace/trace.o 00:02:12.106 CC lib/sock/sock_rpc.o 00:02:12.106 CC lib/trace/trace_flags.o 00:02:12.106 CC lib/trace/trace_rpc.o 00:02:12.106 LIB libspdk_notify.a 00:02:12.366 SO libspdk_notify.so.5.0 00:02:12.366 SYMLINK libspdk_notify.so 00:02:12.366 LIB libspdk_trace.a 00:02:12.366 SO libspdk_trace.so.9.0 00:02:12.366 SYMLINK libspdk_trace.so 00:02:12.366 LIB libspdk_sock.a 00:02:12.366 SO libspdk_sock.so.8.0 00:02:12.366 CC lib/thread/thread.o 00:02:12.366 CC lib/thread/iobuf.o 00:02:12.624 SYMLINK libspdk_sock.so 00:02:12.624 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:12.624 CC lib/nvme/nvme_ctrlr.o 00:02:12.624 CC lib/nvme/nvme_fabric.o 00:02:12.624 CC lib/nvme/nvme_ns_cmd.o 00:02:12.624 CC lib/nvme/nvme_ns.o 00:02:12.624 CC lib/nvme/nvme_pcie_common.o 00:02:12.624 CC lib/nvme/nvme_pcie.o 00:02:12.624 CC lib/nvme/nvme_qpair.o 00:02:12.624 CC lib/nvme/nvme.o 00:02:12.624 CC lib/nvme/nvme_quirks.o 00:02:12.624 CC lib/nvme/nvme_transport.o 00:02:12.624 CC lib/nvme/nvme_discovery.o 00:02:12.624 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:12.624 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:12.624 CC lib/nvme/nvme_tcp.o 00:02:12.624 CC lib/nvme/nvme_opal.o 00:02:12.624 CC lib/nvme/nvme_io_msg.o 00:02:12.624 CC lib/nvme/nvme_poll_group.o 00:02:12.624 CC lib/nvme/nvme_zns.o 00:02:12.624 CC lib/nvme/nvme_cuse.o 00:02:12.624 CC lib/nvme/nvme_vfio_user.o 00:02:12.624 CC lib/nvme/nvme_rdma.o 00:02:12.624 LIB libspdk_env_dpdk.a 00:02:12.883 SO libspdk_env_dpdk.so.13.0 00:02:12.883 SYMLINK libspdk_env_dpdk.so 00:02:14.258 LIB libspdk_thread.a 00:02:14.258 SO libspdk_thread.so.9.0 00:02:14.258 SYMLINK libspdk_thread.so 00:02:14.258 CC lib/init/json_config.o 00:02:14.258 CC lib/init/subsystem.o 00:02:14.258 CC lib/accel/accel.o 00:02:14.258 CC lib/virtio/virtio.o 00:02:14.258 CC lib/blob/blobstore.o 00:02:14.258 CC lib/accel/accel_rpc.o 00:02:14.258 CC lib/init/subsystem_rpc.o 00:02:14.258 CC lib/virtio/virtio_vhost_user.o 00:02:14.258 CC lib/blob/request.o 00:02:14.258 CC lib/init/rpc.o 00:02:14.258 CC lib/accel/accel_sw.o 00:02:14.258 CC lib/virtio/virtio_vfio_user.o 00:02:14.258 CC lib/blob/zeroes.o 00:02:14.258 CC lib/virtio/virtio_pci.o 00:02:14.258 CC lib/blob/blob_bs_dev.o 00:02:14.516 LIB libspdk_init.a 00:02:14.516 SO libspdk_init.so.4.0 00:02:14.516 SYMLINK libspdk_init.so 00:02:14.516 LIB libspdk_virtio.a 00:02:14.516 SO libspdk_virtio.so.6.0 00:02:14.774 SYMLINK libspdk_virtio.so 00:02:14.774 CC lib/event/app.o 00:02:14.774 CC lib/event/reactor.o 00:02:14.774 CC lib/event/log_rpc.o 00:02:14.774 CC lib/event/app_rpc.o 00:02:14.774 CC lib/event/scheduler_static.o 00:02:15.032 LIB libspdk_nvme.a 00:02:15.032 SO libspdk_nvme.so.12.0 00:02:15.032 LIB libspdk_event.a 00:02:15.032 SO libspdk_event.so.12.0 00:02:15.291 SYMLINK libspdk_event.so 00:02:15.291 LIB libspdk_accel.a 00:02:15.291 SYMLINK libspdk_nvme.so 00:02:15.291 SO libspdk_accel.so.14.0 00:02:15.291 SYMLINK libspdk_accel.so 00:02:15.550 CC lib/bdev/bdev.o 00:02:15.550 CC lib/bdev/bdev_rpc.o 00:02:15.550 CC lib/bdev/bdev_zone.o 00:02:15.550 CC lib/bdev/part.o 00:02:15.550 CC lib/bdev/scsi_nvme.o 00:02:17.461 LIB libspdk_blob.a 00:02:17.461 SO libspdk_blob.so.10.1 00:02:17.461 SYMLINK libspdk_blob.so 00:02:17.461 CC lib/blobfs/blobfs.o 00:02:17.461 CC lib/blobfs/tree.o 00:02:17.461 CC lib/lvol/lvol.o 00:02:18.027 LIB libspdk_bdev.a 00:02:18.027 SO libspdk_bdev.so.14.0 00:02:18.293 LIB libspdk_blobfs.a 00:02:18.293 SO libspdk_blobfs.so.9.0 00:02:18.293 LIB libspdk_lvol.a 00:02:18.293 SYMLINK libspdk_bdev.so 00:02:18.293 SO libspdk_lvol.so.9.1 00:02:18.293 SYMLINK libspdk_blobfs.so 00:02:18.293 SYMLINK libspdk_lvol.so 00:02:18.293 CC lib/nvmf/ctrlr.o 00:02:18.293 CC lib/nvmf/ctrlr_discovery.o 00:02:18.293 CC lib/scsi/dev.o 00:02:18.293 CC lib/ublk/ublk.o 00:02:18.293 CC lib/nvmf/ctrlr_bdev.o 00:02:18.293 CC lib/scsi/lun.o 00:02:18.293 CC lib/ublk/ublk_rpc.o 00:02:18.293 CC lib/nvmf/subsystem.o 00:02:18.293 CC lib/scsi/port.o 00:02:18.293 CC lib/ftl/ftl_core.o 00:02:18.293 CC lib/nbd/nbd.o 00:02:18.293 CC lib/nvmf/nvmf.o 00:02:18.293 CC lib/scsi/scsi.o 00:02:18.293 CC lib/ftl/ftl_init.o 00:02:18.293 CC lib/nvmf/nvmf_rpc.o 00:02:18.293 CC lib/scsi/scsi_bdev.o 00:02:18.293 CC lib/nbd/nbd_rpc.o 00:02:18.293 CC lib/nvmf/transport.o 00:02:18.293 CC lib/scsi/scsi_pr.o 00:02:18.293 CC lib/ftl/ftl_layout.o 00:02:18.293 CC lib/nvmf/tcp.o 00:02:18.293 CC lib/ftl/ftl_debug.o 00:02:18.293 CC lib/scsi/scsi_rpc.o 00:02:18.293 CC lib/nvmf/rdma.o 00:02:18.293 CC lib/ftl/ftl_io.o 00:02:18.293 CC lib/scsi/task.o 00:02:18.293 CC lib/ftl/ftl_sb.o 00:02:18.293 CC lib/ftl/ftl_l2p.o 00:02:18.293 CC lib/ftl/ftl_nv_cache.o 00:02:18.293 CC lib/ftl/ftl_l2p_flat.o 00:02:18.293 CC lib/ftl/ftl_band.o 00:02:18.293 CC lib/ftl/ftl_band_ops.o 00:02:18.293 CC lib/ftl/ftl_writer.o 00:02:18.293 CC lib/ftl/ftl_rq.o 00:02:18.293 CC lib/ftl/ftl_reloc.o 00:02:18.293 CC lib/ftl/ftl_l2p_cache.o 00:02:18.293 CC lib/ftl/ftl_p2l.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:18.293 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:18.554 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:18.554 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:18.554 CC lib/ftl/utils/ftl_conf.o 00:02:18.817 CC lib/ftl/utils/ftl_md.o 00:02:18.817 CC lib/ftl/utils/ftl_mempool.o 00:02:18.817 CC lib/ftl/utils/ftl_bitmap.o 00:02:18.817 CC lib/ftl/utils/ftl_property.o 00:02:18.817 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:18.817 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:18.817 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:18.817 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:18.817 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:18.817 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:18.817 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:18.817 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:18.817 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:18.817 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:18.817 CC lib/ftl/base/ftl_base_dev.o 00:02:18.817 CC lib/ftl/base/ftl_base_bdev.o 00:02:18.817 CC lib/ftl/ftl_trace.o 00:02:19.076 LIB libspdk_nbd.a 00:02:19.076 SO libspdk_nbd.so.6.0 00:02:19.076 LIB libspdk_scsi.a 00:02:19.076 SYMLINK libspdk_nbd.so 00:02:19.335 SO libspdk_scsi.so.8.0 00:02:19.335 LIB libspdk_ublk.a 00:02:19.335 SO libspdk_ublk.so.2.0 00:02:19.335 SYMLINK libspdk_scsi.so 00:02:19.335 SYMLINK libspdk_ublk.so 00:02:19.335 CC lib/iscsi/conn.o 00:02:19.335 CC lib/vhost/vhost.o 00:02:19.335 CC lib/iscsi/init_grp.o 00:02:19.335 CC lib/vhost/vhost_rpc.o 00:02:19.335 CC lib/vhost/vhost_scsi.o 00:02:19.335 CC lib/iscsi/iscsi.o 00:02:19.335 CC lib/vhost/vhost_blk.o 00:02:19.335 CC lib/iscsi/md5.o 00:02:19.335 CC lib/iscsi/param.o 00:02:19.335 CC lib/vhost/rte_vhost_user.o 00:02:19.335 CC lib/iscsi/portal_grp.o 00:02:19.335 CC lib/iscsi/tgt_node.o 00:02:19.335 CC lib/iscsi/iscsi_subsystem.o 00:02:19.335 CC lib/iscsi/iscsi_rpc.o 00:02:19.335 CC lib/iscsi/task.o 00:02:19.593 LIB libspdk_ftl.a 00:02:19.852 SO libspdk_ftl.so.8.0 00:02:20.110 SYMLINK libspdk_ftl.so 00:02:20.680 LIB libspdk_vhost.a 00:02:20.680 SO libspdk_vhost.so.7.1 00:02:20.680 SYMLINK libspdk_vhost.so 00:02:20.680 LIB libspdk_nvmf.a 00:02:20.939 LIB libspdk_iscsi.a 00:02:20.940 SO libspdk_nvmf.so.17.0 00:02:20.940 SO libspdk_iscsi.so.7.0 00:02:20.940 SYMLINK libspdk_nvmf.so 00:02:20.940 SYMLINK libspdk_iscsi.so 00:02:21.198 CC module/env_dpdk/env_dpdk_rpc.o 00:02:21.198 CC module/scheduler/gscheduler/gscheduler.o 00:02:21.198 CC module/accel/dsa/accel_dsa.o 00:02:21.198 CC module/sock/posix/posix.o 00:02:21.198 CC module/accel/dsa/accel_dsa_rpc.o 00:02:21.198 CC module/blob/bdev/blob_bdev.o 00:02:21.198 CC module/accel/ioat/accel_ioat.o 00:02:21.198 CC module/accel/iaa/accel_iaa.o 00:02:21.198 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:21.198 CC module/accel/error/accel_error.o 00:02:21.198 CC module/accel/ioat/accel_ioat_rpc.o 00:02:21.198 CC module/accel/iaa/accel_iaa_rpc.o 00:02:21.198 CC module/accel/error/accel_error_rpc.o 00:02:21.198 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:21.456 LIB libspdk_env_dpdk_rpc.a 00:02:21.456 SO libspdk_env_dpdk_rpc.so.5.0 00:02:21.456 SYMLINK libspdk_env_dpdk_rpc.so 00:02:21.457 LIB libspdk_scheduler_gscheduler.a 00:02:21.457 LIB libspdk_scheduler_dpdk_governor.a 00:02:21.457 SO libspdk_scheduler_gscheduler.so.3.0 00:02:21.457 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:21.457 LIB libspdk_accel_error.a 00:02:21.457 LIB libspdk_accel_ioat.a 00:02:21.457 LIB libspdk_scheduler_dynamic.a 00:02:21.457 LIB libspdk_accel_iaa.a 00:02:21.457 SO libspdk_accel_error.so.1.0 00:02:21.457 SO libspdk_accel_ioat.so.5.0 00:02:21.457 SYMLINK libspdk_scheduler_gscheduler.so 00:02:21.457 SO libspdk_scheduler_dynamic.so.3.0 00:02:21.457 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:21.457 SO libspdk_accel_iaa.so.2.0 00:02:21.457 LIB libspdk_accel_dsa.a 00:02:21.457 SYMLINK libspdk_accel_error.so 00:02:21.457 SYMLINK libspdk_accel_ioat.so 00:02:21.457 SYMLINK libspdk_scheduler_dynamic.so 00:02:21.457 SO libspdk_accel_dsa.so.4.0 00:02:21.457 LIB libspdk_blob_bdev.a 00:02:21.457 SYMLINK libspdk_accel_iaa.so 00:02:21.457 SO libspdk_blob_bdev.so.10.1 00:02:21.717 SYMLINK libspdk_accel_dsa.so 00:02:21.717 SYMLINK libspdk_blob_bdev.so 00:02:21.717 CC module/bdev/delay/vbdev_delay.o 00:02:21.717 CC module/bdev/lvol/vbdev_lvol.o 00:02:21.717 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:21.717 CC module/bdev/aio/bdev_aio.o 00:02:21.717 CC module/bdev/raid/bdev_raid.o 00:02:21.717 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:21.717 CC module/bdev/passthru/vbdev_passthru.o 00:02:21.717 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:21.717 CC module/bdev/aio/bdev_aio_rpc.o 00:02:21.717 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:21.717 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:21.717 CC module/bdev/gpt/gpt.o 00:02:21.717 CC module/bdev/nvme/bdev_nvme.o 00:02:21.717 CC module/bdev/raid/bdev_raid_rpc.o 00:02:21.717 CC module/bdev/split/vbdev_split.o 00:02:21.717 CC module/bdev/raid/bdev_raid_sb.o 00:02:21.717 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:21.717 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:21.717 CC module/bdev/raid/raid0.o 00:02:21.717 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:21.717 CC module/bdev/malloc/bdev_malloc.o 00:02:21.717 CC module/bdev/split/vbdev_split_rpc.o 00:02:21.717 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:21.717 CC module/bdev/nvme/nvme_rpc.o 00:02:21.717 CC module/bdev/gpt/vbdev_gpt.o 00:02:21.717 CC module/bdev/error/vbdev_error.o 00:02:21.717 CC module/bdev/iscsi/bdev_iscsi.o 00:02:21.717 CC module/bdev/ftl/bdev_ftl.o 00:02:21.717 CC module/bdev/nvme/bdev_mdns_client.o 00:02:21.717 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:21.717 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:21.717 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:21.717 CC module/bdev/error/vbdev_error_rpc.o 00:02:21.717 CC module/bdev/nvme/vbdev_opal.o 00:02:21.717 CC module/bdev/raid/concat.o 00:02:21.717 CC module/bdev/raid/raid1.o 00:02:21.717 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:21.717 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:21.717 CC module/bdev/null/bdev_null.o 00:02:21.717 CC module/bdev/null/bdev_null_rpc.o 00:02:21.717 CC module/blobfs/bdev/blobfs_bdev.o 00:02:21.717 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:22.284 LIB libspdk_sock_posix.a 00:02:22.284 LIB libspdk_bdev_split.a 00:02:22.284 LIB libspdk_bdev_null.a 00:02:22.284 SO libspdk_bdev_split.so.5.0 00:02:22.284 SO libspdk_sock_posix.so.5.0 00:02:22.284 LIB libspdk_blobfs_bdev.a 00:02:22.284 SO libspdk_bdev_null.so.5.0 00:02:22.284 SO libspdk_blobfs_bdev.so.5.0 00:02:22.284 LIB libspdk_bdev_gpt.a 00:02:22.284 SO libspdk_bdev_gpt.so.5.0 00:02:22.284 LIB libspdk_bdev_error.a 00:02:22.284 SYMLINK libspdk_bdev_split.so 00:02:22.284 SYMLINK libspdk_blobfs_bdev.so 00:02:22.284 SYMLINK libspdk_bdev_null.so 00:02:22.284 SO libspdk_bdev_error.so.5.0 00:02:22.284 LIB libspdk_bdev_passthru.a 00:02:22.284 SYMLINK libspdk_sock_posix.so 00:02:22.284 SYMLINK libspdk_bdev_gpt.so 00:02:22.284 LIB libspdk_bdev_aio.a 00:02:22.284 SO libspdk_bdev_passthru.so.5.0 00:02:22.284 LIB libspdk_bdev_ftl.a 00:02:22.284 LIB libspdk_bdev_zone_block.a 00:02:22.284 SO libspdk_bdev_aio.so.5.0 00:02:22.284 SYMLINK libspdk_bdev_error.so 00:02:22.284 SO libspdk_bdev_ftl.so.5.0 00:02:22.284 SO libspdk_bdev_zone_block.so.5.0 00:02:22.284 SYMLINK libspdk_bdev_passthru.so 00:02:22.284 LIB libspdk_bdev_delay.a 00:02:22.284 SYMLINK libspdk_bdev_aio.so 00:02:22.284 LIB libspdk_bdev_iscsi.a 00:02:22.284 SO libspdk_bdev_delay.so.5.0 00:02:22.284 SYMLINK libspdk_bdev_ftl.so 00:02:22.284 SYMLINK libspdk_bdev_zone_block.so 00:02:22.284 LIB libspdk_bdev_malloc.a 00:02:22.284 SO libspdk_bdev_iscsi.so.5.0 00:02:22.284 SO libspdk_bdev_malloc.so.5.0 00:02:22.542 SYMLINK libspdk_bdev_delay.so 00:02:22.542 SYMLINK libspdk_bdev_iscsi.so 00:02:22.542 SYMLINK libspdk_bdev_malloc.so 00:02:22.542 LIB libspdk_bdev_lvol.a 00:02:22.542 LIB libspdk_bdev_virtio.a 00:02:22.542 SO libspdk_bdev_lvol.so.5.0 00:02:22.542 SO libspdk_bdev_virtio.so.5.0 00:02:22.542 SYMLINK libspdk_bdev_lvol.so 00:02:22.542 SYMLINK libspdk_bdev_virtio.so 00:02:22.801 LIB libspdk_bdev_raid.a 00:02:22.801 SO libspdk_bdev_raid.so.5.0 00:02:22.801 SYMLINK libspdk_bdev_raid.so 00:02:24.176 LIB libspdk_bdev_nvme.a 00:02:24.176 SO libspdk_bdev_nvme.so.6.0 00:02:24.176 SYMLINK libspdk_bdev_nvme.so 00:02:24.434 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:24.434 CC module/event/subsystems/scheduler/scheduler.o 00:02:24.434 CC module/event/subsystems/sock/sock.o 00:02:24.434 CC module/event/subsystems/vmd/vmd.o 00:02:24.434 CC module/event/subsystems/iobuf/iobuf.o 00:02:24.434 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:24.434 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:24.434 LIB libspdk_event_sock.a 00:02:24.434 LIB libspdk_event_vhost_blk.a 00:02:24.434 LIB libspdk_event_scheduler.a 00:02:24.434 LIB libspdk_event_vmd.a 00:02:24.434 SO libspdk_event_sock.so.4.0 00:02:24.434 LIB libspdk_event_iobuf.a 00:02:24.434 SO libspdk_event_vhost_blk.so.2.0 00:02:24.434 SO libspdk_event_scheduler.so.3.0 00:02:24.434 SO libspdk_event_vmd.so.5.0 00:02:24.692 SO libspdk_event_iobuf.so.2.0 00:02:24.693 SYMLINK libspdk_event_sock.so 00:02:24.693 SYMLINK libspdk_event_vhost_blk.so 00:02:24.693 SYMLINK libspdk_event_scheduler.so 00:02:24.693 SYMLINK libspdk_event_vmd.so 00:02:24.693 SYMLINK libspdk_event_iobuf.so 00:02:24.693 CC module/event/subsystems/accel/accel.o 00:02:24.952 LIB libspdk_event_accel.a 00:02:24.952 SO libspdk_event_accel.so.5.0 00:02:24.952 SYMLINK libspdk_event_accel.so 00:02:24.952 CC module/event/subsystems/bdev/bdev.o 00:02:25.211 LIB libspdk_event_bdev.a 00:02:25.211 SO libspdk_event_bdev.so.5.0 00:02:25.211 SYMLINK libspdk_event_bdev.so 00:02:25.469 CC module/event/subsystems/nbd/nbd.o 00:02:25.469 CC module/event/subsystems/scsi/scsi.o 00:02:25.469 CC module/event/subsystems/ublk/ublk.o 00:02:25.469 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:25.469 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:25.469 LIB libspdk_event_nbd.a 00:02:25.469 LIB libspdk_event_ublk.a 00:02:25.469 LIB libspdk_event_scsi.a 00:02:25.469 SO libspdk_event_nbd.so.5.0 00:02:25.469 SO libspdk_event_ublk.so.2.0 00:02:25.469 SO libspdk_event_scsi.so.5.0 00:02:25.727 SYMLINK libspdk_event_nbd.so 00:02:25.727 SYMLINK libspdk_event_ublk.so 00:02:25.727 SYMLINK libspdk_event_scsi.so 00:02:25.727 LIB libspdk_event_nvmf.a 00:02:25.727 SO libspdk_event_nvmf.so.5.0 00:02:25.727 SYMLINK libspdk_event_nvmf.so 00:02:25.727 CC module/event/subsystems/iscsi/iscsi.o 00:02:25.727 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:25.991 LIB libspdk_event_vhost_scsi.a 00:02:25.991 LIB libspdk_event_iscsi.a 00:02:25.991 SO libspdk_event_vhost_scsi.so.2.0 00:02:25.991 SO libspdk_event_iscsi.so.5.0 00:02:25.991 SYMLINK libspdk_event_vhost_scsi.so 00:02:25.991 SYMLINK libspdk_event_iscsi.so 00:02:25.991 SO libspdk.so.5.0 00:02:25.991 SYMLINK libspdk.so 00:02:26.255 CC app/spdk_lspci/spdk_lspci.o 00:02:26.255 CC app/trace_record/trace_record.o 00:02:26.255 CXX app/trace/trace.o 00:02:26.255 CC app/spdk_nvme_discover/discovery_aer.o 00:02:26.255 CC app/spdk_nvme_identify/identify.o 00:02:26.255 CC test/rpc_client/rpc_client_test.o 00:02:26.255 CC app/spdk_top/spdk_top.o 00:02:26.255 TEST_HEADER include/spdk/accel.h 00:02:26.255 CC app/spdk_nvme_perf/perf.o 00:02:26.255 TEST_HEADER include/spdk/accel_module.h 00:02:26.255 TEST_HEADER include/spdk/assert.h 00:02:26.255 TEST_HEADER include/spdk/barrier.h 00:02:26.255 TEST_HEADER include/spdk/base64.h 00:02:26.255 TEST_HEADER include/spdk/bdev.h 00:02:26.255 TEST_HEADER include/spdk/bdev_module.h 00:02:26.255 TEST_HEADER include/spdk/bdev_zone.h 00:02:26.255 TEST_HEADER include/spdk/bit_array.h 00:02:26.255 TEST_HEADER include/spdk/bit_pool.h 00:02:26.255 TEST_HEADER include/spdk/blob_bdev.h 00:02:26.255 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:26.255 TEST_HEADER include/spdk/blobfs.h 00:02:26.255 TEST_HEADER include/spdk/blob.h 00:02:26.255 TEST_HEADER include/spdk/conf.h 00:02:26.255 TEST_HEADER include/spdk/config.h 00:02:26.255 TEST_HEADER include/spdk/cpuset.h 00:02:26.255 CC app/spdk_dd/spdk_dd.o 00:02:26.255 TEST_HEADER include/spdk/crc16.h 00:02:26.255 TEST_HEADER include/spdk/crc32.h 00:02:26.255 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:26.255 TEST_HEADER include/spdk/crc64.h 00:02:26.255 CC app/nvmf_tgt/nvmf_main.o 00:02:26.255 TEST_HEADER include/spdk/dif.h 00:02:26.255 CC app/iscsi_tgt/iscsi_tgt.o 00:02:26.255 TEST_HEADER include/spdk/dma.h 00:02:26.255 TEST_HEADER include/spdk/endian.h 00:02:26.255 TEST_HEADER include/spdk/env_dpdk.h 00:02:26.255 CC examples/ioat/perf/perf.o 00:02:26.255 CC app/vhost/vhost.o 00:02:26.255 CC test/app/histogram_perf/histogram_perf.o 00:02:26.255 TEST_HEADER include/spdk/env.h 00:02:26.255 CC examples/ioat/verify/verify.o 00:02:26.255 CC test/app/jsoncat/jsoncat.o 00:02:26.255 CC app/fio/nvme/fio_plugin.o 00:02:26.255 CC test/nvme/aer/aer.o 00:02:26.255 CC test/app/stub/stub.o 00:02:26.255 CC examples/idxd/perf/perf.o 00:02:26.255 CC test/nvme/reset/reset.o 00:02:26.255 CC test/thread/poller_perf/poller_perf.o 00:02:26.255 CC test/event/event_perf/event_perf.o 00:02:26.255 TEST_HEADER include/spdk/event.h 00:02:26.255 CC test/event/reactor_perf/reactor_perf.o 00:02:26.255 CC test/event/reactor/reactor.o 00:02:26.255 CC examples/vmd/lsvmd/lsvmd.o 00:02:26.255 TEST_HEADER include/spdk/fd_group.h 00:02:26.255 CC examples/nvme/hello_world/hello_world.o 00:02:26.255 TEST_HEADER include/spdk/fd.h 00:02:26.255 CC examples/util/zipf/zipf.o 00:02:26.255 TEST_HEADER include/spdk/file.h 00:02:26.255 TEST_HEADER include/spdk/ftl.h 00:02:26.255 CC examples/sock/hello_world/hello_sock.o 00:02:26.255 TEST_HEADER include/spdk/gpt_spec.h 00:02:26.255 CC examples/accel/perf/accel_perf.o 00:02:26.255 TEST_HEADER include/spdk/hexlify.h 00:02:26.255 TEST_HEADER include/spdk/histogram_data.h 00:02:26.255 CC test/event/app_repeat/app_repeat.o 00:02:26.255 CC app/spdk_tgt/spdk_tgt.o 00:02:26.255 TEST_HEADER include/spdk/idxd.h 00:02:26.255 TEST_HEADER include/spdk/idxd_spec.h 00:02:26.255 TEST_HEADER include/spdk/init.h 00:02:26.255 TEST_HEADER include/spdk/ioat.h 00:02:26.255 TEST_HEADER include/spdk/ioat_spec.h 00:02:26.255 TEST_HEADER include/spdk/iscsi_spec.h 00:02:26.255 TEST_HEADER include/spdk/json.h 00:02:26.255 TEST_HEADER include/spdk/jsonrpc.h 00:02:26.255 CC examples/blob/cli/blobcli.o 00:02:26.255 TEST_HEADER include/spdk/likely.h 00:02:26.255 TEST_HEADER include/spdk/log.h 00:02:26.255 CC examples/nvmf/nvmf/nvmf.o 00:02:26.255 TEST_HEADER include/spdk/lvol.h 00:02:26.255 CC test/accel/dif/dif.o 00:02:26.255 CC examples/thread/thread/thread_ex.o 00:02:26.255 CC examples/blob/hello_world/hello_blob.o 00:02:26.255 TEST_HEADER include/spdk/memory.h 00:02:26.255 CC examples/bdev/hello_world/hello_bdev.o 00:02:26.255 CC test/blobfs/mkfs/mkfs.o 00:02:26.255 CC test/app/bdev_svc/bdev_svc.o 00:02:26.255 TEST_HEADER include/spdk/mmio.h 00:02:26.255 CC test/dma/test_dma/test_dma.o 00:02:26.255 TEST_HEADER include/spdk/nbd.h 00:02:26.255 CC test/bdev/bdevio/bdevio.o 00:02:26.255 CC examples/bdev/bdevperf/bdevperf.o 00:02:26.255 TEST_HEADER include/spdk/notify.h 00:02:26.255 CC test/env/mem_callbacks/mem_callbacks.o 00:02:26.518 TEST_HEADER include/spdk/nvme.h 00:02:26.518 TEST_HEADER include/spdk/nvme_intel.h 00:02:26.518 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:26.518 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:26.518 CC test/lvol/esnap/esnap.o 00:02:26.518 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:26.518 TEST_HEADER include/spdk/nvme_spec.h 00:02:26.518 TEST_HEADER include/spdk/nvme_zns.h 00:02:26.518 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:26.518 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:26.518 TEST_HEADER include/spdk/nvmf.h 00:02:26.518 TEST_HEADER include/spdk/nvmf_spec.h 00:02:26.518 TEST_HEADER include/spdk/nvmf_transport.h 00:02:26.519 TEST_HEADER include/spdk/opal.h 00:02:26.519 TEST_HEADER include/spdk/opal_spec.h 00:02:26.519 TEST_HEADER include/spdk/pci_ids.h 00:02:26.519 TEST_HEADER include/spdk/pipe.h 00:02:26.519 TEST_HEADER include/spdk/queue.h 00:02:26.519 TEST_HEADER include/spdk/reduce.h 00:02:26.519 TEST_HEADER include/spdk/rpc.h 00:02:26.519 TEST_HEADER include/spdk/scheduler.h 00:02:26.519 TEST_HEADER include/spdk/scsi.h 00:02:26.519 TEST_HEADER include/spdk/scsi_spec.h 00:02:26.519 TEST_HEADER include/spdk/sock.h 00:02:26.519 TEST_HEADER include/spdk/stdinc.h 00:02:26.519 LINK spdk_lspci 00:02:26.519 TEST_HEADER include/spdk/string.h 00:02:26.519 TEST_HEADER include/spdk/thread.h 00:02:26.519 TEST_HEADER include/spdk/trace.h 00:02:26.519 TEST_HEADER include/spdk/trace_parser.h 00:02:26.519 TEST_HEADER include/spdk/tree.h 00:02:26.519 TEST_HEADER include/spdk/ublk.h 00:02:26.519 TEST_HEADER include/spdk/util.h 00:02:26.519 TEST_HEADER include/spdk/uuid.h 00:02:26.519 TEST_HEADER include/spdk/version.h 00:02:26.519 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:26.519 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:26.519 TEST_HEADER include/spdk/vhost.h 00:02:26.519 TEST_HEADER include/spdk/vmd.h 00:02:26.519 TEST_HEADER include/spdk/xor.h 00:02:26.519 TEST_HEADER include/spdk/zipf.h 00:02:26.519 CXX test/cpp_headers/accel.o 00:02:26.519 LINK rpc_client_test 00:02:26.519 LINK lsvmd 00:02:26.519 LINK jsoncat 00:02:26.519 LINK reactor_perf 00:02:26.519 LINK reactor 00:02:26.519 LINK spdk_nvme_discover 00:02:26.519 LINK histogram_perf 00:02:26.519 LINK event_perf 00:02:26.519 LINK zipf 00:02:26.519 LINK poller_perf 00:02:26.519 LINK app_repeat 00:02:26.519 LINK interrupt_tgt 00:02:26.780 LINK nvmf_tgt 00:02:26.780 LINK stub 00:02:26.780 LINK vhost 00:02:26.780 LINK iscsi_tgt 00:02:26.780 LINK spdk_trace_record 00:02:26.780 LINK bdev_svc 00:02:26.780 LINK ioat_perf 00:02:26.780 LINK verify 00:02:26.780 LINK spdk_tgt 00:02:26.780 LINK hello_world 00:02:26.780 LINK mkfs 00:02:26.780 LINK hello_sock 00:02:26.780 LINK reset 00:02:26.780 LINK hello_blob 00:02:26.780 LINK hello_bdev 00:02:26.780 LINK aer 00:02:26.780 LINK thread 00:02:26.780 CC test/nvme/sgl/sgl.o 00:02:26.780 CXX test/cpp_headers/accel_module.o 00:02:26.780 CXX test/cpp_headers/assert.o 00:02:27.046 LINK nvmf 00:02:27.046 LINK idxd_perf 00:02:27.046 CC examples/vmd/led/led.o 00:02:27.046 CC test/env/vtophys/vtophys.o 00:02:27.046 CXX test/cpp_headers/barrier.o 00:02:27.046 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:27.046 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:27.046 LINK spdk_dd 00:02:27.046 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:27.046 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:27.046 CC test/env/memory/memory_ut.o 00:02:27.046 CC examples/nvme/reconnect/reconnect.o 00:02:27.046 CC test/nvme/e2edp/nvme_dp.o 00:02:27.046 CXX test/cpp_headers/base64.o 00:02:27.046 CC app/fio/bdev/fio_plugin.o 00:02:27.046 LINK spdk_trace 00:02:27.046 LINK dif 00:02:27.046 LINK test_dma 00:02:27.046 CC test/env/pci/pci_ut.o 00:02:27.046 CXX test/cpp_headers/bdev.o 00:02:27.046 CXX test/cpp_headers/bdev_module.o 00:02:27.046 CXX test/cpp_headers/bdev_zone.o 00:02:27.046 LINK bdevio 00:02:27.046 CC test/nvme/overhead/overhead.o 00:02:27.046 CC test/event/scheduler/scheduler.o 00:02:27.046 CXX test/cpp_headers/bit_array.o 00:02:27.046 CC test/nvme/err_injection/err_injection.o 00:02:27.046 CXX test/cpp_headers/bit_pool.o 00:02:27.046 CC test/nvme/startup/startup.o 00:02:27.317 CC test/nvme/reserve/reserve.o 00:02:27.317 LINK accel_perf 00:02:27.317 LINK nvme_fuzz 00:02:27.317 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:27.317 CXX test/cpp_headers/blob_bdev.o 00:02:27.317 CXX test/cpp_headers/blobfs_bdev.o 00:02:27.317 LINK led 00:02:27.317 CC examples/nvme/arbitration/arbitration.o 00:02:27.317 CXX test/cpp_headers/blobfs.o 00:02:27.317 LINK vtophys 00:02:27.317 CXX test/cpp_headers/blob.o 00:02:27.317 LINK blobcli 00:02:27.317 CC examples/nvme/hotplug/hotplug.o 00:02:27.317 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:27.317 LINK env_dpdk_post_init 00:02:27.317 CC test/nvme/simple_copy/simple_copy.o 00:02:27.317 CC test/nvme/connect_stress/connect_stress.o 00:02:27.317 LINK spdk_nvme 00:02:27.317 LINK sgl 00:02:27.317 CXX test/cpp_headers/conf.o 00:02:27.583 CC examples/nvme/abort/abort.o 00:02:27.583 CC test/nvme/boot_partition/boot_partition.o 00:02:27.583 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:27.583 CXX test/cpp_headers/config.o 00:02:27.583 CXX test/cpp_headers/cpuset.o 00:02:27.583 CXX test/cpp_headers/crc16.o 00:02:27.583 CXX test/cpp_headers/crc32.o 00:02:27.583 LINK startup 00:02:27.583 CC test/nvme/compliance/nvme_compliance.o 00:02:27.583 LINK err_injection 00:02:27.583 CXX test/cpp_headers/crc64.o 00:02:27.583 CXX test/cpp_headers/dif.o 00:02:27.583 CXX test/cpp_headers/dma.o 00:02:27.583 CC test/nvme/fused_ordering/fused_ordering.o 00:02:27.583 LINK scheduler 00:02:27.583 LINK mem_callbacks 00:02:27.583 CXX test/cpp_headers/endian.o 00:02:27.583 LINK nvme_dp 00:02:27.583 CXX test/cpp_headers/env_dpdk.o 00:02:27.583 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:27.583 LINK reserve 00:02:27.583 CC test/nvme/cuse/cuse.o 00:02:27.583 CC test/nvme/fdp/fdp.o 00:02:27.583 CXX test/cpp_headers/env.o 00:02:27.583 CXX test/cpp_headers/event.o 00:02:27.583 CXX test/cpp_headers/fd_group.o 00:02:27.583 CXX test/cpp_headers/fd.o 00:02:27.583 CXX test/cpp_headers/file.o 00:02:27.583 LINK reconnect 00:02:27.583 LINK cmb_copy 00:02:27.583 LINK overhead 00:02:27.583 CXX test/cpp_headers/ftl.o 00:02:27.845 LINK connect_stress 00:02:27.845 CXX test/cpp_headers/gpt_spec.o 00:02:27.845 CXX test/cpp_headers/hexlify.o 00:02:27.845 LINK spdk_nvme_identify 00:02:27.845 LINK hotplug 00:02:27.845 LINK spdk_nvme_perf 00:02:27.845 LINK vhost_fuzz 00:02:27.845 CXX test/cpp_headers/histogram_data.o 00:02:27.845 LINK simple_copy 00:02:27.845 LINK boot_partition 00:02:27.845 LINK pci_ut 00:02:27.845 LINK bdevperf 00:02:27.845 CXX test/cpp_headers/idxd.o 00:02:27.845 CXX test/cpp_headers/idxd_spec.o 00:02:27.845 LINK pmr_persistence 00:02:27.845 CXX test/cpp_headers/init.o 00:02:27.845 LINK spdk_top 00:02:27.845 CXX test/cpp_headers/ioat.o 00:02:27.845 CXX test/cpp_headers/ioat_spec.o 00:02:27.845 CXX test/cpp_headers/iscsi_spec.o 00:02:27.845 LINK arbitration 00:02:27.845 CXX test/cpp_headers/json.o 00:02:27.845 CXX test/cpp_headers/jsonrpc.o 00:02:27.846 CXX test/cpp_headers/likely.o 00:02:27.846 CXX test/cpp_headers/log.o 00:02:27.846 CXX test/cpp_headers/lvol.o 00:02:27.846 CXX test/cpp_headers/memory.o 00:02:27.846 CXX test/cpp_headers/mmio.o 00:02:27.846 LINK fused_ordering 00:02:28.113 LINK doorbell_aers 00:02:28.113 CXX test/cpp_headers/nbd.o 00:02:28.113 LINK spdk_bdev 00:02:28.113 CXX test/cpp_headers/notify.o 00:02:28.113 CXX test/cpp_headers/nvme.o 00:02:28.113 CXX test/cpp_headers/nvme_intel.o 00:02:28.113 CXX test/cpp_headers/nvme_ocssd.o 00:02:28.113 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:28.113 CXX test/cpp_headers/nvme_spec.o 00:02:28.113 CXX test/cpp_headers/nvme_zns.o 00:02:28.113 CXX test/cpp_headers/nvmf_cmd.o 00:02:28.113 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:28.113 CXX test/cpp_headers/nvmf.o 00:02:28.113 CXX test/cpp_headers/nvmf_spec.o 00:02:28.113 CXX test/cpp_headers/nvmf_transport.o 00:02:28.113 CXX test/cpp_headers/opal.o 00:02:28.113 CXX test/cpp_headers/opal_spec.o 00:02:28.113 CXX test/cpp_headers/pci_ids.o 00:02:28.113 CXX test/cpp_headers/pipe.o 00:02:28.113 CXX test/cpp_headers/queue.o 00:02:28.113 CXX test/cpp_headers/reduce.o 00:02:28.113 LINK nvme_manage 00:02:28.113 CXX test/cpp_headers/rpc.o 00:02:28.113 CXX test/cpp_headers/scheduler.o 00:02:28.113 LINK nvme_compliance 00:02:28.113 CXX test/cpp_headers/scsi.o 00:02:28.113 CXX test/cpp_headers/scsi_spec.o 00:02:28.113 CXX test/cpp_headers/sock.o 00:02:28.113 CXX test/cpp_headers/stdinc.o 00:02:28.113 LINK abort 00:02:28.113 CXX test/cpp_headers/string.o 00:02:28.113 CXX test/cpp_headers/thread.o 00:02:28.113 CXX test/cpp_headers/trace.o 00:02:28.113 CXX test/cpp_headers/trace_parser.o 00:02:28.372 CXX test/cpp_headers/tree.o 00:02:28.372 CXX test/cpp_headers/ublk.o 00:02:28.372 LINK fdp 00:02:28.372 CXX test/cpp_headers/util.o 00:02:28.372 CXX test/cpp_headers/uuid.o 00:02:28.372 CXX test/cpp_headers/version.o 00:02:28.372 CXX test/cpp_headers/vfio_user_pci.o 00:02:28.372 CXX test/cpp_headers/vfio_user_spec.o 00:02:28.372 CXX test/cpp_headers/vhost.o 00:02:28.372 CXX test/cpp_headers/vmd.o 00:02:28.372 CXX test/cpp_headers/xor.o 00:02:28.372 CXX test/cpp_headers/zipf.o 00:02:28.630 LINK memory_ut 00:02:29.197 LINK cuse 00:02:29.197 LINK iscsi_fuzz 00:02:32.479 LINK esnap 00:02:32.479 00:02:32.479 real 0m46.663s 00:02:32.479 user 9m41.205s 00:02:32.479 sys 2m9.700s 00:02:32.479 08:10:18 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:32.479 08:10:18 -- common/autotest_common.sh@10 -- $ set +x 00:02:32.479 ************************************ 00:02:32.479 END TEST make 00:02:32.479 ************************************ 00:02:32.479 08:10:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:32.479 08:10:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:32.479 08:10:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:32.479 08:10:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:32.479 08:10:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:32.479 08:10:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:32.479 08:10:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:32.479 08:10:18 -- scripts/common.sh@335 -- # IFS=.-: 00:02:32.479 08:10:18 -- scripts/common.sh@335 -- # read -ra ver1 00:02:32.479 08:10:18 -- scripts/common.sh@336 -- # IFS=.-: 00:02:32.479 08:10:18 -- scripts/common.sh@336 -- # read -ra ver2 00:02:32.479 08:10:18 -- scripts/common.sh@337 -- # local 'op=<' 00:02:32.479 08:10:18 -- scripts/common.sh@339 -- # ver1_l=2 00:02:32.479 08:10:18 -- scripts/common.sh@340 -- # ver2_l=1 00:02:32.479 08:10:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:32.479 08:10:18 -- scripts/common.sh@343 -- # case "$op" in 00:02:32.479 08:10:18 -- scripts/common.sh@344 -- # : 1 00:02:32.479 08:10:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:32.479 08:10:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:32.479 08:10:18 -- scripts/common.sh@364 -- # decimal 1 00:02:32.479 08:10:18 -- scripts/common.sh@352 -- # local d=1 00:02:32.479 08:10:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:32.479 08:10:18 -- scripts/common.sh@354 -- # echo 1 00:02:32.479 08:10:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:32.479 08:10:18 -- scripts/common.sh@365 -- # decimal 2 00:02:32.479 08:10:18 -- scripts/common.sh@352 -- # local d=2 00:02:32.479 08:10:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:32.479 08:10:18 -- scripts/common.sh@354 -- # echo 2 00:02:32.479 08:10:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:32.479 08:10:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:32.479 08:10:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:32.479 08:10:18 -- scripts/common.sh@367 -- # return 0 00:02:32.479 08:10:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:32.479 08:10:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:32.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.479 --rc genhtml_branch_coverage=1 00:02:32.479 --rc genhtml_function_coverage=1 00:02:32.479 --rc genhtml_legend=1 00:02:32.479 --rc geninfo_all_blocks=1 00:02:32.479 --rc geninfo_unexecuted_blocks=1 00:02:32.479 00:02:32.479 ' 00:02:32.479 08:10:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:32.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.479 --rc genhtml_branch_coverage=1 00:02:32.479 --rc genhtml_function_coverage=1 00:02:32.479 --rc genhtml_legend=1 00:02:32.479 --rc geninfo_all_blocks=1 00:02:32.479 --rc geninfo_unexecuted_blocks=1 00:02:32.479 00:02:32.479 ' 00:02:32.479 08:10:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:32.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.479 --rc genhtml_branch_coverage=1 00:02:32.479 --rc genhtml_function_coverage=1 00:02:32.479 --rc genhtml_legend=1 00:02:32.479 --rc geninfo_all_blocks=1 00:02:32.479 --rc geninfo_unexecuted_blocks=1 00:02:32.479 00:02:32.479 ' 00:02:32.479 08:10:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:32.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.479 --rc genhtml_branch_coverage=1 00:02:32.479 --rc genhtml_function_coverage=1 00:02:32.479 --rc genhtml_legend=1 00:02:32.479 --rc geninfo_all_blocks=1 00:02:32.479 --rc geninfo_unexecuted_blocks=1 00:02:32.479 00:02:32.479 ' 00:02:32.479 08:10:18 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:32.479 08:10:18 -- nvmf/common.sh@7 -- # uname -s 00:02:32.479 08:10:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:32.479 08:10:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:32.479 08:10:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:32.479 08:10:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:32.479 08:10:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:32.479 08:10:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:32.479 08:10:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:32.479 08:10:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:32.479 08:10:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:32.479 08:10:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:32.479 08:10:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:32.479 08:10:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:32.479 08:10:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:32.479 08:10:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:32.479 08:10:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:32.479 08:10:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:32.479 08:10:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:32.479 08:10:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:32.479 08:10:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:32.479 08:10:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.479 08:10:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.479 08:10:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.479 08:10:18 -- paths/export.sh@5 -- # export PATH 00:02:32.479 08:10:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.479 08:10:18 -- nvmf/common.sh@46 -- # : 0 00:02:32.479 08:10:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:32.479 08:10:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:32.479 08:10:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:32.479 08:10:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:32.479 08:10:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:32.479 08:10:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:32.479 08:10:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:32.479 08:10:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:32.479 08:10:18 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:32.479 08:10:18 -- spdk/autotest.sh@32 -- # uname -s 00:02:32.479 08:10:18 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:32.479 08:10:18 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:32.479 08:10:18 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:32.479 08:10:18 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:32.479 08:10:18 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:32.479 08:10:18 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:32.479 08:10:18 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:32.479 08:10:18 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:32.479 08:10:18 -- spdk/autotest.sh@48 -- # udevadm_pid=805081 00:02:32.479 08:10:18 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:32.479 08:10:18 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.479 08:10:18 -- spdk/autotest.sh@54 -- # echo 805083 00:02:32.479 08:10:18 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.479 08:10:18 -- spdk/autotest.sh@56 -- # echo 805084 00:02:32.479 08:10:18 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.479 08:10:18 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:32.479 08:10:18 -- spdk/autotest.sh@60 -- # echo 805085 00:02:32.479 08:10:18 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:32.479 08:10:18 -- spdk/autotest.sh@62 -- # echo 805086 00:02:32.479 08:10:18 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:32.479 08:10:18 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:32.479 08:10:18 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:32.479 08:10:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:32.479 08:10:18 -- common/autotest_common.sh@10 -- # set +x 00:02:32.479 08:10:18 -- spdk/autotest.sh@70 -- # create_test_list 00:02:32.479 08:10:18 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:32.479 08:10:18 -- common/autotest_common.sh@10 -- # set +x 00:02:32.479 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:32.739 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:32.739 08:10:18 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:32.739 08:10:18 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.739 08:10:18 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.739 08:10:18 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:32.739 08:10:18 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.739 08:10:18 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:32.739 08:10:18 -- common/autotest_common.sh@1450 -- # uname 00:02:32.739 08:10:18 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:32.739 08:10:18 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:32.739 08:10:18 -- common/autotest_common.sh@1470 -- # uname 00:02:32.739 08:10:18 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:32.739 08:10:18 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:32.739 08:10:18 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:32.739 lcov: LCOV version 1.15 00:02:32.739 08:10:18 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:36.027 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:36.027 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:36.027 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:36.027 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:36.027 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:36.027 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:08.098 08:10:51 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:08.098 08:10:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:08.098 08:10:51 -- common/autotest_common.sh@10 -- # set +x 00:03:08.098 08:10:51 -- spdk/autotest.sh@89 -- # rm -f 00:03:08.098 08:10:51 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:08.098 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:08.098 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:08.098 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:08.098 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:08.098 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:08.098 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:08.098 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:08.098 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:08.098 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:08.098 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:08.098 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:08.098 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:08.098 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:08.098 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:08.098 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:08.098 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:08.098 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:08.098 08:10:52 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:08.098 08:10:52 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:08.098 08:10:52 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:08.098 08:10:52 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:08.098 08:10:52 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:08.098 08:10:52 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:08.098 08:10:52 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:08.098 08:10:52 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:08.098 08:10:52 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:08.098 08:10:52 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:08.098 08:10:52 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:08.098 08:10:52 -- spdk/autotest.sh@108 -- # grep -v p 00:03:08.098 08:10:52 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:08.098 08:10:52 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:08.098 08:10:52 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:08.098 08:10:52 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:08.098 08:10:52 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:08.098 No valid GPT data, bailing 00:03:08.098 08:10:52 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:08.098 08:10:52 -- scripts/common.sh@393 -- # pt= 00:03:08.098 08:10:52 -- scripts/common.sh@394 -- # return 1 00:03:08.098 08:10:52 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:08.098 1+0 records in 00:03:08.098 1+0 records out 00:03:08.098 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00145295 s, 722 MB/s 00:03:08.098 08:10:52 -- spdk/autotest.sh@116 -- # sync 00:03:08.098 08:10:52 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:08.098 08:10:52 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:08.098 08:10:52 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:08.666 08:10:54 -- spdk/autotest.sh@122 -- # uname -s 00:03:08.666 08:10:54 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:08.666 08:10:54 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.666 08:10:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.666 08:10:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.666 08:10:54 -- common/autotest_common.sh@10 -- # set +x 00:03:08.666 ************************************ 00:03:08.666 START TEST setup.sh 00:03:08.666 ************************************ 00:03:08.666 08:10:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.958 * Looking for test storage... 00:03:08.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.958 08:10:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.958 08:10:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.958 08:10:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.958 08:10:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.958 08:10:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.958 08:10:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.958 08:10:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.958 08:10:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.958 08:10:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.958 08:10:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.958 08:10:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.958 08:10:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.958 08:10:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.958 08:10:54 -- scripts/common.sh@344 -- # : 1 00:03:08.958 08:10:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.958 08:10:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.958 08:10:54 -- scripts/common.sh@364 -- # decimal 1 00:03:08.958 08:10:54 -- scripts/common.sh@352 -- # local d=1 00:03:08.958 08:10:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.958 08:10:54 -- scripts/common.sh@354 -- # echo 1 00:03:08.958 08:10:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.958 08:10:54 -- scripts/common.sh@365 -- # decimal 2 00:03:08.958 08:10:54 -- scripts/common.sh@352 -- # local d=2 00:03:08.958 08:10:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.958 08:10:54 -- scripts/common.sh@354 -- # echo 2 00:03:08.958 08:10:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.958 08:10:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.958 08:10:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.958 08:10:54 -- scripts/common.sh@367 -- # return 0 00:03:08.958 08:10:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- setup/test-setup.sh@10 -- # uname -s 00:03:08.958 08:10:54 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:08.958 08:10:54 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.958 08:10:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.958 08:10:54 -- common/autotest_common.sh@10 -- # set +x 00:03:08.958 ************************************ 00:03:08.958 START TEST acl 00:03:08.958 ************************************ 00:03:08.958 08:10:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.958 * Looking for test storage... 00:03:08.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.958 08:10:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.958 08:10:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.958 08:10:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.958 08:10:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.958 08:10:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.958 08:10:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.958 08:10:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.958 08:10:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.958 08:10:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.958 08:10:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.958 08:10:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.958 08:10:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.958 08:10:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.958 08:10:54 -- scripts/common.sh@344 -- # : 1 00:03:08.958 08:10:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.958 08:10:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.958 08:10:54 -- scripts/common.sh@364 -- # decimal 1 00:03:08.958 08:10:54 -- scripts/common.sh@352 -- # local d=1 00:03:08.958 08:10:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.958 08:10:54 -- scripts/common.sh@354 -- # echo 1 00:03:08.958 08:10:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.958 08:10:54 -- scripts/common.sh@365 -- # decimal 2 00:03:08.958 08:10:54 -- scripts/common.sh@352 -- # local d=2 00:03:08.958 08:10:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.958 08:10:54 -- scripts/common.sh@354 -- # echo 2 00:03:08.958 08:10:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.958 08:10:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.958 08:10:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.958 08:10:54 -- scripts/common.sh@367 -- # return 0 00:03:08.958 08:10:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.958 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.958 --rc genhtml_branch_coverage=1 00:03:08.958 --rc genhtml_function_coverage=1 00:03:08.958 --rc genhtml_legend=1 00:03:08.958 --rc geninfo_all_blocks=1 00:03:08.958 --rc geninfo_unexecuted_blocks=1 00:03:08.958 00:03:08.958 ' 00:03:08.958 08:10:54 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:08.958 08:10:54 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:08.958 08:10:54 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:08.958 08:10:54 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:08.958 08:10:54 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:08.958 08:10:54 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:08.958 08:10:54 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:08.958 08:10:54 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:08.958 08:10:54 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:08.958 08:10:54 -- setup/acl.sh@12 -- # devs=() 00:03:08.958 08:10:54 -- setup/acl.sh@12 -- # declare -a devs 00:03:08.958 08:10:54 -- setup/acl.sh@13 -- # drivers=() 00:03:08.958 08:10:54 -- setup/acl.sh@13 -- # declare -A drivers 00:03:08.958 08:10:54 -- setup/acl.sh@51 -- # setup reset 00:03:08.958 08:10:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:08.958 08:10:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.878 08:10:56 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:10.878 08:10:56 -- setup/acl.sh@16 -- # local dev driver 00:03:10.878 08:10:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.878 08:10:56 -- setup/acl.sh@15 -- # setup output status 00:03:10.878 08:10:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.878 08:10:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:11.809 Hugepages 00:03:11.809 node hugesize free / total 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 00:03:11.809 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.809 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.809 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:11.809 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # continue 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:11.810 08:10:57 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:11.810 08:10:57 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:11.810 08:10:57 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:11.810 08:10:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.810 08:10:57 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:11.810 08:10:57 -- setup/acl.sh@54 -- # run_test denied denied 00:03:11.810 08:10:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.810 08:10:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.810 08:10:57 -- common/autotest_common.sh@10 -- # set +x 00:03:11.810 ************************************ 00:03:11.810 START TEST denied 00:03:11.810 ************************************ 00:03:11.810 08:10:57 -- common/autotest_common.sh@1114 -- # denied 00:03:11.810 08:10:57 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:11.810 08:10:57 -- setup/acl.sh@38 -- # setup output config 00:03:11.810 08:10:57 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:11.810 08:10:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.810 08:10:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:13.184 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:13.184 08:10:58 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:13.184 08:10:58 -- setup/acl.sh@28 -- # local dev driver 00:03:13.184 08:10:58 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:13.184 08:10:58 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:13.184 08:10:58 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:13.184 08:10:58 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:13.184 08:10:58 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:13.184 08:10:58 -- setup/acl.sh@41 -- # setup reset 00:03:13.184 08:10:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:13.184 08:10:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:15.712 00:03:15.712 real 0m3.930s 00:03:15.712 user 0m1.087s 00:03:15.712 sys 0m1.936s 00:03:15.713 08:11:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.713 08:11:01 -- common/autotest_common.sh@10 -- # set +x 00:03:15.713 ************************************ 00:03:15.713 END TEST denied 00:03:15.713 ************************************ 00:03:15.713 08:11:01 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:15.713 08:11:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.713 08:11:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.713 08:11:01 -- common/autotest_common.sh@10 -- # set +x 00:03:15.713 ************************************ 00:03:15.713 START TEST allowed 00:03:15.713 ************************************ 00:03:15.713 08:11:01 -- common/autotest_common.sh@1114 -- # allowed 00:03:15.713 08:11:01 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:15.713 08:11:01 -- setup/acl.sh@45 -- # setup output config 00:03:15.713 08:11:01 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:15.713 08:11:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.713 08:11:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:18.242 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:18.242 08:11:03 -- setup/acl.sh@47 -- # verify 00:03:18.242 08:11:03 -- setup/acl.sh@28 -- # local dev driver 00:03:18.242 08:11:03 -- setup/acl.sh@48 -- # setup reset 00:03:18.242 08:11:03 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:18.242 08:11:03 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:19.614 00:03:19.614 real 0m3.916s 00:03:19.614 user 0m1.074s 00:03:19.614 sys 0m1.740s 00:03:19.614 08:11:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.614 08:11:05 -- common/autotest_common.sh@10 -- # set +x 00:03:19.614 ************************************ 00:03:19.614 END TEST allowed 00:03:19.614 ************************************ 00:03:19.614 00:03:19.614 real 0m10.693s 00:03:19.614 user 0m3.296s 00:03:19.614 sys 0m5.470s 00:03:19.614 08:11:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.614 08:11:05 -- common/autotest_common.sh@10 -- # set +x 00:03:19.614 ************************************ 00:03:19.614 END TEST acl 00:03:19.614 ************************************ 00:03:19.614 08:11:05 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:19.614 08:11:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.614 08:11:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.614 08:11:05 -- common/autotest_common.sh@10 -- # set +x 00:03:19.614 ************************************ 00:03:19.614 START TEST hugepages 00:03:19.614 ************************************ 00:03:19.614 08:11:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:19.614 * Looking for test storage... 00:03:19.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:19.614 08:11:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:19.614 08:11:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:19.614 08:11:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:19.873 08:11:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:19.873 08:11:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:19.873 08:11:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:19.873 08:11:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:19.873 08:11:05 -- scripts/common.sh@335 -- # IFS=.-: 00:03:19.873 08:11:05 -- scripts/common.sh@335 -- # read -ra ver1 00:03:19.873 08:11:05 -- scripts/common.sh@336 -- # IFS=.-: 00:03:19.873 08:11:05 -- scripts/common.sh@336 -- # read -ra ver2 00:03:19.873 08:11:05 -- scripts/common.sh@337 -- # local 'op=<' 00:03:19.873 08:11:05 -- scripts/common.sh@339 -- # ver1_l=2 00:03:19.873 08:11:05 -- scripts/common.sh@340 -- # ver2_l=1 00:03:19.873 08:11:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:19.873 08:11:05 -- scripts/common.sh@343 -- # case "$op" in 00:03:19.873 08:11:05 -- scripts/common.sh@344 -- # : 1 00:03:19.873 08:11:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:19.873 08:11:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:19.873 08:11:05 -- scripts/common.sh@364 -- # decimal 1 00:03:19.873 08:11:05 -- scripts/common.sh@352 -- # local d=1 00:03:19.873 08:11:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:19.873 08:11:05 -- scripts/common.sh@354 -- # echo 1 00:03:19.873 08:11:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:19.873 08:11:05 -- scripts/common.sh@365 -- # decimal 2 00:03:19.873 08:11:05 -- scripts/common.sh@352 -- # local d=2 00:03:19.873 08:11:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:19.873 08:11:05 -- scripts/common.sh@354 -- # echo 2 00:03:19.873 08:11:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:19.873 08:11:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:19.873 08:11:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:19.873 08:11:05 -- scripts/common.sh@367 -- # return 0 00:03:19.873 08:11:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:19.873 08:11:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:19.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.873 --rc genhtml_branch_coverage=1 00:03:19.873 --rc genhtml_function_coverage=1 00:03:19.873 --rc genhtml_legend=1 00:03:19.873 --rc geninfo_all_blocks=1 00:03:19.873 --rc geninfo_unexecuted_blocks=1 00:03:19.873 00:03:19.873 ' 00:03:19.873 08:11:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:19.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.873 --rc genhtml_branch_coverage=1 00:03:19.873 --rc genhtml_function_coverage=1 00:03:19.873 --rc genhtml_legend=1 00:03:19.873 --rc geninfo_all_blocks=1 00:03:19.873 --rc geninfo_unexecuted_blocks=1 00:03:19.873 00:03:19.873 ' 00:03:19.873 08:11:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:19.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.873 --rc genhtml_branch_coverage=1 00:03:19.873 --rc genhtml_function_coverage=1 00:03:19.873 --rc genhtml_legend=1 00:03:19.873 --rc geninfo_all_blocks=1 00:03:19.873 --rc geninfo_unexecuted_blocks=1 00:03:19.873 00:03:19.873 ' 00:03:19.873 08:11:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:19.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.873 --rc genhtml_branch_coverage=1 00:03:19.873 --rc genhtml_function_coverage=1 00:03:19.873 --rc genhtml_legend=1 00:03:19.873 --rc geninfo_all_blocks=1 00:03:19.873 --rc geninfo_unexecuted_blocks=1 00:03:19.874 00:03:19.874 ' 00:03:19.874 08:11:05 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:19.874 08:11:05 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:19.874 08:11:05 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:19.874 08:11:05 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:19.874 08:11:05 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:19.874 08:11:05 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:19.874 08:11:05 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:19.874 08:11:05 -- setup/common.sh@18 -- # local node= 00:03:19.874 08:11:05 -- setup/common.sh@19 -- # local var val 00:03:19.874 08:11:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.874 08:11:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.874 08:11:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.874 08:11:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.874 08:11:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.874 08:11:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 42967268 kB' 'MemAvailable: 46741904 kB' 'Buffers: 2708 kB' 'Cached: 10731916 kB' 'SwapCached: 0 kB' 'Active: 7465960 kB' 'Inactive: 3766524 kB' 'Active(anon): 7064188 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501312 kB' 'Mapped: 202164 kB' 'Shmem: 6566328 kB' 'KReclaimable: 200328 kB' 'Slab: 767624 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567296 kB' 'KernelStack: 12848 kB' 'PageTables: 8496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 8133652 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198668 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.874 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.874 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # continue 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.875 08:11:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.875 08:11:05 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.875 08:11:05 -- setup/common.sh@33 -- # echo 2048 00:03:19.875 08:11:05 -- setup/common.sh@33 -- # return 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:19.875 08:11:05 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:19.875 08:11:05 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:19.875 08:11:05 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:19.875 08:11:05 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:19.875 08:11:05 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:19.875 08:11:05 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:19.875 08:11:05 -- setup/hugepages.sh@207 -- # get_nodes 00:03:19.875 08:11:05 -- setup/hugepages.sh@27 -- # local node 00:03:19.875 08:11:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.875 08:11:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:19.875 08:11:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.875 08:11:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:19.875 08:11:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.875 08:11:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.875 08:11:05 -- setup/hugepages.sh@208 -- # clear_hp 00:03:19.875 08:11:05 -- setup/hugepages.sh@37 -- # local node hp 00:03:19.875 08:11:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.875 08:11:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.875 08:11:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.875 08:11:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.875 08:11:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.875 08:11:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.875 08:11:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:19.875 08:11:05 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:19.875 08:11:05 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:19.875 08:11:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.875 08:11:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.875 08:11:05 -- common/autotest_common.sh@10 -- # set +x 00:03:19.875 ************************************ 00:03:19.875 START TEST default_setup 00:03:19.875 ************************************ 00:03:19.875 08:11:05 -- common/autotest_common.sh@1114 -- # default_setup 00:03:19.875 08:11:05 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.875 08:11:05 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:19.875 08:11:05 -- setup/hugepages.sh@51 -- # shift 00:03:19.875 08:11:05 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:19.875 08:11:05 -- setup/hugepages.sh@52 -- # local node_ids 00:03:19.875 08:11:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.875 08:11:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.875 08:11:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:19.875 08:11:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.875 08:11:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.875 08:11:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.875 08:11:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.875 08:11:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.875 08:11:05 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:19.875 08:11:05 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:19.875 08:11:05 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:19.875 08:11:05 -- setup/hugepages.sh@73 -- # return 0 00:03:19.875 08:11:05 -- setup/hugepages.sh@137 -- # setup output 00:03:19.875 08:11:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.875 08:11:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.246 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:21.246 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:21.246 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:22.184 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:22.184 08:11:07 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:22.184 08:11:07 -- setup/hugepages.sh@89 -- # local node 00:03:22.184 08:11:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.184 08:11:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.184 08:11:07 -- setup/hugepages.sh@92 -- # local surp 00:03:22.184 08:11:07 -- setup/hugepages.sh@93 -- # local resv 00:03:22.184 08:11:07 -- setup/hugepages.sh@94 -- # local anon 00:03:22.184 08:11:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.184 08:11:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.184 08:11:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.184 08:11:07 -- setup/common.sh@18 -- # local node= 00:03:22.184 08:11:07 -- setup/common.sh@19 -- # local var val 00:03:22.184 08:11:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.184 08:11:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.184 08:11:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.184 08:11:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.184 08:11:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.184 08:11:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.184 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.184 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.184 08:11:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45095552 kB' 'MemAvailable: 48870188 kB' 'Buffers: 2708 kB' 'Cached: 10732004 kB' 'SwapCached: 0 kB' 'Active: 7467944 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066172 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502980 kB' 'Mapped: 201692 kB' 'Shmem: 6566416 kB' 'KReclaimable: 200328 kB' 'Slab: 767564 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567236 kB' 'KernelStack: 12864 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:22.184 08:11:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.184 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.184 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.184 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.184 08:11:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.184 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.184 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.185 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.185 08:11:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.185 08:11:07 -- setup/common.sh@33 -- # echo 0 00:03:22.185 08:11:07 -- setup/common.sh@33 -- # return 0 00:03:22.185 08:11:07 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.185 08:11:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.185 08:11:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.185 08:11:07 -- setup/common.sh@18 -- # local node= 00:03:22.185 08:11:07 -- setup/common.sh@19 -- # local var val 00:03:22.185 08:11:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.185 08:11:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.186 08:11:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.186 08:11:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.186 08:11:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.186 08:11:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45104588 kB' 'MemAvailable: 48879224 kB' 'Buffers: 2708 kB' 'Cached: 10732008 kB' 'SwapCached: 0 kB' 'Active: 7467604 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065832 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502716 kB' 'Mapped: 201692 kB' 'Shmem: 6566420 kB' 'KReclaimable: 200328 kB' 'Slab: 767572 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567244 kB' 'KernelStack: 12720 kB' 'PageTables: 8048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198780 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.186 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.186 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.187 08:11:07 -- setup/common.sh@33 -- # echo 0 00:03:22.187 08:11:07 -- setup/common.sh@33 -- # return 0 00:03:22.187 08:11:07 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.187 08:11:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.187 08:11:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.187 08:11:07 -- setup/common.sh@18 -- # local node= 00:03:22.187 08:11:07 -- setup/common.sh@19 -- # local var val 00:03:22.187 08:11:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.187 08:11:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.187 08:11:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.187 08:11:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.187 08:11:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.187 08:11:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45104784 kB' 'MemAvailable: 48879420 kB' 'Buffers: 2708 kB' 'Cached: 10732020 kB' 'SwapCached: 0 kB' 'Active: 7467196 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065424 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502292 kB' 'Mapped: 201652 kB' 'Shmem: 6566432 kB' 'KReclaimable: 200328 kB' 'Slab: 767696 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567368 kB' 'KernelStack: 12800 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.187 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.187 08:11:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.188 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.188 08:11:07 -- setup/common.sh@33 -- # echo 0 00:03:22.188 08:11:07 -- setup/common.sh@33 -- # return 0 00:03:22.188 08:11:07 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.188 08:11:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.188 nr_hugepages=1024 00:03:22.188 08:11:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.188 resv_hugepages=0 00:03:22.188 08:11:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.188 surplus_hugepages=0 00:03:22.188 08:11:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.188 anon_hugepages=0 00:03:22.188 08:11:07 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.188 08:11:07 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.188 08:11:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.188 08:11:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.188 08:11:07 -- setup/common.sh@18 -- # local node= 00:03:22.188 08:11:07 -- setup/common.sh@19 -- # local var val 00:03:22.188 08:11:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.188 08:11:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.188 08:11:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.188 08:11:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.188 08:11:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.188 08:11:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.188 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45110636 kB' 'MemAvailable: 48885272 kB' 'Buffers: 2708 kB' 'Cached: 10732032 kB' 'SwapCached: 0 kB' 'Active: 7467528 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065756 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502612 kB' 'Mapped: 201652 kB' 'Shmem: 6566444 kB' 'KReclaimable: 200328 kB' 'Slab: 767696 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567368 kB' 'KernelStack: 12800 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198780 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.189 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.189 08:11:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.190 08:11:07 -- setup/common.sh@33 -- # echo 1024 00:03:22.190 08:11:07 -- setup/common.sh@33 -- # return 0 00:03:22.190 08:11:07 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.190 08:11:07 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.190 08:11:07 -- setup/hugepages.sh@27 -- # local node 00:03:22.190 08:11:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.190 08:11:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:22.190 08:11:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.190 08:11:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:22.190 08:11:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.190 08:11:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.190 08:11:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.190 08:11:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.190 08:11:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.190 08:11:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.190 08:11:07 -- setup/common.sh@18 -- # local node=0 00:03:22.190 08:11:07 -- setup/common.sh@19 -- # local var val 00:03:22.190 08:11:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.190 08:11:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.190 08:11:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.190 08:11:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.190 08:11:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.190 08:11:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27186040 kB' 'MemUsed: 5688884 kB' 'SwapCached: 0 kB' 'Active: 2089548 kB' 'Inactive: 226888 kB' 'Active(anon): 1916324 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2158736 kB' 'Mapped: 100180 kB' 'AnonPages: 160904 kB' 'Shmem: 1758624 kB' 'KernelStack: 6872 kB' 'PageTables: 4212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395480 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312244 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.190 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.190 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # continue 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.191 08:11:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.191 08:11:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.191 08:11:07 -- setup/common.sh@33 -- # echo 0 00:03:22.191 08:11:07 -- setup/common.sh@33 -- # return 0 00:03:22.191 08:11:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.191 08:11:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.191 08:11:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.191 08:11:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.191 08:11:07 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:22.191 node0=1024 expecting 1024 00:03:22.191 08:11:07 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:22.191 00:03:22.191 real 0m2.408s 00:03:22.191 user 0m0.647s 00:03:22.191 sys 0m0.894s 00:03:22.191 08:11:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.191 08:11:07 -- common/autotest_common.sh@10 -- # set +x 00:03:22.191 ************************************ 00:03:22.191 END TEST default_setup 00:03:22.191 ************************************ 00:03:22.191 08:11:07 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:22.191 08:11:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.191 08:11:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.191 08:11:07 -- common/autotest_common.sh@10 -- # set +x 00:03:22.191 ************************************ 00:03:22.191 START TEST per_node_1G_alloc 00:03:22.191 ************************************ 00:03:22.191 08:11:07 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:22.191 08:11:07 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:22.191 08:11:07 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:22.191 08:11:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:22.191 08:11:07 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:22.191 08:11:07 -- setup/hugepages.sh@51 -- # shift 00:03:22.191 08:11:07 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:22.191 08:11:07 -- setup/hugepages.sh@52 -- # local node_ids 00:03:22.191 08:11:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.191 08:11:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:22.191 08:11:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:22.191 08:11:07 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:22.191 08:11:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.191 08:11:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:22.191 08:11:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.191 08:11:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.191 08:11:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.191 08:11:07 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:22.191 08:11:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:22.191 08:11:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:22.191 08:11:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:22.191 08:11:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:22.191 08:11:07 -- setup/hugepages.sh@73 -- # return 0 00:03:22.191 08:11:07 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:22.191 08:11:07 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:22.191 08:11:07 -- setup/hugepages.sh@146 -- # setup output 00:03:22.191 08:11:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.191 08:11:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.589 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.589 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.589 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.589 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.589 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.589 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.589 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.589 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.589 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.589 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.589 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.589 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.589 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.589 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.589 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.589 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.589 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.589 08:11:09 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:23.589 08:11:09 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:23.589 08:11:09 -- setup/hugepages.sh@89 -- # local node 00:03:23.589 08:11:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.589 08:11:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.589 08:11:09 -- setup/hugepages.sh@92 -- # local surp 00:03:23.589 08:11:09 -- setup/hugepages.sh@93 -- # local resv 00:03:23.589 08:11:09 -- setup/hugepages.sh@94 -- # local anon 00:03:23.590 08:11:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.590 08:11:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.590 08:11:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.590 08:11:09 -- setup/common.sh@18 -- # local node= 00:03:23.590 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.590 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.590 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.590 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.590 08:11:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.590 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.590 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45112568 kB' 'MemAvailable: 48887204 kB' 'Buffers: 2708 kB' 'Cached: 10732096 kB' 'SwapCached: 0 kB' 'Active: 7468172 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066400 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503124 kB' 'Mapped: 201832 kB' 'Shmem: 6566508 kB' 'KReclaimable: 200328 kB' 'Slab: 767808 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567480 kB' 'KernelStack: 12816 kB' 'PageTables: 8300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140772 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.590 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.590 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.590 08:11:09 -- setup/common.sh@33 -- # echo 0 00:03:23.590 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.590 08:11:09 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.591 08:11:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.591 08:11:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.591 08:11:09 -- setup/common.sh@18 -- # local node= 00:03:23.591 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.591 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.591 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.591 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.591 08:11:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.591 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.591 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45113844 kB' 'MemAvailable: 48888480 kB' 'Buffers: 2708 kB' 'Cached: 10732096 kB' 'SwapCached: 0 kB' 'Active: 7468272 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066500 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503248 kB' 'Mapped: 201832 kB' 'Shmem: 6566508 kB' 'KReclaimable: 200328 kB' 'Slab: 767816 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567488 kB' 'KernelStack: 12784 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.591 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.591 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.592 08:11:09 -- setup/common.sh@33 -- # echo 0 00:03:23.592 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.592 08:11:09 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.592 08:11:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.592 08:11:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.592 08:11:09 -- setup/common.sh@18 -- # local node= 00:03:23.592 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.592 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.592 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.592 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.592 08:11:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.592 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.592 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45114276 kB' 'MemAvailable: 48888912 kB' 'Buffers: 2708 kB' 'Cached: 10732096 kB' 'SwapCached: 0 kB' 'Active: 7467396 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065624 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502360 kB' 'Mapped: 201668 kB' 'Shmem: 6566508 kB' 'KReclaimable: 200328 kB' 'Slab: 767852 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567524 kB' 'KernelStack: 12800 kB' 'PageTables: 8184 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.592 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.592 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.593 08:11:09 -- setup/common.sh@33 -- # echo 0 00:03:23.593 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.593 08:11:09 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.593 08:11:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.593 nr_hugepages=1024 00:03:23.593 08:11:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.593 resv_hugepages=0 00:03:23.593 08:11:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.593 surplus_hugepages=0 00:03:23.593 08:11:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.593 anon_hugepages=0 00:03:23.593 08:11:09 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.593 08:11:09 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.593 08:11:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.593 08:11:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.593 08:11:09 -- setup/common.sh@18 -- # local node= 00:03:23.593 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.593 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.593 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.593 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.593 08:11:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.593 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.593 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45114276 kB' 'MemAvailable: 48888912 kB' 'Buffers: 2708 kB' 'Cached: 10732124 kB' 'SwapCached: 0 kB' 'Active: 7467464 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065692 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502400 kB' 'Mapped: 201668 kB' 'Shmem: 6566536 kB' 'KReclaimable: 200328 kB' 'Slab: 767852 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567524 kB' 'KernelStack: 12800 kB' 'PageTables: 8184 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.593 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.593 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.593 08:11:09 -- setup/common.sh@33 -- # echo 1024 00:03:23.593 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.593 08:11:09 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.594 08:11:09 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.594 08:11:09 -- setup/hugepages.sh@27 -- # local node 00:03:23.594 08:11:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.594 08:11:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.594 08:11:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.594 08:11:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.594 08:11:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.594 08:11:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.594 08:11:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.594 08:11:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.594 08:11:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.594 08:11:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.594 08:11:09 -- setup/common.sh@18 -- # local node=0 00:03:23.594 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.594 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.594 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.594 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.594 08:11:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.594 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.594 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28238476 kB' 'MemUsed: 4636448 kB' 'SwapCached: 0 kB' 'Active: 2089312 kB' 'Inactive: 226888 kB' 'Active(anon): 1916088 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2158808 kB' 'Mapped: 100188 kB' 'AnonPages: 160576 kB' 'Shmem: 1758696 kB' 'KernelStack: 6872 kB' 'PageTables: 4168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395648 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@33 -- # echo 0 00:03:23.594 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.594 08:11:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.594 08:11:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.594 08:11:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.594 08:11:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:23.594 08:11:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.594 08:11:09 -- setup/common.sh@18 -- # local node=1 00:03:23.594 08:11:09 -- setup/common.sh@19 -- # local var val 00:03:23.594 08:11:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.594 08:11:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.594 08:11:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:23.594 08:11:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:23.594 08:11:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.594 08:11:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16875800 kB' 'MemUsed: 10784936 kB' 'SwapCached: 0 kB' 'Active: 5378192 kB' 'Inactive: 3539636 kB' 'Active(anon): 5149644 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8576040 kB' 'Mapped: 101480 kB' 'AnonPages: 341864 kB' 'Shmem: 4807856 kB' 'KernelStack: 5944 kB' 'PageTables: 4064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 117092 kB' 'Slab: 372204 kB' 'SReclaimable: 117092 kB' 'SUnreclaim: 255112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.594 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.594 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # continue 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.595 08:11:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.595 08:11:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.595 08:11:09 -- setup/common.sh@33 -- # echo 0 00:03:23.595 08:11:09 -- setup/common.sh@33 -- # return 0 00:03:23.595 08:11:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.595 08:11:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.595 08:11:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.595 08:11:09 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:23.595 node0=512 expecting 512 00:03:23.595 08:11:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.595 08:11:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.595 08:11:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.595 08:11:09 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:23.595 node1=512 expecting 512 00:03:23.595 08:11:09 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:23.595 00:03:23.595 real 0m1.388s 00:03:23.595 user 0m0.555s 00:03:23.595 sys 0m0.796s 00:03:23.595 08:11:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.595 08:11:09 -- common/autotest_common.sh@10 -- # set +x 00:03:23.595 ************************************ 00:03:23.595 END TEST per_node_1G_alloc 00:03:23.595 ************************************ 00:03:23.595 08:11:09 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:23.595 08:11:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.595 08:11:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.595 08:11:09 -- common/autotest_common.sh@10 -- # set +x 00:03:23.595 ************************************ 00:03:23.595 START TEST even_2G_alloc 00:03:23.595 ************************************ 00:03:23.595 08:11:09 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:23.595 08:11:09 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:23.595 08:11:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:23.595 08:11:09 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:23.595 08:11:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:23.595 08:11:09 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:23.595 08:11:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.595 08:11:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:23.595 08:11:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.595 08:11:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.595 08:11:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.595 08:11:09 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:23.595 08:11:09 -- setup/hugepages.sh@83 -- # : 512 00:03:23.595 08:11:09 -- setup/hugepages.sh@84 -- # : 1 00:03:23.595 08:11:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:23.595 08:11:09 -- setup/hugepages.sh@83 -- # : 0 00:03:23.595 08:11:09 -- setup/hugepages.sh@84 -- # : 0 00:03:23.595 08:11:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.595 08:11:09 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:23.595 08:11:09 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:23.595 08:11:09 -- setup/hugepages.sh@153 -- # setup output 00:03:23.595 08:11:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.595 08:11:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.972 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.972 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:24.972 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.972 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.972 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.972 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.972 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.972 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.972 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.972 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.972 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.972 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.972 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.972 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.972 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.972 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.972 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.972 08:11:10 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:24.972 08:11:10 -- setup/hugepages.sh@89 -- # local node 00:03:24.972 08:11:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.972 08:11:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.972 08:11:10 -- setup/hugepages.sh@92 -- # local surp 00:03:24.972 08:11:10 -- setup/hugepages.sh@93 -- # local resv 00:03:24.972 08:11:10 -- setup/hugepages.sh@94 -- # local anon 00:03:24.972 08:11:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.972 08:11:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.972 08:11:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.972 08:11:10 -- setup/common.sh@18 -- # local node= 00:03:24.972 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:24.972 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.972 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.972 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.972 08:11:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.972 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.973 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45115920 kB' 'MemAvailable: 48890556 kB' 'Buffers: 2708 kB' 'Cached: 10732180 kB' 'SwapCached: 0 kB' 'Active: 7467796 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066024 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502612 kB' 'Mapped: 201672 kB' 'Shmem: 6566592 kB' 'KReclaimable: 200328 kB' 'Slab: 767808 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567480 kB' 'KernelStack: 12816 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140856 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.973 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.973 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.974 08:11:10 -- setup/common.sh@33 -- # echo 0 00:03:24.974 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:24.974 08:11:10 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.974 08:11:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.974 08:11:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.974 08:11:10 -- setup/common.sh@18 -- # local node= 00:03:24.974 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:24.974 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.974 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.974 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.974 08:11:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.974 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.974 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45119408 kB' 'MemAvailable: 48894044 kB' 'Buffers: 2708 kB' 'Cached: 10732180 kB' 'SwapCached: 0 kB' 'Active: 7468184 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066412 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503000 kB' 'Mapped: 201672 kB' 'Shmem: 6566592 kB' 'KReclaimable: 200328 kB' 'Slab: 767784 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567456 kB' 'KernelStack: 12784 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140868 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.974 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.974 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.975 08:11:10 -- setup/common.sh@33 -- # echo 0 00:03:24.975 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:24.975 08:11:10 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.975 08:11:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.975 08:11:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.975 08:11:10 -- setup/common.sh@18 -- # local node= 00:03:24.975 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:24.975 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.975 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.975 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.975 08:11:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.975 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.975 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45119592 kB' 'MemAvailable: 48894228 kB' 'Buffers: 2708 kB' 'Cached: 10732192 kB' 'SwapCached: 0 kB' 'Active: 7467648 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065876 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502432 kB' 'Mapped: 201664 kB' 'Shmem: 6566604 kB' 'KReclaimable: 200328 kB' 'Slab: 767852 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567524 kB' 'KernelStack: 12832 kB' 'PageTables: 8236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.975 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.975 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.976 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.976 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.977 08:11:10 -- setup/common.sh@33 -- # echo 0 00:03:24.977 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:24.977 08:11:10 -- setup/hugepages.sh@100 -- # resv=0 00:03:24.977 08:11:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:24.977 nr_hugepages=1024 00:03:24.977 08:11:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:24.977 resv_hugepages=0 00:03:24.977 08:11:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:24.977 surplus_hugepages=0 00:03:24.977 08:11:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:24.977 anon_hugepages=0 00:03:24.977 08:11:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.977 08:11:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:24.977 08:11:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:24.977 08:11:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:24.977 08:11:10 -- setup/common.sh@18 -- # local node= 00:03:24.977 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:24.977 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.977 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.977 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.977 08:11:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.977 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.977 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45119592 kB' 'MemAvailable: 48894228 kB' 'Buffers: 2708 kB' 'Cached: 10732208 kB' 'SwapCached: 0 kB' 'Active: 7467620 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065848 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502388 kB' 'Mapped: 201664 kB' 'Shmem: 6566620 kB' 'KReclaimable: 200328 kB' 'Slab: 767852 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567524 kB' 'KernelStack: 12816 kB' 'PageTables: 8188 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8140896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.977 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.977 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.978 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.978 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.238 08:11:10 -- setup/common.sh@33 -- # echo 1024 00:03:25.238 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:25.238 08:11:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.238 08:11:10 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.238 08:11:10 -- setup/hugepages.sh@27 -- # local node 00:03:25.238 08:11:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.238 08:11:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.238 08:11:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.238 08:11:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.238 08:11:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.238 08:11:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.238 08:11:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.238 08:11:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.238 08:11:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.238 08:11:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.238 08:11:10 -- setup/common.sh@18 -- # local node=0 00:03:25.238 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:25.238 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.238 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.238 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.238 08:11:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.238 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.238 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28237896 kB' 'MemUsed: 4637028 kB' 'SwapCached: 0 kB' 'Active: 2090336 kB' 'Inactive: 226888 kB' 'Active(anon): 1917112 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2158892 kB' 'Mapped: 100192 kB' 'AnonPages: 161524 kB' 'Shmem: 1758780 kB' 'KernelStack: 6936 kB' 'PageTables: 4312 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395648 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.238 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.238 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@33 -- # echo 0 00:03:25.239 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:25.239 08:11:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.239 08:11:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.239 08:11:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.239 08:11:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:25.239 08:11:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.239 08:11:10 -- setup/common.sh@18 -- # local node=1 00:03:25.239 08:11:10 -- setup/common.sh@19 -- # local var val 00:03:25.239 08:11:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.239 08:11:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.239 08:11:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:25.239 08:11:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:25.239 08:11:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.239 08:11:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16880940 kB' 'MemUsed: 10779796 kB' 'SwapCached: 0 kB' 'Active: 5377292 kB' 'Inactive: 3539636 kB' 'Active(anon): 5148744 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8576040 kB' 'Mapped: 101472 kB' 'AnonPages: 340904 kB' 'Shmem: 4807856 kB' 'KernelStack: 5896 kB' 'PageTables: 3924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 117092 kB' 'Slab: 372204 kB' 'SReclaimable: 117092 kB' 'SUnreclaim: 255112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.239 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.239 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # continue 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.240 08:11:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.240 08:11:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.240 08:11:10 -- setup/common.sh@33 -- # echo 0 00:03:25.240 08:11:10 -- setup/common.sh@33 -- # return 0 00:03:25.240 08:11:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.240 08:11:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.240 08:11:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.240 08:11:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:25.240 node0=512 expecting 512 00:03:25.240 08:11:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.240 08:11:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.240 08:11:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.240 08:11:10 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:25.240 node1=512 expecting 512 00:03:25.240 08:11:10 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:25.240 00:03:25.240 real 0m1.466s 00:03:25.240 user 0m0.568s 00:03:25.240 sys 0m0.863s 00:03:25.240 08:11:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.240 08:11:10 -- common/autotest_common.sh@10 -- # set +x 00:03:25.240 ************************************ 00:03:25.240 END TEST even_2G_alloc 00:03:25.240 ************************************ 00:03:25.240 08:11:10 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:25.240 08:11:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.240 08:11:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.240 08:11:10 -- common/autotest_common.sh@10 -- # set +x 00:03:25.240 ************************************ 00:03:25.240 START TEST odd_alloc 00:03:25.240 ************************************ 00:03:25.240 08:11:10 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:25.240 08:11:10 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:25.240 08:11:10 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:25.240 08:11:10 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:25.240 08:11:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.240 08:11:10 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.240 08:11:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.240 08:11:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:25.240 08:11:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.240 08:11:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.240 08:11:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.240 08:11:10 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.240 08:11:10 -- setup/hugepages.sh@83 -- # : 513 00:03:25.240 08:11:10 -- setup/hugepages.sh@84 -- # : 1 00:03:25.240 08:11:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:25.240 08:11:10 -- setup/hugepages.sh@83 -- # : 0 00:03:25.240 08:11:10 -- setup/hugepages.sh@84 -- # : 0 00:03:25.240 08:11:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.240 08:11:10 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:25.240 08:11:10 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:25.240 08:11:10 -- setup/hugepages.sh@160 -- # setup output 00:03:25.240 08:11:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.240 08:11:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.618 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.618 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.618 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.618 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.618 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.618 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.618 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.618 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.618 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.618 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.618 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.618 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.618 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.618 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.618 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.618 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.618 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.618 08:11:12 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:26.618 08:11:12 -- setup/hugepages.sh@89 -- # local node 00:03:26.618 08:11:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.618 08:11:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.618 08:11:12 -- setup/hugepages.sh@92 -- # local surp 00:03:26.618 08:11:12 -- setup/hugepages.sh@93 -- # local resv 00:03:26.618 08:11:12 -- setup/hugepages.sh@94 -- # local anon 00:03:26.618 08:11:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.618 08:11:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.618 08:11:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.618 08:11:12 -- setup/common.sh@18 -- # local node= 00:03:26.618 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.618 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.618 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.618 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.618 08:11:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.618 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.618 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45126844 kB' 'MemAvailable: 48901480 kB' 'Buffers: 2708 kB' 'Cached: 10732276 kB' 'SwapCached: 0 kB' 'Active: 7466684 kB' 'Inactive: 3766524 kB' 'Active(anon): 7064912 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501600 kB' 'Mapped: 200676 kB' 'Shmem: 6566688 kB' 'KReclaimable: 200328 kB' 'Slab: 767868 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567540 kB' 'KernelStack: 12848 kB' 'PageTables: 8248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8130496 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.618 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.618 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.619 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.619 08:11:12 -- setup/common.sh@33 -- # echo 0 00:03:26.619 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.619 08:11:12 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.619 08:11:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.619 08:11:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.619 08:11:12 -- setup/common.sh@18 -- # local node= 00:03:26.619 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.619 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.619 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.619 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.619 08:11:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.619 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.619 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.619 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45129668 kB' 'MemAvailable: 48904304 kB' 'Buffers: 2708 kB' 'Cached: 10732276 kB' 'SwapCached: 0 kB' 'Active: 7467784 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066012 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502680 kB' 'Mapped: 200676 kB' 'Shmem: 6566688 kB' 'KReclaimable: 200328 kB' 'Slab: 767868 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567540 kB' 'KernelStack: 13184 kB' 'PageTables: 9120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8129140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199020 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.620 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.620 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.621 08:11:12 -- setup/common.sh@33 -- # echo 0 00:03:26.621 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.621 08:11:12 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.621 08:11:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.621 08:11:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.621 08:11:12 -- setup/common.sh@18 -- # local node= 00:03:26.621 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.621 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.621 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.621 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.621 08:11:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.621 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.621 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45127776 kB' 'MemAvailable: 48902412 kB' 'Buffers: 2708 kB' 'Cached: 10732292 kB' 'SwapCached: 0 kB' 'Active: 7467796 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066024 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502636 kB' 'Mapped: 200636 kB' 'Shmem: 6566704 kB' 'KReclaimable: 200328 kB' 'Slab: 767876 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567548 kB' 'KernelStack: 12944 kB' 'PageTables: 9500 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8129140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199036 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.621 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.621 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.622 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.622 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.623 08:11:12 -- setup/common.sh@33 -- # echo 0 00:03:26.623 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.623 08:11:12 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.623 08:11:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:26.623 nr_hugepages=1025 00:03:26.623 08:11:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.623 resv_hugepages=0 00:03:26.623 08:11:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.623 surplus_hugepages=0 00:03:26.623 08:11:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.623 anon_hugepages=0 00:03:26.623 08:11:12 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.623 08:11:12 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:26.623 08:11:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.623 08:11:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.623 08:11:12 -- setup/common.sh@18 -- # local node= 00:03:26.623 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.623 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.623 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.623 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.623 08:11:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.623 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.623 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45127848 kB' 'MemAvailable: 48902484 kB' 'Buffers: 2708 kB' 'Cached: 10732304 kB' 'SwapCached: 0 kB' 'Active: 7467028 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065256 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501848 kB' 'Mapped: 200636 kB' 'Shmem: 6566716 kB' 'KReclaimable: 200328 kB' 'Slab: 767544 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567216 kB' 'KernelStack: 13104 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8130536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198988 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.623 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.623 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.624 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.624 08:11:12 -- setup/common.sh@33 -- # echo 1025 00:03:26.624 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.624 08:11:12 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.624 08:11:12 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.624 08:11:12 -- setup/hugepages.sh@27 -- # local node 00:03:26.624 08:11:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.624 08:11:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.624 08:11:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.624 08:11:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:26.624 08:11:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.624 08:11:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.624 08:11:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.624 08:11:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.624 08:11:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.624 08:11:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.624 08:11:12 -- setup/common.sh@18 -- # local node=0 00:03:26.624 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.624 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.624 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.624 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.624 08:11:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.624 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.624 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.624 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28231836 kB' 'MemUsed: 4643088 kB' 'SwapCached: 0 kB' 'Active: 2088580 kB' 'Inactive: 226888 kB' 'Active(anon): 1915356 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2158972 kB' 'Mapped: 99460 kB' 'AnonPages: 159704 kB' 'Shmem: 1758860 kB' 'KernelStack: 6776 kB' 'PageTables: 3812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395472 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312236 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.625 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.625 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@33 -- # echo 0 00:03:26.626 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.626 08:11:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.626 08:11:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.626 08:11:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.626 08:11:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:26.626 08:11:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.626 08:11:12 -- setup/common.sh@18 -- # local node=1 00:03:26.626 08:11:12 -- setup/common.sh@19 -- # local var val 00:03:26.626 08:11:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.626 08:11:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.626 08:11:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:26.626 08:11:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:26.626 08:11:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.626 08:11:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16895904 kB' 'MemUsed: 10764832 kB' 'SwapCached: 0 kB' 'Active: 5377116 kB' 'Inactive: 3539636 kB' 'Active(anon): 5148568 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8576056 kB' 'Mapped: 101176 kB' 'AnonPages: 340756 kB' 'Shmem: 4807872 kB' 'KernelStack: 5912 kB' 'PageTables: 3564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 117092 kB' 'Slab: 372064 kB' 'SReclaimable: 117092 kB' 'SUnreclaim: 254972 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.626 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.626 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # continue 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.627 08:11:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.627 08:11:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.627 08:11:12 -- setup/common.sh@33 -- # echo 0 00:03:26.627 08:11:12 -- setup/common.sh@33 -- # return 0 00:03:26.627 08:11:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.627 08:11:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.627 08:11:12 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:26.627 node0=512 expecting 513 00:03:26.627 08:11:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.627 08:11:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.627 08:11:12 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:26.627 node1=513 expecting 512 00:03:26.627 08:11:12 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:26.627 00:03:26.627 real 0m1.509s 00:03:26.627 user 0m0.616s 00:03:26.627 sys 0m0.859s 00:03:26.627 08:11:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.627 08:11:12 -- common/autotest_common.sh@10 -- # set +x 00:03:26.627 ************************************ 00:03:26.627 END TEST odd_alloc 00:03:26.627 ************************************ 00:03:26.627 08:11:12 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:26.627 08:11:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.627 08:11:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.627 08:11:12 -- common/autotest_common.sh@10 -- # set +x 00:03:26.627 ************************************ 00:03:26.627 START TEST custom_alloc 00:03:26.627 ************************************ 00:03:26.627 08:11:12 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:26.627 08:11:12 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:26.627 08:11:12 -- setup/hugepages.sh@169 -- # local node 00:03:26.627 08:11:12 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:26.627 08:11:12 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:26.627 08:11:12 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:26.627 08:11:12 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.627 08:11:12 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.627 08:11:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.627 08:11:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.627 08:11:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.627 08:11:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.627 08:11:12 -- setup/hugepages.sh@83 -- # : 256 00:03:26.627 08:11:12 -- setup/hugepages.sh@84 -- # : 1 00:03:26.627 08:11:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.627 08:11:12 -- setup/hugepages.sh@83 -- # : 0 00:03:26.627 08:11:12 -- setup/hugepages.sh@84 -- # : 0 00:03:26.627 08:11:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:26.627 08:11:12 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:26.627 08:11:12 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:26.627 08:11:12 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:26.627 08:11:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.627 08:11:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.627 08:11:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.627 08:11:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.627 08:11:12 -- setup/hugepages.sh@78 -- # return 0 00:03:26.627 08:11:12 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:26.627 08:11:12 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.627 08:11:12 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.627 08:11:12 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.627 08:11:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.627 08:11:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.627 08:11:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.627 08:11:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:26.627 08:11:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.627 08:11:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.627 08:11:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:26.627 08:11:12 -- setup/hugepages.sh@78 -- # return 0 00:03:26.627 08:11:12 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:26.627 08:11:12 -- setup/hugepages.sh@187 -- # setup output 00:03:26.627 08:11:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.627 08:11:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.003 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.003 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:28.003 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.003 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.003 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.003 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.003 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.003 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.003 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.003 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.003 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.003 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.003 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.003 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.003 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.003 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.003 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.003 08:11:13 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:28.003 08:11:13 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:28.003 08:11:13 -- setup/hugepages.sh@89 -- # local node 00:03:28.003 08:11:13 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:28.003 08:11:13 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:28.003 08:11:13 -- setup/hugepages.sh@92 -- # local surp 00:03:28.003 08:11:13 -- setup/hugepages.sh@93 -- # local resv 00:03:28.003 08:11:13 -- setup/hugepages.sh@94 -- # local anon 00:03:28.003 08:11:13 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:28.003 08:11:13 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:28.003 08:11:13 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:28.003 08:11:13 -- setup/common.sh@18 -- # local node= 00:03:28.003 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.003 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.003 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.003 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.003 08:11:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.003 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.003 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44085812 kB' 'MemAvailable: 47860448 kB' 'Buffers: 2708 kB' 'Cached: 10732376 kB' 'SwapCached: 0 kB' 'Active: 7466104 kB' 'Inactive: 3766524 kB' 'Active(anon): 7064332 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500740 kB' 'Mapped: 200644 kB' 'Shmem: 6566788 kB' 'KReclaimable: 200328 kB' 'Slab: 767472 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567144 kB' 'KernelStack: 12752 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8126560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.003 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.003 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.004 08:11:13 -- setup/common.sh@33 -- # echo 0 00:03:28.004 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.004 08:11:13 -- setup/hugepages.sh@97 -- # anon=0 00:03:28.004 08:11:13 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:28.004 08:11:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.004 08:11:13 -- setup/common.sh@18 -- # local node= 00:03:28.004 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.004 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.004 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.004 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.004 08:11:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.004 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.004 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44107540 kB' 'MemAvailable: 47882176 kB' 'Buffers: 2708 kB' 'Cached: 10732380 kB' 'SwapCached: 0 kB' 'Active: 7465688 kB' 'Inactive: 3766524 kB' 'Active(anon): 7063916 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500332 kB' 'Mapped: 200640 kB' 'Shmem: 6566792 kB' 'KReclaimable: 200328 kB' 'Slab: 767456 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567128 kB' 'KernelStack: 12784 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8126572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.004 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.004 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.005 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.005 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.266 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.266 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.266 08:11:13 -- setup/common.sh@33 -- # echo 0 00:03:28.266 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.266 08:11:13 -- setup/hugepages.sh@99 -- # surp=0 00:03:28.266 08:11:13 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:28.266 08:11:13 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:28.266 08:11:13 -- setup/common.sh@18 -- # local node= 00:03:28.266 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.266 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.266 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.266 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.266 08:11:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.266 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.266 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44107808 kB' 'MemAvailable: 47882444 kB' 'Buffers: 2708 kB' 'Cached: 10732392 kB' 'SwapCached: 0 kB' 'Active: 7465736 kB' 'Inactive: 3766524 kB' 'Active(anon): 7063964 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500308 kB' 'Mapped: 200640 kB' 'Shmem: 6566804 kB' 'KReclaimable: 200328 kB' 'Slab: 767508 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567180 kB' 'KernelStack: 12784 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8126588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.267 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.267 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.268 08:11:13 -- setup/common.sh@33 -- # echo 0 00:03:28.268 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.268 08:11:13 -- setup/hugepages.sh@100 -- # resv=0 00:03:28.268 08:11:13 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:28.268 nr_hugepages=1536 00:03:28.268 08:11:13 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:28.268 resv_hugepages=0 00:03:28.268 08:11:13 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:28.268 surplus_hugepages=0 00:03:28.268 08:11:13 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:28.268 anon_hugepages=0 00:03:28.268 08:11:13 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:28.268 08:11:13 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:28.268 08:11:13 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:28.268 08:11:13 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:28.268 08:11:13 -- setup/common.sh@18 -- # local node= 00:03:28.268 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.268 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.268 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.268 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.268 08:11:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.268 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.268 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44107808 kB' 'MemAvailable: 47882444 kB' 'Buffers: 2708 kB' 'Cached: 10732392 kB' 'SwapCached: 0 kB' 'Active: 7465460 kB' 'Inactive: 3766524 kB' 'Active(anon): 7063688 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500032 kB' 'Mapped: 200640 kB' 'Shmem: 6566804 kB' 'KReclaimable: 200328 kB' 'Slab: 767508 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567180 kB' 'KernelStack: 12784 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8126600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.268 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.268 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.269 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.269 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.269 08:11:13 -- setup/common.sh@33 -- # echo 1536 00:03:28.269 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.269 08:11:13 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:28.269 08:11:13 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.269 08:11:13 -- setup/hugepages.sh@27 -- # local node 00:03:28.269 08:11:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.269 08:11:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:28.269 08:11:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.269 08:11:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:28.269 08:11:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.269 08:11:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.269 08:11:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.269 08:11:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.269 08:11:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.270 08:11:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.270 08:11:13 -- setup/common.sh@18 -- # local node=0 00:03:28.270 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.270 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.270 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.270 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.270 08:11:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.270 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.270 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28252368 kB' 'MemUsed: 4622556 kB' 'SwapCached: 0 kB' 'Active: 2088500 kB' 'Inactive: 226888 kB' 'Active(anon): 1915276 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2159080 kB' 'Mapped: 99464 kB' 'AnonPages: 159444 kB' 'Shmem: 1758968 kB' 'KernelStack: 6840 kB' 'PageTables: 3960 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395532 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.270 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.270 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@33 -- # echo 0 00:03:28.271 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.271 08:11:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.271 08:11:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.271 08:11:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.271 08:11:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:28.271 08:11:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.271 08:11:13 -- setup/common.sh@18 -- # local node=1 00:03:28.271 08:11:13 -- setup/common.sh@19 -- # local var val 00:03:28.271 08:11:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.271 08:11:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.271 08:11:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:28.271 08:11:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:28.271 08:11:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.271 08:11:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 15855440 kB' 'MemUsed: 11805296 kB' 'SwapCached: 0 kB' 'Active: 5376888 kB' 'Inactive: 3539636 kB' 'Active(anon): 5148340 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8576060 kB' 'Mapped: 101176 kB' 'AnonPages: 340472 kB' 'Shmem: 4807876 kB' 'KernelStack: 5928 kB' 'PageTables: 3904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 117092 kB' 'Slab: 371976 kB' 'SReclaimable: 117092 kB' 'SUnreclaim: 254884 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.271 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.271 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # continue 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.272 08:11:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.272 08:11:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.272 08:11:13 -- setup/common.sh@33 -- # echo 0 00:03:28.272 08:11:13 -- setup/common.sh@33 -- # return 0 00:03:28.272 08:11:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.272 08:11:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.272 08:11:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.272 08:11:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.272 08:11:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:28.272 node0=512 expecting 512 00:03:28.272 08:11:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.272 08:11:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.272 08:11:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.272 08:11:13 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:28.272 node1=1024 expecting 1024 00:03:28.272 08:11:13 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:28.272 00:03:28.272 real 0m1.534s 00:03:28.272 user 0m0.647s 00:03:28.272 sys 0m0.854s 00:03:28.272 08:11:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.272 08:11:13 -- common/autotest_common.sh@10 -- # set +x 00:03:28.272 ************************************ 00:03:28.272 END TEST custom_alloc 00:03:28.272 ************************************ 00:03:28.272 08:11:13 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:28.272 08:11:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.272 08:11:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.272 08:11:13 -- common/autotest_common.sh@10 -- # set +x 00:03:28.272 ************************************ 00:03:28.272 START TEST no_shrink_alloc 00:03:28.272 ************************************ 00:03:28.272 08:11:13 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:28.272 08:11:13 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:28.272 08:11:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:28.272 08:11:13 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:28.272 08:11:13 -- setup/hugepages.sh@51 -- # shift 00:03:28.272 08:11:13 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:28.272 08:11:13 -- setup/hugepages.sh@52 -- # local node_ids 00:03:28.272 08:11:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.272 08:11:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:28.272 08:11:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:28.272 08:11:13 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:28.272 08:11:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.272 08:11:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.272 08:11:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.272 08:11:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.272 08:11:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.272 08:11:13 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:28.272 08:11:13 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:28.272 08:11:13 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:28.272 08:11:13 -- setup/hugepages.sh@73 -- # return 0 00:03:28.272 08:11:13 -- setup/hugepages.sh@198 -- # setup output 00:03:28.272 08:11:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.272 08:11:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.651 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.651 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.651 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.651 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.651 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.651 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.651 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.651 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.651 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.651 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.651 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.651 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.651 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.651 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.651 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.651 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.651 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.651 08:11:15 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:29.651 08:11:15 -- setup/hugepages.sh@89 -- # local node 00:03:29.651 08:11:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.651 08:11:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.651 08:11:15 -- setup/hugepages.sh@92 -- # local surp 00:03:29.651 08:11:15 -- setup/hugepages.sh@93 -- # local resv 00:03:29.651 08:11:15 -- setup/hugepages.sh@94 -- # local anon 00:03:29.651 08:11:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.651 08:11:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.651 08:11:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.651 08:11:15 -- setup/common.sh@18 -- # local node= 00:03:29.651 08:11:15 -- setup/common.sh@19 -- # local var val 00:03:29.651 08:11:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.651 08:11:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.651 08:11:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.651 08:11:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.651 08:11:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.651 08:11:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45125880 kB' 'MemAvailable: 48900516 kB' 'Buffers: 2708 kB' 'Cached: 10732468 kB' 'SwapCached: 0 kB' 'Active: 7466064 kB' 'Inactive: 3766524 kB' 'Active(anon): 7064292 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500564 kB' 'Mapped: 200668 kB' 'Shmem: 6566880 kB' 'KReclaimable: 200328 kB' 'Slab: 767544 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567216 kB' 'KernelStack: 12768 kB' 'PageTables: 7832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8126784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.651 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.651 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.652 08:11:15 -- setup/common.sh@33 -- # echo 0 00:03:29.652 08:11:15 -- setup/common.sh@33 -- # return 0 00:03:29.652 08:11:15 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.652 08:11:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.652 08:11:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.652 08:11:15 -- setup/common.sh@18 -- # local node= 00:03:29.652 08:11:15 -- setup/common.sh@19 -- # local var val 00:03:29.652 08:11:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.652 08:11:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.652 08:11:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.652 08:11:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.652 08:11:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.652 08:11:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45135336 kB' 'MemAvailable: 48909972 kB' 'Buffers: 2708 kB' 'Cached: 10732468 kB' 'SwapCached: 0 kB' 'Active: 7466804 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065032 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501376 kB' 'Mapped: 200748 kB' 'Shmem: 6566880 kB' 'KReclaimable: 200328 kB' 'Slab: 767548 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567220 kB' 'KernelStack: 12768 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8126796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.652 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.652 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.653 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.653 08:11:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.654 08:11:15 -- setup/common.sh@33 -- # echo 0 00:03:29.654 08:11:15 -- setup/common.sh@33 -- # return 0 00:03:29.654 08:11:15 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.654 08:11:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.654 08:11:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.654 08:11:15 -- setup/common.sh@18 -- # local node= 00:03:29.654 08:11:15 -- setup/common.sh@19 -- # local var val 00:03:29.654 08:11:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.654 08:11:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.654 08:11:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.654 08:11:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.654 08:11:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.654 08:11:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45135336 kB' 'MemAvailable: 48909972 kB' 'Buffers: 2708 kB' 'Cached: 10732472 kB' 'SwapCached: 0 kB' 'Active: 7466088 kB' 'Inactive: 3766524 kB' 'Active(anon): 7064316 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500648 kB' 'Mapped: 200724 kB' 'Shmem: 6566884 kB' 'KReclaimable: 200328 kB' 'Slab: 767548 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567220 kB' 'KernelStack: 12816 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8126812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.654 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.654 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.655 08:11:15 -- setup/common.sh@33 -- # echo 0 00:03:29.655 08:11:15 -- setup/common.sh@33 -- # return 0 00:03:29.655 08:11:15 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.655 08:11:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.655 nr_hugepages=1024 00:03:29.655 08:11:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.655 resv_hugepages=0 00:03:29.655 08:11:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.655 surplus_hugepages=0 00:03:29.655 08:11:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.655 anon_hugepages=0 00:03:29.655 08:11:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.655 08:11:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.655 08:11:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.655 08:11:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.655 08:11:15 -- setup/common.sh@18 -- # local node= 00:03:29.655 08:11:15 -- setup/common.sh@19 -- # local var val 00:03:29.655 08:11:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.655 08:11:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.655 08:11:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.655 08:11:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.655 08:11:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.655 08:11:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45136816 kB' 'MemAvailable: 48911452 kB' 'Buffers: 2708 kB' 'Cached: 10732496 kB' 'SwapCached: 0 kB' 'Active: 7468308 kB' 'Inactive: 3766524 kB' 'Active(anon): 7066536 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502820 kB' 'Mapped: 201084 kB' 'Shmem: 6566908 kB' 'KReclaimable: 200328 kB' 'Slab: 767540 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 567212 kB' 'KernelStack: 12800 kB' 'PageTables: 7868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8129900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.655 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.655 08:11:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.656 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.656 08:11:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.657 08:11:15 -- setup/common.sh@33 -- # echo 1024 00:03:29.657 08:11:15 -- setup/common.sh@33 -- # return 0 00:03:29.657 08:11:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.657 08:11:15 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.657 08:11:15 -- setup/hugepages.sh@27 -- # local node 00:03:29.657 08:11:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.657 08:11:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.657 08:11:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.657 08:11:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:29.657 08:11:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.657 08:11:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.657 08:11:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.657 08:11:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.657 08:11:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.657 08:11:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.657 08:11:15 -- setup/common.sh@18 -- # local node=0 00:03:29.657 08:11:15 -- setup/common.sh@19 -- # local var val 00:03:29.657 08:11:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.657 08:11:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.657 08:11:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.657 08:11:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.657 08:11:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.657 08:11:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27191412 kB' 'MemUsed: 5683512 kB' 'SwapCached: 0 kB' 'Active: 2094624 kB' 'Inactive: 226888 kB' 'Active(anon): 1921400 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2159152 kB' 'Mapped: 99624 kB' 'AnonPages: 165600 kB' 'Shmem: 1759040 kB' 'KernelStack: 6904 kB' 'PageTables: 4024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395532 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.657 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.657 08:11:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.915 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.915 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # continue 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.916 08:11:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.916 08:11:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.916 08:11:15 -- setup/common.sh@33 -- # echo 0 00:03:29.916 08:11:15 -- setup/common.sh@33 -- # return 0 00:03:29.916 08:11:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.916 08:11:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.916 08:11:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.916 08:11:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.916 08:11:15 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:29.916 node0=1024 expecting 1024 00:03:29.916 08:11:15 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:29.916 08:11:15 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:29.916 08:11:15 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:29.916 08:11:15 -- setup/hugepages.sh@202 -- # setup output 00:03:29.916 08:11:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.916 08:11:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.850 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.850 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.850 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.850 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.850 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.850 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.850 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.850 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.850 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.850 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.850 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.850 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.850 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.850 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.850 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.850 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.850 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:31.111 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:31.111 08:11:16 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:31.111 08:11:16 -- setup/hugepages.sh@89 -- # local node 00:03:31.111 08:11:16 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:31.111 08:11:16 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:31.111 08:11:16 -- setup/hugepages.sh@92 -- # local surp 00:03:31.111 08:11:16 -- setup/hugepages.sh@93 -- # local resv 00:03:31.111 08:11:16 -- setup/hugepages.sh@94 -- # local anon 00:03:31.111 08:11:16 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:31.111 08:11:16 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:31.111 08:11:16 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:31.111 08:11:16 -- setup/common.sh@18 -- # local node= 00:03:31.111 08:11:16 -- setup/common.sh@19 -- # local var val 00:03:31.111 08:11:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.111 08:11:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.111 08:11:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.111 08:11:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.111 08:11:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.111 08:11:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.111 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.111 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45114208 kB' 'MemAvailable: 48888844 kB' 'Buffers: 2708 kB' 'Cached: 10732548 kB' 'SwapCached: 0 kB' 'Active: 7467636 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065864 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502204 kB' 'Mapped: 200700 kB' 'Shmem: 6566960 kB' 'KReclaimable: 200328 kB' 'Slab: 767264 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 566936 kB' 'KernelStack: 12880 kB' 'PageTables: 8128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8129824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.112 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.112 08:11:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.112 08:11:16 -- setup/common.sh@33 -- # echo 0 00:03:31.112 08:11:16 -- setup/common.sh@33 -- # return 0 00:03:31.112 08:11:16 -- setup/hugepages.sh@97 -- # anon=0 00:03:31.112 08:11:16 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:31.112 08:11:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.112 08:11:16 -- setup/common.sh@18 -- # local node= 00:03:31.113 08:11:16 -- setup/common.sh@19 -- # local var val 00:03:31.113 08:11:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.113 08:11:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.113 08:11:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.113 08:11:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.113 08:11:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.113 08:11:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45117940 kB' 'MemAvailable: 48892576 kB' 'Buffers: 2708 kB' 'Cached: 10732552 kB' 'SwapCached: 0 kB' 'Active: 7467332 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065560 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501956 kB' 'Mapped: 200652 kB' 'Shmem: 6566964 kB' 'KReclaimable: 200328 kB' 'Slab: 767264 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 566936 kB' 'KernelStack: 13008 kB' 'PageTables: 8616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8131068 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.113 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.113 08:11:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.114 08:11:16 -- setup/common.sh@33 -- # echo 0 00:03:31.114 08:11:16 -- setup/common.sh@33 -- # return 0 00:03:31.114 08:11:16 -- setup/hugepages.sh@99 -- # surp=0 00:03:31.114 08:11:16 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:31.114 08:11:16 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:31.114 08:11:16 -- setup/common.sh@18 -- # local node= 00:03:31.114 08:11:16 -- setup/common.sh@19 -- # local var val 00:03:31.114 08:11:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.114 08:11:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.114 08:11:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.114 08:11:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.114 08:11:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.114 08:11:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45116116 kB' 'MemAvailable: 48890752 kB' 'Buffers: 2708 kB' 'Cached: 10732564 kB' 'SwapCached: 0 kB' 'Active: 7467440 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065668 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502064 kB' 'Mapped: 200652 kB' 'Shmem: 6566976 kB' 'KReclaimable: 200328 kB' 'Slab: 767276 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 566948 kB' 'KernelStack: 12992 kB' 'PageTables: 9504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8131084 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199084 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.114 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.114 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.115 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.115 08:11:16 -- setup/common.sh@33 -- # echo 0 00:03:31.115 08:11:16 -- setup/common.sh@33 -- # return 0 00:03:31.115 08:11:16 -- setup/hugepages.sh@100 -- # resv=0 00:03:31.115 08:11:16 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:31.115 nr_hugepages=1024 00:03:31.115 08:11:16 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:31.115 resv_hugepages=0 00:03:31.115 08:11:16 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:31.115 surplus_hugepages=0 00:03:31.115 08:11:16 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:31.115 anon_hugepages=0 00:03:31.115 08:11:16 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.115 08:11:16 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:31.115 08:11:16 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:31.115 08:11:16 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:31.115 08:11:16 -- setup/common.sh@18 -- # local node= 00:03:31.115 08:11:16 -- setup/common.sh@19 -- # local var val 00:03:31.115 08:11:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.115 08:11:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.115 08:11:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.115 08:11:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.115 08:11:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.115 08:11:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.115 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45116028 kB' 'MemAvailable: 48890664 kB' 'Buffers: 2708 kB' 'Cached: 10732576 kB' 'SwapCached: 0 kB' 'Active: 7467756 kB' 'Inactive: 3766524 kB' 'Active(anon): 7065984 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502412 kB' 'Mapped: 200652 kB' 'Shmem: 6566988 kB' 'KReclaimable: 200328 kB' 'Slab: 767276 kB' 'SReclaimable: 200328 kB' 'SUnreclaim: 566948 kB' 'KernelStack: 13248 kB' 'PageTables: 8856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8129704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199020 kB' 'VmallocChunk: 0 kB' 'Percpu: 36480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.116 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.116 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.117 08:11:16 -- setup/common.sh@33 -- # echo 1024 00:03:31.117 08:11:16 -- setup/common.sh@33 -- # return 0 00:03:31.117 08:11:16 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.117 08:11:16 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.117 08:11:16 -- setup/hugepages.sh@27 -- # local node 00:03:31.117 08:11:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.117 08:11:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:31.117 08:11:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.117 08:11:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:31.117 08:11:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.117 08:11:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.117 08:11:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.117 08:11:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.117 08:11:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.117 08:11:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.117 08:11:16 -- setup/common.sh@18 -- # local node=0 00:03:31.117 08:11:16 -- setup/common.sh@19 -- # local var val 00:03:31.117 08:11:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.117 08:11:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.117 08:11:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.117 08:11:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.117 08:11:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.117 08:11:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27184928 kB' 'MemUsed: 5689996 kB' 'SwapCached: 0 kB' 'Active: 2090016 kB' 'Inactive: 226888 kB' 'Active(anon): 1916792 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2159216 kB' 'Mapped: 99476 kB' 'AnonPages: 160856 kB' 'Shmem: 1759104 kB' 'KernelStack: 7320 kB' 'PageTables: 5224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83236 kB' 'Slab: 395332 kB' 'SReclaimable: 83236 kB' 'SUnreclaim: 312096 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.117 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.117 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # continue 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.118 08:11:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.118 08:11:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.118 08:11:16 -- setup/common.sh@33 -- # echo 0 00:03:31.118 08:11:16 -- setup/common.sh@33 -- # return 0 00:03:31.118 08:11:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.118 08:11:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.118 08:11:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.118 08:11:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.118 08:11:16 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:31.118 node0=1024 expecting 1024 00:03:31.118 08:11:16 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:31.118 00:03:31.118 real 0m2.902s 00:03:31.118 user 0m1.149s 00:03:31.118 sys 0m1.682s 00:03:31.118 08:11:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.118 08:11:16 -- common/autotest_common.sh@10 -- # set +x 00:03:31.118 ************************************ 00:03:31.118 END TEST no_shrink_alloc 00:03:31.118 ************************************ 00:03:31.118 08:11:16 -- setup/hugepages.sh@217 -- # clear_hp 00:03:31.118 08:11:16 -- setup/hugepages.sh@37 -- # local node hp 00:03:31.118 08:11:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.118 08:11:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.118 08:11:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.118 08:11:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.118 08:11:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.118 08:11:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.118 08:11:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.118 08:11:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.118 08:11:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.118 08:11:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.118 08:11:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:31.118 08:11:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:31.118 00:03:31.118 real 0m11.548s 00:03:31.118 user 0m4.354s 00:03:31.118 sys 0m6.150s 00:03:31.118 08:11:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.118 08:11:16 -- common/autotest_common.sh@10 -- # set +x 00:03:31.118 ************************************ 00:03:31.118 END TEST hugepages 00:03:31.118 ************************************ 00:03:31.118 08:11:16 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.118 08:11:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.118 08:11:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.118 08:11:16 -- common/autotest_common.sh@10 -- # set +x 00:03:31.118 ************************************ 00:03:31.118 START TEST driver 00:03:31.118 ************************************ 00:03:31.118 08:11:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.377 * Looking for test storage... 00:03:31.377 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:31.377 08:11:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:31.377 08:11:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:31.377 08:11:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:31.377 08:11:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:31.377 08:11:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:31.377 08:11:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:31.377 08:11:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:31.377 08:11:17 -- scripts/common.sh@335 -- # IFS=.-: 00:03:31.377 08:11:17 -- scripts/common.sh@335 -- # read -ra ver1 00:03:31.377 08:11:17 -- scripts/common.sh@336 -- # IFS=.-: 00:03:31.377 08:11:17 -- scripts/common.sh@336 -- # read -ra ver2 00:03:31.377 08:11:17 -- scripts/common.sh@337 -- # local 'op=<' 00:03:31.377 08:11:17 -- scripts/common.sh@339 -- # ver1_l=2 00:03:31.377 08:11:17 -- scripts/common.sh@340 -- # ver2_l=1 00:03:31.377 08:11:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:31.377 08:11:17 -- scripts/common.sh@343 -- # case "$op" in 00:03:31.377 08:11:17 -- scripts/common.sh@344 -- # : 1 00:03:31.377 08:11:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:31.377 08:11:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:31.377 08:11:17 -- scripts/common.sh@364 -- # decimal 1 00:03:31.377 08:11:17 -- scripts/common.sh@352 -- # local d=1 00:03:31.377 08:11:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:31.377 08:11:17 -- scripts/common.sh@354 -- # echo 1 00:03:31.377 08:11:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:31.377 08:11:17 -- scripts/common.sh@365 -- # decimal 2 00:03:31.377 08:11:17 -- scripts/common.sh@352 -- # local d=2 00:03:31.377 08:11:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:31.377 08:11:17 -- scripts/common.sh@354 -- # echo 2 00:03:31.377 08:11:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:31.377 08:11:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:31.377 08:11:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:31.377 08:11:17 -- scripts/common.sh@367 -- # return 0 00:03:31.377 08:11:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:31.377 08:11:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:31.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.377 --rc genhtml_branch_coverage=1 00:03:31.377 --rc genhtml_function_coverage=1 00:03:31.377 --rc genhtml_legend=1 00:03:31.377 --rc geninfo_all_blocks=1 00:03:31.377 --rc geninfo_unexecuted_blocks=1 00:03:31.377 00:03:31.377 ' 00:03:31.377 08:11:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:31.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.377 --rc genhtml_branch_coverage=1 00:03:31.377 --rc genhtml_function_coverage=1 00:03:31.377 --rc genhtml_legend=1 00:03:31.377 --rc geninfo_all_blocks=1 00:03:31.377 --rc geninfo_unexecuted_blocks=1 00:03:31.377 00:03:31.377 ' 00:03:31.377 08:11:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:31.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.377 --rc genhtml_branch_coverage=1 00:03:31.377 --rc genhtml_function_coverage=1 00:03:31.377 --rc genhtml_legend=1 00:03:31.377 --rc geninfo_all_blocks=1 00:03:31.377 --rc geninfo_unexecuted_blocks=1 00:03:31.377 00:03:31.377 ' 00:03:31.377 08:11:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:31.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.377 --rc genhtml_branch_coverage=1 00:03:31.377 --rc genhtml_function_coverage=1 00:03:31.377 --rc genhtml_legend=1 00:03:31.377 --rc geninfo_all_blocks=1 00:03:31.377 --rc geninfo_unexecuted_blocks=1 00:03:31.377 00:03:31.377 ' 00:03:31.377 08:11:17 -- setup/driver.sh@68 -- # setup reset 00:03:31.377 08:11:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:31.377 08:11:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:33.910 08:11:19 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:33.910 08:11:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.910 08:11:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.910 08:11:19 -- common/autotest_common.sh@10 -- # set +x 00:03:33.910 ************************************ 00:03:33.910 START TEST guess_driver 00:03:33.910 ************************************ 00:03:33.910 08:11:19 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:33.910 08:11:19 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:33.910 08:11:19 -- setup/driver.sh@47 -- # local fail=0 00:03:33.910 08:11:19 -- setup/driver.sh@49 -- # pick_driver 00:03:33.910 08:11:19 -- setup/driver.sh@36 -- # vfio 00:03:33.910 08:11:19 -- setup/driver.sh@21 -- # local iommu_grups 00:03:33.910 08:11:19 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:33.910 08:11:19 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:33.910 08:11:19 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:33.910 08:11:19 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:33.910 08:11:19 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:33.910 08:11:19 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:33.910 08:11:19 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:33.910 08:11:19 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:33.910 08:11:19 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:33.910 08:11:19 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:33.910 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:33.910 08:11:19 -- setup/driver.sh@30 -- # return 0 00:03:33.910 08:11:19 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:33.910 08:11:19 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:33.910 08:11:19 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:33.910 08:11:19 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:33.910 Looking for driver=vfio-pci 00:03:33.910 08:11:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.910 08:11:19 -- setup/driver.sh@45 -- # setup output config 00:03:33.910 08:11:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.910 08:11:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.284 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.284 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.284 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.285 08:11:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.285 08:11:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.285 08:11:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.219 08:11:21 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.219 08:11:21 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.219 08:11:21 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.219 08:11:21 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:36.219 08:11:21 -- setup/driver.sh@65 -- # setup reset 00:03:36.219 08:11:21 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:36.219 08:11:21 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.753 00:03:38.753 real 0m4.980s 00:03:38.753 user 0m1.138s 00:03:38.753 sys 0m2.018s 00:03:38.753 08:11:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.753 08:11:24 -- common/autotest_common.sh@10 -- # set +x 00:03:38.753 ************************************ 00:03:38.753 END TEST guess_driver 00:03:38.753 ************************************ 00:03:39.012 00:03:39.012 real 0m7.660s 00:03:39.012 user 0m1.768s 00:03:39.012 sys 0m3.141s 00:03:39.012 08:11:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.012 08:11:24 -- common/autotest_common.sh@10 -- # set +x 00:03:39.012 ************************************ 00:03:39.012 END TEST driver 00:03:39.012 ************************************ 00:03:39.012 08:11:24 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:39.012 08:11:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.012 08:11:24 -- common/autotest_common.sh@10 -- # set +x 00:03:39.012 ************************************ 00:03:39.012 START TEST devices 00:03:39.012 ************************************ 00:03:39.012 08:11:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:39.012 * Looking for test storage... 00:03:39.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:39.012 08:11:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.012 08:11:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.012 08:11:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:39.012 08:11:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:39.012 08:11:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:39.012 08:11:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:39.012 08:11:24 -- scripts/common.sh@335 -- # IFS=.-: 00:03:39.012 08:11:24 -- scripts/common.sh@335 -- # read -ra ver1 00:03:39.012 08:11:24 -- scripts/common.sh@336 -- # IFS=.-: 00:03:39.012 08:11:24 -- scripts/common.sh@336 -- # read -ra ver2 00:03:39.012 08:11:24 -- scripts/common.sh@337 -- # local 'op=<' 00:03:39.012 08:11:24 -- scripts/common.sh@339 -- # ver1_l=2 00:03:39.012 08:11:24 -- scripts/common.sh@340 -- # ver2_l=1 00:03:39.012 08:11:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:39.012 08:11:24 -- scripts/common.sh@343 -- # case "$op" in 00:03:39.012 08:11:24 -- scripts/common.sh@344 -- # : 1 00:03:39.012 08:11:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:39.012 08:11:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:39.012 08:11:24 -- scripts/common.sh@364 -- # decimal 1 00:03:39.012 08:11:24 -- scripts/common.sh@352 -- # local d=1 00:03:39.012 08:11:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:39.012 08:11:24 -- scripts/common.sh@354 -- # echo 1 00:03:39.012 08:11:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:39.012 08:11:24 -- scripts/common.sh@365 -- # decimal 2 00:03:39.012 08:11:24 -- scripts/common.sh@352 -- # local d=2 00:03:39.012 08:11:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:39.012 08:11:24 -- scripts/common.sh@354 -- # echo 2 00:03:39.012 08:11:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:39.012 08:11:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:39.012 08:11:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:39.012 08:11:24 -- scripts/common.sh@367 -- # return 0 00:03:39.012 08:11:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:39.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.012 --rc genhtml_branch_coverage=1 00:03:39.012 --rc genhtml_function_coverage=1 00:03:39.012 --rc genhtml_legend=1 00:03:39.012 --rc geninfo_all_blocks=1 00:03:39.012 --rc geninfo_unexecuted_blocks=1 00:03:39.012 00:03:39.012 ' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:39.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.012 --rc genhtml_branch_coverage=1 00:03:39.012 --rc genhtml_function_coverage=1 00:03:39.012 --rc genhtml_legend=1 00:03:39.012 --rc geninfo_all_blocks=1 00:03:39.012 --rc geninfo_unexecuted_blocks=1 00:03:39.012 00:03:39.012 ' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:39.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.012 --rc genhtml_branch_coverage=1 00:03:39.012 --rc genhtml_function_coverage=1 00:03:39.012 --rc genhtml_legend=1 00:03:39.012 --rc geninfo_all_blocks=1 00:03:39.012 --rc geninfo_unexecuted_blocks=1 00:03:39.012 00:03:39.012 ' 00:03:39.012 08:11:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:39.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.012 --rc genhtml_branch_coverage=1 00:03:39.012 --rc genhtml_function_coverage=1 00:03:39.012 --rc genhtml_legend=1 00:03:39.012 --rc geninfo_all_blocks=1 00:03:39.012 --rc geninfo_unexecuted_blocks=1 00:03:39.012 00:03:39.012 ' 00:03:39.012 08:11:24 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:39.012 08:11:24 -- setup/devices.sh@192 -- # setup reset 00:03:39.012 08:11:24 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:39.012 08:11:24 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:40.913 08:11:26 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:40.913 08:11:26 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:40.913 08:11:26 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:40.913 08:11:26 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:40.913 08:11:26 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:40.913 08:11:26 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:40.913 08:11:26 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:40.913 08:11:26 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:40.913 08:11:26 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:40.913 08:11:26 -- setup/devices.sh@196 -- # blocks=() 00:03:40.913 08:11:26 -- setup/devices.sh@196 -- # declare -a blocks 00:03:40.913 08:11:26 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:40.913 08:11:26 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:40.913 08:11:26 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:40.913 08:11:26 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:40.913 08:11:26 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:40.913 08:11:26 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:40.913 08:11:26 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:40.913 08:11:26 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:40.913 08:11:26 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:40.913 08:11:26 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:40.913 08:11:26 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:40.913 No valid GPT data, bailing 00:03:40.913 08:11:26 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:40.913 08:11:26 -- scripts/common.sh@393 -- # pt= 00:03:40.913 08:11:26 -- scripts/common.sh@394 -- # return 1 00:03:40.913 08:11:26 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:40.913 08:11:26 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:40.913 08:11:26 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:40.913 08:11:26 -- setup/common.sh@80 -- # echo 1000204886016 00:03:40.913 08:11:26 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:40.913 08:11:26 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:40.913 08:11:26 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:40.913 08:11:26 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:40.913 08:11:26 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:40.913 08:11:26 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:40.913 08:11:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:40.913 08:11:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.913 08:11:26 -- common/autotest_common.sh@10 -- # set +x 00:03:40.913 ************************************ 00:03:40.913 START TEST nvme_mount 00:03:40.913 ************************************ 00:03:40.913 08:11:26 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:40.913 08:11:26 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:40.913 08:11:26 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:40.913 08:11:26 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.913 08:11:26 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:40.913 08:11:26 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:40.913 08:11:26 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:40.913 08:11:26 -- setup/common.sh@40 -- # local part_no=1 00:03:40.913 08:11:26 -- setup/common.sh@41 -- # local size=1073741824 00:03:40.913 08:11:26 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:40.913 08:11:26 -- setup/common.sh@44 -- # parts=() 00:03:40.913 08:11:26 -- setup/common.sh@44 -- # local parts 00:03:40.913 08:11:26 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:40.913 08:11:26 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.913 08:11:26 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:40.913 08:11:26 -- setup/common.sh@46 -- # (( part++ )) 00:03:40.913 08:11:26 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.913 08:11:26 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:40.913 08:11:26 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:40.913 08:11:26 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:41.846 Creating new GPT entries in memory. 00:03:41.846 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:41.846 other utilities. 00:03:41.846 08:11:27 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:41.847 08:11:27 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.847 08:11:27 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:41.847 08:11:27 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:41.847 08:11:27 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:42.783 Creating new GPT entries in memory. 00:03:42.783 The operation has completed successfully. 00:03:42.783 08:11:28 -- setup/common.sh@57 -- # (( part++ )) 00:03:42.783 08:11:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.783 08:11:28 -- setup/common.sh@62 -- # wait 825160 00:03:42.783 08:11:28 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.783 08:11:28 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:42.783 08:11:28 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.783 08:11:28 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:42.783 08:11:28 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:42.783 08:11:28 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.783 08:11:28 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.783 08:11:28 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.783 08:11:28 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:42.783 08:11:28 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.783 08:11:28 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.783 08:11:28 -- setup/devices.sh@53 -- # local found=0 00:03:42.783 08:11:28 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.783 08:11:28 -- setup/devices.sh@56 -- # : 00:03:42.783 08:11:28 -- setup/devices.sh@59 -- # local pci status 00:03:42.783 08:11:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.783 08:11:28 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.783 08:11:28 -- setup/devices.sh@47 -- # setup output config 00:03:42.783 08:11:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.783 08:11:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:43.717 08:11:29 -- setup/devices.sh@63 -- # found=1 00:03:43.717 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.717 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.717 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.717 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.717 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.718 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.718 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.718 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.718 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.718 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.718 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.976 08:11:29 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:43.976 08:11:29 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:43.976 08:11:29 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.976 08:11:29 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:43.976 08:11:29 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.976 08:11:29 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:43.976 08:11:29 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.976 08:11:29 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.976 08:11:29 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:43.976 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:43.976 08:11:29 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:43.976 08:11:29 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.269 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.269 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.269 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.269 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.269 08:11:30 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:44.269 08:11:30 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:44.269 08:11:30 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.269 08:11:30 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:44.269 08:11:30 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:44.555 08:11:30 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.555 08:11:30 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.555 08:11:30 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.555 08:11:30 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:44.555 08:11:30 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.555 08:11:30 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.555 08:11:30 -- setup/devices.sh@53 -- # local found=0 00:03:44.555 08:11:30 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:44.556 08:11:30 -- setup/devices.sh@56 -- # : 00:03:44.556 08:11:30 -- setup/devices.sh@59 -- # local pci status 00:03:44.556 08:11:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.556 08:11:30 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.556 08:11:30 -- setup/devices.sh@47 -- # setup output config 00:03:44.556 08:11:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.556 08:11:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:45.490 08:11:31 -- setup/devices.sh@63 -- # found=1 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.490 08:11:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.490 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.748 08:11:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:45.748 08:11:31 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:45.748 08:11:31 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.748 08:11:31 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:45.748 08:11:31 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.748 08:11:31 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.748 08:11:31 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:45.748 08:11:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:45.748 08:11:31 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:45.748 08:11:31 -- setup/devices.sh@50 -- # local mount_point= 00:03:45.748 08:11:31 -- setup/devices.sh@51 -- # local test_file= 00:03:45.748 08:11:31 -- setup/devices.sh@53 -- # local found=0 00:03:45.748 08:11:31 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:45.748 08:11:31 -- setup/devices.sh@59 -- # local pci status 00:03:45.748 08:11:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.749 08:11:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:45.749 08:11:31 -- setup/devices.sh@47 -- # setup output config 00:03:45.749 08:11:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.749 08:11:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:46.681 08:11:32 -- setup/devices.sh@63 -- # found=1 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.681 08:11:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.681 08:11:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.940 08:11:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.940 08:11:32 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:46.940 08:11:32 -- setup/devices.sh@68 -- # return 0 00:03:46.940 08:11:32 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:46.940 08:11:32 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.940 08:11:32 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.940 08:11:32 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.940 08:11:32 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:46.940 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:46.940 00:03:46.940 real 0m6.314s 00:03:46.940 user 0m1.421s 00:03:46.940 sys 0m2.452s 00:03:46.940 08:11:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.940 08:11:32 -- common/autotest_common.sh@10 -- # set +x 00:03:46.940 ************************************ 00:03:46.940 END TEST nvme_mount 00:03:46.940 ************************************ 00:03:46.940 08:11:32 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:46.940 08:11:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.940 08:11:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.940 08:11:32 -- common/autotest_common.sh@10 -- # set +x 00:03:46.940 ************************************ 00:03:46.940 START TEST dm_mount 00:03:46.940 ************************************ 00:03:46.940 08:11:32 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:46.940 08:11:32 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:46.940 08:11:32 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:46.940 08:11:32 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:46.940 08:11:32 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:46.940 08:11:32 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:46.940 08:11:32 -- setup/common.sh@40 -- # local part_no=2 00:03:46.940 08:11:32 -- setup/common.sh@41 -- # local size=1073741824 00:03:46.940 08:11:32 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:46.940 08:11:32 -- setup/common.sh@44 -- # parts=() 00:03:46.940 08:11:32 -- setup/common.sh@44 -- # local parts 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.940 08:11:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.940 08:11:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:46.940 08:11:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.940 08:11:32 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:46.940 08:11:32 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:46.940 08:11:32 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:47.873 Creating new GPT entries in memory. 00:03:47.873 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:47.873 other utilities. 00:03:47.873 08:11:33 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:47.873 08:11:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:47.873 08:11:33 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:47.873 08:11:33 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:47.873 08:11:33 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:49.245 Creating new GPT entries in memory. 00:03:49.245 The operation has completed successfully. 00:03:49.246 08:11:34 -- setup/common.sh@57 -- # (( part++ )) 00:03:49.246 08:11:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:49.246 08:11:34 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:49.246 08:11:34 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:49.246 08:11:34 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:50.180 The operation has completed successfully. 00:03:50.180 08:11:35 -- setup/common.sh@57 -- # (( part++ )) 00:03:50.180 08:11:35 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:50.180 08:11:35 -- setup/common.sh@62 -- # wait 827593 00:03:50.180 08:11:35 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:50.180 08:11:35 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:50.180 08:11:35 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:50.180 08:11:35 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:50.180 08:11:35 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:50.180 08:11:35 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:50.180 08:11:35 -- setup/devices.sh@161 -- # break 00:03:50.180 08:11:35 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:50.180 08:11:35 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:50.180 08:11:35 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:50.180 08:11:35 -- setup/devices.sh@166 -- # dm=dm-0 00:03:50.180 08:11:35 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:50.180 08:11:35 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:50.180 08:11:35 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:50.180 08:11:35 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:50.180 08:11:35 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:50.180 08:11:35 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:50.180 08:11:35 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:50.180 08:11:35 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:50.180 08:11:35 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:50.180 08:11:35 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:50.180 08:11:35 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:50.180 08:11:35 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:50.180 08:11:35 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:50.180 08:11:35 -- setup/devices.sh@53 -- # local found=0 00:03:50.180 08:11:35 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:50.180 08:11:35 -- setup/devices.sh@56 -- # : 00:03:50.180 08:11:35 -- setup/devices.sh@59 -- # local pci status 00:03:50.180 08:11:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.180 08:11:35 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:50.180 08:11:35 -- setup/devices.sh@47 -- # setup output config 00:03:50.180 08:11:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:50.180 08:11:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:51.115 08:11:36 -- setup/devices.sh@63 -- # found=1 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.115 08:11:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.115 08:11:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.374 08:11:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:51.374 08:11:37 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:51.374 08:11:37 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.374 08:11:37 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:51.374 08:11:37 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:51.374 08:11:37 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.374 08:11:37 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:51.374 08:11:37 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:51.374 08:11:37 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:51.374 08:11:37 -- setup/devices.sh@50 -- # local mount_point= 00:03:51.374 08:11:37 -- setup/devices.sh@51 -- # local test_file= 00:03:51.374 08:11:37 -- setup/devices.sh@53 -- # local found=0 00:03:51.374 08:11:37 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:51.374 08:11:37 -- setup/devices.sh@59 -- # local pci status 00:03:51.374 08:11:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.374 08:11:37 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:51.374 08:11:37 -- setup/devices.sh@47 -- # setup output config 00:03:51.374 08:11:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.374 08:11:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:52.748 08:11:38 -- setup/devices.sh@63 -- # found=1 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.748 08:11:38 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.748 08:11:38 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:52.748 08:11:38 -- setup/devices.sh@68 -- # return 0 00:03:52.748 08:11:38 -- setup/devices.sh@187 -- # cleanup_dm 00:03:52.748 08:11:38 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.748 08:11:38 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:52.748 08:11:38 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:52.748 08:11:38 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:52.748 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:52.748 08:11:38 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:52.748 00:03:52.748 real 0m5.776s 00:03:52.748 user 0m0.986s 00:03:52.748 sys 0m1.650s 00:03:52.748 08:11:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.748 08:11:38 -- common/autotest_common.sh@10 -- # set +x 00:03:52.748 ************************************ 00:03:52.748 END TEST dm_mount 00:03:52.748 ************************************ 00:03:52.748 08:11:38 -- setup/devices.sh@1 -- # cleanup 00:03:52.748 08:11:38 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:52.748 08:11:38 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.748 08:11:38 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:52.748 08:11:38 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.748 08:11:38 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:53.006 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:53.006 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:53.006 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:53.006 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:53.006 08:11:38 -- setup/devices.sh@12 -- # cleanup_dm 00:03:53.006 08:11:38 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:53.006 08:11:38 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:53.006 08:11:38 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:53.006 08:11:38 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:53.006 08:11:38 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:53.006 08:11:38 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:53.006 00:03:53.006 real 0m14.152s 00:03:53.006 user 0m3.147s 00:03:53.006 sys 0m5.199s 00:03:53.006 08:11:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:53.006 08:11:38 -- common/autotest_common.sh@10 -- # set +x 00:03:53.006 ************************************ 00:03:53.006 END TEST devices 00:03:53.006 ************************************ 00:03:53.006 00:03:53.006 real 0m44.294s 00:03:53.006 user 0m12.693s 00:03:53.006 sys 0m20.096s 00:03:53.006 08:11:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:53.006 08:11:38 -- common/autotest_common.sh@10 -- # set +x 00:03:53.006 ************************************ 00:03:53.006 END TEST setup.sh 00:03:53.006 ************************************ 00:03:53.006 08:11:38 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:54.378 Hugepages 00:03:54.378 node hugesize free / total 00:03:54.378 node0 1048576kB 0 / 0 00:03:54.378 node0 2048kB 2048 / 2048 00:03:54.378 node1 1048576kB 0 / 0 00:03:54.378 node1 2048kB 0 / 0 00:03:54.378 00:03:54.378 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:54.378 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:54.378 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:54.378 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:54.378 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:54.378 08:11:39 -- spdk/autotest.sh@128 -- # uname -s 00:03:54.378 08:11:39 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:54.378 08:11:39 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:54.378 08:11:39 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:55.314 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:55.572 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:55.572 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:56.507 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:56.507 08:11:42 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:57.882 08:11:43 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:57.882 08:11:43 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:57.882 08:11:43 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:57.882 08:11:43 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:57.882 08:11:43 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:57.882 08:11:43 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:57.882 08:11:43 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:57.882 08:11:43 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:57.882 08:11:43 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:57.882 08:11:43 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:57.882 08:11:43 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:57.882 08:11:43 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:58.817 Waiting for block devices as requested 00:03:58.817 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:59.075 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:59.075 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:59.075 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:59.333 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:59.333 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:59.333 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:59.333 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:59.591 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:59.591 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:59.591 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:59.591 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:59.849 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:59.849 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:59.849 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:59.849 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:00.108 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:00.108 08:11:45 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:00.108 08:11:45 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:00.108 08:11:45 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:00.108 08:11:45 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:00.108 08:11:45 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:00.108 08:11:45 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:00.108 08:11:45 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:00.108 08:11:45 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:00.108 08:11:45 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:00.108 08:11:45 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:00.108 08:11:45 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:00.108 08:11:45 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:00.108 08:11:45 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:00.108 08:11:45 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:00.108 08:11:45 -- common/autotest_common.sh@1552 -- # continue 00:04:00.108 08:11:45 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:00.108 08:11:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:00.108 08:11:45 -- common/autotest_common.sh@10 -- # set +x 00:04:00.108 08:11:45 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:00.108 08:11:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:00.108 08:11:45 -- common/autotest_common.sh@10 -- # set +x 00:04:00.108 08:11:45 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:01.481 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:01.481 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:01.481 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:02.416 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:02.674 08:11:48 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:02.674 08:11:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:02.674 08:11:48 -- common/autotest_common.sh@10 -- # set +x 00:04:02.674 08:11:48 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:02.674 08:11:48 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:02.674 08:11:48 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:02.674 08:11:48 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:02.674 08:11:48 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:02.674 08:11:48 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:02.674 08:11:48 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:02.674 08:11:48 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:02.674 08:11:48 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:02.674 08:11:48 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:02.674 08:11:48 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:02.674 08:11:48 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:02.674 08:11:48 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:02.674 08:11:48 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:02.674 08:11:48 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:02.674 08:11:48 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:02.674 08:11:48 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:02.674 08:11:48 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:02.674 08:11:48 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:02.674 08:11:48 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:02.674 08:11:48 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=832894 00:04:02.674 08:11:48 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:02.674 08:11:48 -- common/autotest_common.sh@1593 -- # waitforlisten 832894 00:04:02.674 08:11:48 -- common/autotest_common.sh@829 -- # '[' -z 832894 ']' 00:04:02.674 08:11:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:02.674 08:11:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:02.674 08:11:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:02.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:02.674 08:11:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:02.674 08:11:48 -- common/autotest_common.sh@10 -- # set +x 00:04:02.674 [2024-11-26 08:11:48.408740] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:02.674 [2024-11-26 08:11:48.408843] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid832894 ] 00:04:02.674 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.674 [2024-11-26 08:11:48.467128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:02.933 [2024-11-26 08:11:48.575643] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:02.933 [2024-11-26 08:11:48.575849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.880 08:11:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:03.880 08:11:49 -- common/autotest_common.sh@862 -- # return 0 00:04:03.880 08:11:49 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:03.880 08:11:49 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:03.880 08:11:49 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:07.163 nvme0n1 00:04:07.163 08:11:52 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:07.163 [2024-11-26 08:11:52.718788] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:07.163 [2024-11-26 08:11:52.718839] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:07.163 request: 00:04:07.163 { 00:04:07.163 "nvme_ctrlr_name": "nvme0", 00:04:07.163 "password": "test", 00:04:07.163 "method": "bdev_nvme_opal_revert", 00:04:07.163 "req_id": 1 00:04:07.163 } 00:04:07.163 Got JSON-RPC error response 00:04:07.163 response: 00:04:07.163 { 00:04:07.163 "code": -32603, 00:04:07.163 "message": "Internal error" 00:04:07.163 } 00:04:07.163 08:11:52 -- common/autotest_common.sh@1599 -- # true 00:04:07.163 08:11:52 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:07.163 08:11:52 -- common/autotest_common.sh@1603 -- # killprocess 832894 00:04:07.163 08:11:52 -- common/autotest_common.sh@936 -- # '[' -z 832894 ']' 00:04:07.163 08:11:52 -- common/autotest_common.sh@940 -- # kill -0 832894 00:04:07.163 08:11:52 -- common/autotest_common.sh@941 -- # uname 00:04:07.163 08:11:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:07.163 08:11:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 832894 00:04:07.163 08:11:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:07.163 08:11:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:07.163 08:11:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 832894' 00:04:07.163 killing process with pid 832894 00:04:07.163 08:11:52 -- common/autotest_common.sh@955 -- # kill 832894 00:04:07.163 08:11:52 -- common/autotest_common.sh@960 -- # wait 832894 00:04:09.065 08:11:54 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:09.065 08:11:54 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:09.065 08:11:54 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:09.065 08:11:54 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:09.065 08:11:54 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:09.065 08:11:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.065 08:11:54 -- common/autotest_common.sh@10 -- # set +x 00:04:09.065 08:11:54 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:09.065 08:11:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.065 08:11:54 -- common/autotest_common.sh@10 -- # set +x 00:04:09.065 ************************************ 00:04:09.065 START TEST env 00:04:09.065 ************************************ 00:04:09.065 08:11:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:09.065 * Looking for test storage... 00:04:09.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:09.065 08:11:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.065 08:11:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.065 08:11:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.065 08:11:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.065 08:11:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.065 08:11:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.065 08:11:54 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.065 08:11:54 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.065 08:11:54 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.065 08:11:54 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.065 08:11:54 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.065 08:11:54 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.065 08:11:54 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.065 08:11:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.065 08:11:54 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.065 08:11:54 -- scripts/common.sh@344 -- # : 1 00:04:09.065 08:11:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.065 08:11:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.065 08:11:54 -- scripts/common.sh@364 -- # decimal 1 00:04:09.065 08:11:54 -- scripts/common.sh@352 -- # local d=1 00:04:09.065 08:11:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.065 08:11:54 -- scripts/common.sh@354 -- # echo 1 00:04:09.065 08:11:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.065 08:11:54 -- scripts/common.sh@365 -- # decimal 2 00:04:09.065 08:11:54 -- scripts/common.sh@352 -- # local d=2 00:04:09.065 08:11:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.065 08:11:54 -- scripts/common.sh@354 -- # echo 2 00:04:09.065 08:11:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.065 08:11:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.065 08:11:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.065 08:11:54 -- scripts/common.sh@367 -- # return 0 00:04:09.065 08:11:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.065 --rc genhtml_branch_coverage=1 00:04:09.065 --rc genhtml_function_coverage=1 00:04:09.065 --rc genhtml_legend=1 00:04:09.065 --rc geninfo_all_blocks=1 00:04:09.065 --rc geninfo_unexecuted_blocks=1 00:04:09.065 00:04:09.065 ' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.065 --rc genhtml_branch_coverage=1 00:04:09.065 --rc genhtml_function_coverage=1 00:04:09.065 --rc genhtml_legend=1 00:04:09.065 --rc geninfo_all_blocks=1 00:04:09.065 --rc geninfo_unexecuted_blocks=1 00:04:09.065 00:04:09.065 ' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.065 --rc genhtml_branch_coverage=1 00:04:09.065 --rc genhtml_function_coverage=1 00:04:09.065 --rc genhtml_legend=1 00:04:09.065 --rc geninfo_all_blocks=1 00:04:09.065 --rc geninfo_unexecuted_blocks=1 00:04:09.065 00:04:09.065 ' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.065 --rc genhtml_branch_coverage=1 00:04:09.065 --rc genhtml_function_coverage=1 00:04:09.065 --rc genhtml_legend=1 00:04:09.065 --rc geninfo_all_blocks=1 00:04:09.065 --rc geninfo_unexecuted_blocks=1 00:04:09.065 00:04:09.065 ' 00:04:09.065 08:11:54 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:09.065 08:11:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.065 08:11:54 -- common/autotest_common.sh@10 -- # set +x 00:04:09.065 ************************************ 00:04:09.065 START TEST env_memory 00:04:09.065 ************************************ 00:04:09.065 08:11:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:09.065 00:04:09.065 00:04:09.065 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.065 http://cunit.sourceforge.net/ 00:04:09.065 00:04:09.065 00:04:09.065 Suite: memory 00:04:09.065 Test: alloc and free memory map ...[2024-11-26 08:11:54.763926] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:09.065 passed 00:04:09.065 Test: mem map translation ...[2024-11-26 08:11:54.784249] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:09.065 [2024-11-26 08:11:54.784270] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:09.065 [2024-11-26 08:11:54.784325] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:09.065 [2024-11-26 08:11:54.784337] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:09.065 passed 00:04:09.065 Test: mem map registration ...[2024-11-26 08:11:54.827349] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:09.065 [2024-11-26 08:11:54.827368] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:09.065 passed 00:04:09.065 Test: mem map adjacent registrations ...passed 00:04:09.065 00:04:09.065 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.065 suites 1 1 n/a 0 0 00:04:09.065 tests 4 4 4 0 0 00:04:09.065 asserts 152 152 152 0 n/a 00:04:09.065 00:04:09.065 Elapsed time = 0.148 seconds 00:04:09.065 00:04:09.065 real 0m0.156s 00:04:09.065 user 0m0.149s 00:04:09.065 sys 0m0.007s 00:04:09.065 08:11:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.065 08:11:54 -- common/autotest_common.sh@10 -- # set +x 00:04:09.065 ************************************ 00:04:09.065 END TEST env_memory 00:04:09.065 ************************************ 00:04:09.065 08:11:54 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:09.065 08:11:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.065 08:11:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.065 08:11:54 -- common/autotest_common.sh@10 -- # set +x 00:04:09.065 ************************************ 00:04:09.065 START TEST env_vtophys 00:04:09.065 ************************************ 00:04:09.065 08:11:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:09.324 EAL: lib.eal log level changed from notice to debug 00:04:09.324 EAL: Detected lcore 0 as core 0 on socket 0 00:04:09.324 EAL: Detected lcore 1 as core 1 on socket 0 00:04:09.324 EAL: Detected lcore 2 as core 2 on socket 0 00:04:09.324 EAL: Detected lcore 3 as core 3 on socket 0 00:04:09.324 EAL: Detected lcore 4 as core 4 on socket 0 00:04:09.324 EAL: Detected lcore 5 as core 5 on socket 0 00:04:09.324 EAL: Detected lcore 6 as core 8 on socket 0 00:04:09.324 EAL: Detected lcore 7 as core 9 on socket 0 00:04:09.324 EAL: Detected lcore 8 as core 10 on socket 0 00:04:09.324 EAL: Detected lcore 9 as core 11 on socket 0 00:04:09.324 EAL: Detected lcore 10 as core 12 on socket 0 00:04:09.324 EAL: Detected lcore 11 as core 13 on socket 0 00:04:09.324 EAL: Detected lcore 12 as core 0 on socket 1 00:04:09.324 EAL: Detected lcore 13 as core 1 on socket 1 00:04:09.324 EAL: Detected lcore 14 as core 2 on socket 1 00:04:09.324 EAL: Detected lcore 15 as core 3 on socket 1 00:04:09.324 EAL: Detected lcore 16 as core 4 on socket 1 00:04:09.324 EAL: Detected lcore 17 as core 5 on socket 1 00:04:09.324 EAL: Detected lcore 18 as core 8 on socket 1 00:04:09.324 EAL: Detected lcore 19 as core 9 on socket 1 00:04:09.325 EAL: Detected lcore 20 as core 10 on socket 1 00:04:09.325 EAL: Detected lcore 21 as core 11 on socket 1 00:04:09.325 EAL: Detected lcore 22 as core 12 on socket 1 00:04:09.325 EAL: Detected lcore 23 as core 13 on socket 1 00:04:09.325 EAL: Detected lcore 24 as core 0 on socket 0 00:04:09.325 EAL: Detected lcore 25 as core 1 on socket 0 00:04:09.325 EAL: Detected lcore 26 as core 2 on socket 0 00:04:09.325 EAL: Detected lcore 27 as core 3 on socket 0 00:04:09.325 EAL: Detected lcore 28 as core 4 on socket 0 00:04:09.325 EAL: Detected lcore 29 as core 5 on socket 0 00:04:09.325 EAL: Detected lcore 30 as core 8 on socket 0 00:04:09.325 EAL: Detected lcore 31 as core 9 on socket 0 00:04:09.325 EAL: Detected lcore 32 as core 10 on socket 0 00:04:09.325 EAL: Detected lcore 33 as core 11 on socket 0 00:04:09.325 EAL: Detected lcore 34 as core 12 on socket 0 00:04:09.325 EAL: Detected lcore 35 as core 13 on socket 0 00:04:09.325 EAL: Detected lcore 36 as core 0 on socket 1 00:04:09.325 EAL: Detected lcore 37 as core 1 on socket 1 00:04:09.325 EAL: Detected lcore 38 as core 2 on socket 1 00:04:09.325 EAL: Detected lcore 39 as core 3 on socket 1 00:04:09.325 EAL: Detected lcore 40 as core 4 on socket 1 00:04:09.325 EAL: Detected lcore 41 as core 5 on socket 1 00:04:09.325 EAL: Detected lcore 42 as core 8 on socket 1 00:04:09.325 EAL: Detected lcore 43 as core 9 on socket 1 00:04:09.325 EAL: Detected lcore 44 as core 10 on socket 1 00:04:09.325 EAL: Detected lcore 45 as core 11 on socket 1 00:04:09.325 EAL: Detected lcore 46 as core 12 on socket 1 00:04:09.325 EAL: Detected lcore 47 as core 13 on socket 1 00:04:09.325 EAL: Maximum logical cores by configuration: 128 00:04:09.325 EAL: Detected CPU lcores: 48 00:04:09.325 EAL: Detected NUMA nodes: 2 00:04:09.325 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:09.325 EAL: Detected shared linkage of DPDK 00:04:09.325 EAL: No shared files mode enabled, IPC will be disabled 00:04:09.325 EAL: Bus pci wants IOVA as 'DC' 00:04:09.325 EAL: Buses did not request a specific IOVA mode. 00:04:09.325 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:09.325 EAL: Selected IOVA mode 'VA' 00:04:09.325 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.325 EAL: Probing VFIO support... 00:04:09.325 EAL: IOMMU type 1 (Type 1) is supported 00:04:09.325 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:09.325 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:09.325 EAL: VFIO support initialized 00:04:09.325 EAL: Ask a virtual area of 0x2e000 bytes 00:04:09.325 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:09.325 EAL: Setting up physically contiguous memory... 00:04:09.325 EAL: Setting maximum number of open files to 524288 00:04:09.325 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:09.325 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:09.325 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:09.325 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:09.325 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.325 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:09.325 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.325 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.325 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:09.325 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:09.325 EAL: Hugepages will be freed exactly as allocated. 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: TSC frequency is ~2700000 KHz 00:04:09.325 EAL: Main lcore 0 is ready (tid=7f2e24f55a00;cpuset=[0]) 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 0 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 2MB 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:09.325 EAL: Mem event callback 'spdk:(nil)' registered 00:04:09.325 00:04:09.325 00:04:09.325 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.325 http://cunit.sourceforge.net/ 00:04:09.325 00:04:09.325 00:04:09.325 Suite: components_suite 00:04:09.325 Test: vtophys_malloc_test ...passed 00:04:09.325 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 4MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was shrunk by 4MB 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 6MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was shrunk by 6MB 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 10MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was shrunk by 10MB 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 18MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was shrunk by 18MB 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 34MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was shrunk by 34MB 00:04:09.325 EAL: Trying to obtain current memory policy. 00:04:09.325 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.325 EAL: Restoring previous memory policy: 4 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.325 EAL: Heap on socket 0 was expanded by 66MB 00:04:09.325 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.325 EAL: request: mp_malloc_sync 00:04:09.325 EAL: No shared files mode enabled, IPC is disabled 00:04:09.326 EAL: Heap on socket 0 was shrunk by 66MB 00:04:09.326 EAL: Trying to obtain current memory policy. 00:04:09.326 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.326 EAL: Restoring previous memory policy: 4 00:04:09.326 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.326 EAL: request: mp_malloc_sync 00:04:09.326 EAL: No shared files mode enabled, IPC is disabled 00:04:09.326 EAL: Heap on socket 0 was expanded by 130MB 00:04:09.326 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.326 EAL: request: mp_malloc_sync 00:04:09.326 EAL: No shared files mode enabled, IPC is disabled 00:04:09.326 EAL: Heap on socket 0 was shrunk by 130MB 00:04:09.326 EAL: Trying to obtain current memory policy. 00:04:09.326 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.584 EAL: Restoring previous memory policy: 4 00:04:09.584 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.584 EAL: request: mp_malloc_sync 00:04:09.584 EAL: No shared files mode enabled, IPC is disabled 00:04:09.584 EAL: Heap on socket 0 was expanded by 258MB 00:04:09.584 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.584 EAL: request: mp_malloc_sync 00:04:09.584 EAL: No shared files mode enabled, IPC is disabled 00:04:09.584 EAL: Heap on socket 0 was shrunk by 258MB 00:04:09.584 EAL: Trying to obtain current memory policy. 00:04:09.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.842 EAL: Restoring previous memory policy: 4 00:04:09.842 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.842 EAL: request: mp_malloc_sync 00:04:09.842 EAL: No shared files mode enabled, IPC is disabled 00:04:09.842 EAL: Heap on socket 0 was expanded by 514MB 00:04:09.842 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.842 EAL: request: mp_malloc_sync 00:04:09.842 EAL: No shared files mode enabled, IPC is disabled 00:04:09.842 EAL: Heap on socket 0 was shrunk by 514MB 00:04:09.842 EAL: Trying to obtain current memory policy. 00:04:09.842 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.408 EAL: Restoring previous memory policy: 4 00:04:10.408 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.408 EAL: request: mp_malloc_sync 00:04:10.408 EAL: No shared files mode enabled, IPC is disabled 00:04:10.408 EAL: Heap on socket 0 was expanded by 1026MB 00:04:10.408 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.668 EAL: request: mp_malloc_sync 00:04:10.668 EAL: No shared files mode enabled, IPC is disabled 00:04:10.668 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:10.668 passed 00:04:10.668 00:04:10.668 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.668 suites 1 1 n/a 0 0 00:04:10.668 tests 2 2 2 0 0 00:04:10.668 asserts 497 497 497 0 n/a 00:04:10.668 00:04:10.668 Elapsed time = 1.371 seconds 00:04:10.668 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.668 EAL: request: mp_malloc_sync 00:04:10.668 EAL: No shared files mode enabled, IPC is disabled 00:04:10.668 EAL: Heap on socket 0 was shrunk by 2MB 00:04:10.668 EAL: No shared files mode enabled, IPC is disabled 00:04:10.668 EAL: No shared files mode enabled, IPC is disabled 00:04:10.668 EAL: No shared files mode enabled, IPC is disabled 00:04:10.668 00:04:10.668 real 0m1.486s 00:04:10.668 user 0m0.857s 00:04:10.668 sys 0m0.598s 00:04:10.668 08:11:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.668 08:11:56 -- common/autotest_common.sh@10 -- # set +x 00:04:10.668 ************************************ 00:04:10.668 END TEST env_vtophys 00:04:10.668 ************************************ 00:04:10.668 08:11:56 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:10.668 08:11:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.668 08:11:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.668 08:11:56 -- common/autotest_common.sh@10 -- # set +x 00:04:10.668 ************************************ 00:04:10.668 START TEST env_pci 00:04:10.668 ************************************ 00:04:10.668 08:11:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:10.668 00:04:10.668 00:04:10.668 CUnit - A unit testing framework for C - Version 2.1-3 00:04:10.668 http://cunit.sourceforge.net/ 00:04:10.668 00:04:10.668 00:04:10.668 Suite: pci 00:04:10.668 Test: pci_hook ...[2024-11-26 08:11:56.430914] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 833937 has claimed it 00:04:10.668 EAL: Cannot find device (10000:00:01.0) 00:04:10.668 EAL: Failed to attach device on primary process 00:04:10.668 passed 00:04:10.668 00:04:10.668 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.668 suites 1 1 n/a 0 0 00:04:10.668 tests 1 1 1 0 0 00:04:10.668 asserts 25 25 25 0 n/a 00:04:10.668 00:04:10.668 Elapsed time = 0.022 seconds 00:04:10.668 00:04:10.668 real 0m0.035s 00:04:10.668 user 0m0.019s 00:04:10.668 sys 0m0.016s 00:04:10.668 08:11:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.668 08:11:56 -- common/autotest_common.sh@10 -- # set +x 00:04:10.668 ************************************ 00:04:10.668 END TEST env_pci 00:04:10.668 ************************************ 00:04:10.668 08:11:56 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:10.668 08:11:56 -- env/env.sh@15 -- # uname 00:04:10.668 08:11:56 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:10.668 08:11:56 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:10.668 08:11:56 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:10.668 08:11:56 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:10.668 08:11:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.668 08:11:56 -- common/autotest_common.sh@10 -- # set +x 00:04:10.668 ************************************ 00:04:10.668 START TEST env_dpdk_post_init 00:04:10.668 ************************************ 00:04:10.668 08:11:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:10.668 EAL: Detected CPU lcores: 48 00:04:10.668 EAL: Detected NUMA nodes: 2 00:04:10.668 EAL: Detected shared linkage of DPDK 00:04:10.668 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:10.927 EAL: Selected IOVA mode 'VA' 00:04:10.927 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.927 EAL: VFIO support initialized 00:04:10.927 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:10.927 EAL: Using IOMMU type 1 (Type 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:10.927 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:11.185 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:11.765 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:15.046 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:15.046 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:15.046 Starting DPDK initialization... 00:04:15.046 Starting SPDK post initialization... 00:04:15.046 SPDK NVMe probe 00:04:15.046 Attaching to 0000:88:00.0 00:04:15.046 Attached to 0000:88:00.0 00:04:15.046 Cleaning up... 00:04:15.046 00:04:15.046 real 0m4.390s 00:04:15.046 user 0m3.268s 00:04:15.046 sys 0m0.179s 00:04:15.046 08:12:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.046 08:12:00 -- common/autotest_common.sh@10 -- # set +x 00:04:15.046 ************************************ 00:04:15.046 END TEST env_dpdk_post_init 00:04:15.046 ************************************ 00:04:15.046 08:12:00 -- env/env.sh@26 -- # uname 00:04:15.046 08:12:00 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:15.046 08:12:00 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:15.046 08:12:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.046 08:12:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.046 08:12:00 -- common/autotest_common.sh@10 -- # set +x 00:04:15.046 ************************************ 00:04:15.046 START TEST env_mem_callbacks 00:04:15.046 ************************************ 00:04:15.046 08:12:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:15.304 EAL: Detected CPU lcores: 48 00:04:15.304 EAL: Detected NUMA nodes: 2 00:04:15.304 EAL: Detected shared linkage of DPDK 00:04:15.304 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:15.304 EAL: Selected IOVA mode 'VA' 00:04:15.304 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.304 EAL: VFIO support initialized 00:04:15.304 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:15.304 00:04:15.304 00:04:15.304 CUnit - A unit testing framework for C - Version 2.1-3 00:04:15.304 http://cunit.sourceforge.net/ 00:04:15.304 00:04:15.304 00:04:15.304 Suite: memory 00:04:15.304 Test: test ... 00:04:15.304 register 0x200000200000 2097152 00:04:15.304 malloc 3145728 00:04:15.304 register 0x200000400000 4194304 00:04:15.304 buf 0x200000500000 len 3145728 PASSED 00:04:15.304 malloc 64 00:04:15.304 buf 0x2000004fff40 len 64 PASSED 00:04:15.304 malloc 4194304 00:04:15.304 register 0x200000800000 6291456 00:04:15.304 buf 0x200000a00000 len 4194304 PASSED 00:04:15.304 free 0x200000500000 3145728 00:04:15.304 free 0x2000004fff40 64 00:04:15.304 unregister 0x200000400000 4194304 PASSED 00:04:15.304 free 0x200000a00000 4194304 00:04:15.304 unregister 0x200000800000 6291456 PASSED 00:04:15.304 malloc 8388608 00:04:15.304 register 0x200000400000 10485760 00:04:15.304 buf 0x200000600000 len 8388608 PASSED 00:04:15.304 free 0x200000600000 8388608 00:04:15.304 unregister 0x200000400000 10485760 PASSED 00:04:15.304 passed 00:04:15.304 00:04:15.304 Run Summary: Type Total Ran Passed Failed Inactive 00:04:15.304 suites 1 1 n/a 0 0 00:04:15.304 tests 1 1 1 0 0 00:04:15.305 asserts 15 15 15 0 n/a 00:04:15.305 00:04:15.305 Elapsed time = 0.005 seconds 00:04:15.305 00:04:15.305 real 0m0.048s 00:04:15.305 user 0m0.016s 00:04:15.305 sys 0m0.032s 00:04:15.305 08:12:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.305 08:12:00 -- common/autotest_common.sh@10 -- # set +x 00:04:15.305 ************************************ 00:04:15.305 END TEST env_mem_callbacks 00:04:15.305 ************************************ 00:04:15.305 00:04:15.305 real 0m6.384s 00:04:15.305 user 0m4.449s 00:04:15.305 sys 0m0.988s 00:04:15.305 08:12:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.305 08:12:00 -- common/autotest_common.sh@10 -- # set +x 00:04:15.305 ************************************ 00:04:15.305 END TEST env 00:04:15.305 ************************************ 00:04:15.305 08:12:00 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:15.305 08:12:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.305 08:12:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.305 08:12:00 -- common/autotest_common.sh@10 -- # set +x 00:04:15.305 ************************************ 00:04:15.305 START TEST rpc 00:04:15.305 ************************************ 00:04:15.305 08:12:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:15.305 * Looking for test storage... 00:04:15.305 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:15.305 08:12:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:15.305 08:12:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:15.305 08:12:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:15.305 08:12:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:15.305 08:12:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:15.305 08:12:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:15.305 08:12:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:15.305 08:12:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:15.305 08:12:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:15.305 08:12:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:15.305 08:12:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:15.305 08:12:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:15.305 08:12:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:15.305 08:12:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:15.305 08:12:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:15.305 08:12:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:15.305 08:12:01 -- scripts/common.sh@344 -- # : 1 00:04:15.305 08:12:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:15.305 08:12:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:15.305 08:12:01 -- scripts/common.sh@364 -- # decimal 1 00:04:15.305 08:12:01 -- scripts/common.sh@352 -- # local d=1 00:04:15.305 08:12:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:15.305 08:12:01 -- scripts/common.sh@354 -- # echo 1 00:04:15.305 08:12:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:15.305 08:12:01 -- scripts/common.sh@365 -- # decimal 2 00:04:15.305 08:12:01 -- scripts/common.sh@352 -- # local d=2 00:04:15.305 08:12:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:15.305 08:12:01 -- scripts/common.sh@354 -- # echo 2 00:04:15.305 08:12:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:15.305 08:12:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:15.305 08:12:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:15.305 08:12:01 -- scripts/common.sh@367 -- # return 0 00:04:15.305 08:12:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:15.305 08:12:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:15.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.305 --rc genhtml_branch_coverage=1 00:04:15.305 --rc genhtml_function_coverage=1 00:04:15.305 --rc genhtml_legend=1 00:04:15.305 --rc geninfo_all_blocks=1 00:04:15.305 --rc geninfo_unexecuted_blocks=1 00:04:15.305 00:04:15.305 ' 00:04:15.305 08:12:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:15.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.305 --rc genhtml_branch_coverage=1 00:04:15.305 --rc genhtml_function_coverage=1 00:04:15.305 --rc genhtml_legend=1 00:04:15.305 --rc geninfo_all_blocks=1 00:04:15.305 --rc geninfo_unexecuted_blocks=1 00:04:15.305 00:04:15.305 ' 00:04:15.305 08:12:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:15.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.305 --rc genhtml_branch_coverage=1 00:04:15.305 --rc genhtml_function_coverage=1 00:04:15.305 --rc genhtml_legend=1 00:04:15.305 --rc geninfo_all_blocks=1 00:04:15.305 --rc geninfo_unexecuted_blocks=1 00:04:15.305 00:04:15.305 ' 00:04:15.305 08:12:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:15.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.305 --rc genhtml_branch_coverage=1 00:04:15.305 --rc genhtml_function_coverage=1 00:04:15.305 --rc genhtml_legend=1 00:04:15.305 --rc geninfo_all_blocks=1 00:04:15.305 --rc geninfo_unexecuted_blocks=1 00:04:15.305 00:04:15.305 ' 00:04:15.305 08:12:01 -- rpc/rpc.sh@65 -- # spdk_pid=834682 00:04:15.305 08:12:01 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:15.305 08:12:01 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:15.305 08:12:01 -- rpc/rpc.sh@67 -- # waitforlisten 834682 00:04:15.305 08:12:01 -- common/autotest_common.sh@829 -- # '[' -z 834682 ']' 00:04:15.305 08:12:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:15.305 08:12:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:15.305 08:12:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:15.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:15.305 08:12:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:15.305 08:12:01 -- common/autotest_common.sh@10 -- # set +x 00:04:15.564 [2024-11-26 08:12:01.179100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:15.564 [2024-11-26 08:12:01.179178] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid834682 ] 00:04:15.564 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.564 [2024-11-26 08:12:01.236489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.564 [2024-11-26 08:12:01.353667] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:15.564 [2024-11-26 08:12:01.353842] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:15.564 [2024-11-26 08:12:01.353868] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 834682' to capture a snapshot of events at runtime. 00:04:15.564 [2024-11-26 08:12:01.353883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid834682 for offline analysis/debug. 00:04:15.564 [2024-11-26 08:12:01.353914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.499 08:12:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:16.499 08:12:02 -- common/autotest_common.sh@862 -- # return 0 00:04:16.499 08:12:02 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:16.499 08:12:02 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:16.499 08:12:02 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:16.499 08:12:02 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:16.499 08:12:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.499 08:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 ************************************ 00:04:16.499 START TEST rpc_integrity 00:04:16.499 ************************************ 00:04:16.499 08:12:02 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:16.499 08:12:02 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:16.499 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.499 08:12:02 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:16.499 08:12:02 -- rpc/rpc.sh@13 -- # jq length 00:04:16.499 08:12:02 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:16.499 08:12:02 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:16.499 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.499 08:12:02 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:16.499 08:12:02 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:16.499 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.499 08:12:02 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:16.499 { 00:04:16.499 "name": "Malloc0", 00:04:16.499 "aliases": [ 00:04:16.499 "286f26ab-3cd5-40d9-9032-c6a7c4b4e6a5" 00:04:16.499 ], 00:04:16.499 "product_name": "Malloc disk", 00:04:16.499 "block_size": 512, 00:04:16.499 "num_blocks": 16384, 00:04:16.499 "uuid": "286f26ab-3cd5-40d9-9032-c6a7c4b4e6a5", 00:04:16.499 "assigned_rate_limits": { 00:04:16.499 "rw_ios_per_sec": 0, 00:04:16.499 "rw_mbytes_per_sec": 0, 00:04:16.499 "r_mbytes_per_sec": 0, 00:04:16.499 "w_mbytes_per_sec": 0 00:04:16.499 }, 00:04:16.499 "claimed": false, 00:04:16.499 "zoned": false, 00:04:16.499 "supported_io_types": { 00:04:16.499 "read": true, 00:04:16.499 "write": true, 00:04:16.499 "unmap": true, 00:04:16.499 "write_zeroes": true, 00:04:16.499 "flush": true, 00:04:16.499 "reset": true, 00:04:16.499 "compare": false, 00:04:16.499 "compare_and_write": false, 00:04:16.499 "abort": true, 00:04:16.499 "nvme_admin": false, 00:04:16.499 "nvme_io": false 00:04:16.499 }, 00:04:16.499 "memory_domains": [ 00:04:16.499 { 00:04:16.499 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.499 "dma_device_type": 2 00:04:16.499 } 00:04:16.499 ], 00:04:16.499 "driver_specific": {} 00:04:16.499 } 00:04:16.499 ]' 00:04:16.499 08:12:02 -- rpc/rpc.sh@17 -- # jq length 00:04:16.499 08:12:02 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:16.499 08:12:02 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:16.499 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 [2024-11-26 08:12:02.257173] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:16.499 [2024-11-26 08:12:02.257231] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:16.499 [2024-11-26 08:12:02.257259] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12c0cb0 00:04:16.499 [2024-11-26 08:12:02.257274] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:16.499 [2024-11-26 08:12:02.258740] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:16.499 [2024-11-26 08:12:02.258774] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:16.499 Passthru0 00:04:16.499 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.499 08:12:02 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:16.499 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.499 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.499 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.499 08:12:02 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:16.499 { 00:04:16.499 "name": "Malloc0", 00:04:16.499 "aliases": [ 00:04:16.499 "286f26ab-3cd5-40d9-9032-c6a7c4b4e6a5" 00:04:16.499 ], 00:04:16.499 "product_name": "Malloc disk", 00:04:16.499 "block_size": 512, 00:04:16.499 "num_blocks": 16384, 00:04:16.499 "uuid": "286f26ab-3cd5-40d9-9032-c6a7c4b4e6a5", 00:04:16.499 "assigned_rate_limits": { 00:04:16.499 "rw_ios_per_sec": 0, 00:04:16.499 "rw_mbytes_per_sec": 0, 00:04:16.499 "r_mbytes_per_sec": 0, 00:04:16.499 "w_mbytes_per_sec": 0 00:04:16.499 }, 00:04:16.499 "claimed": true, 00:04:16.499 "claim_type": "exclusive_write", 00:04:16.499 "zoned": false, 00:04:16.499 "supported_io_types": { 00:04:16.499 "read": true, 00:04:16.499 "write": true, 00:04:16.499 "unmap": true, 00:04:16.499 "write_zeroes": true, 00:04:16.499 "flush": true, 00:04:16.499 "reset": true, 00:04:16.499 "compare": false, 00:04:16.499 "compare_and_write": false, 00:04:16.499 "abort": true, 00:04:16.499 "nvme_admin": false, 00:04:16.499 "nvme_io": false 00:04:16.499 }, 00:04:16.499 "memory_domains": [ 00:04:16.499 { 00:04:16.499 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.499 "dma_device_type": 2 00:04:16.499 } 00:04:16.499 ], 00:04:16.499 "driver_specific": {} 00:04:16.499 }, 00:04:16.499 { 00:04:16.499 "name": "Passthru0", 00:04:16.499 "aliases": [ 00:04:16.499 "b2961939-7889-5f72-96fa-3d26cb8077fc" 00:04:16.499 ], 00:04:16.499 "product_name": "passthru", 00:04:16.499 "block_size": 512, 00:04:16.499 "num_blocks": 16384, 00:04:16.499 "uuid": "b2961939-7889-5f72-96fa-3d26cb8077fc", 00:04:16.499 "assigned_rate_limits": { 00:04:16.499 "rw_ios_per_sec": 0, 00:04:16.499 "rw_mbytes_per_sec": 0, 00:04:16.499 "r_mbytes_per_sec": 0, 00:04:16.499 "w_mbytes_per_sec": 0 00:04:16.499 }, 00:04:16.499 "claimed": false, 00:04:16.499 "zoned": false, 00:04:16.499 "supported_io_types": { 00:04:16.499 "read": true, 00:04:16.499 "write": true, 00:04:16.499 "unmap": true, 00:04:16.499 "write_zeroes": true, 00:04:16.499 "flush": true, 00:04:16.499 "reset": true, 00:04:16.499 "compare": false, 00:04:16.499 "compare_and_write": false, 00:04:16.499 "abort": true, 00:04:16.499 "nvme_admin": false, 00:04:16.499 "nvme_io": false 00:04:16.499 }, 00:04:16.499 "memory_domains": [ 00:04:16.499 { 00:04:16.499 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.500 "dma_device_type": 2 00:04:16.500 } 00:04:16.500 ], 00:04:16.500 "driver_specific": { 00:04:16.500 "passthru": { 00:04:16.500 "name": "Passthru0", 00:04:16.500 "base_bdev_name": "Malloc0" 00:04:16.500 } 00:04:16.500 } 00:04:16.500 } 00:04:16.500 ]' 00:04:16.500 08:12:02 -- rpc/rpc.sh@21 -- # jq length 00:04:16.500 08:12:02 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:16.500 08:12:02 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:16.500 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.500 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.500 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.500 08:12:02 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:16.500 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.500 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.500 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.500 08:12:02 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:16.500 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.500 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.500 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.500 08:12:02 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:16.500 08:12:02 -- rpc/rpc.sh@26 -- # jq length 00:04:16.758 08:12:02 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:16.758 00:04:16.758 real 0m0.226s 00:04:16.758 user 0m0.150s 00:04:16.758 sys 0m0.017s 00:04:16.758 08:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 ************************************ 00:04:16.758 END TEST rpc_integrity 00:04:16.758 ************************************ 00:04:16.758 08:12:02 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:16.758 08:12:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.758 08:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 ************************************ 00:04:16.758 START TEST rpc_plugins 00:04:16.758 ************************************ 00:04:16.758 08:12:02 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:16.758 08:12:02 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:16.758 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.758 08:12:02 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:16.758 08:12:02 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:16.758 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.758 08:12:02 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:16.758 { 00:04:16.758 "name": "Malloc1", 00:04:16.758 "aliases": [ 00:04:16.758 "0609bc39-6843-4a08-a8ce-eb7d719bfb95" 00:04:16.758 ], 00:04:16.758 "product_name": "Malloc disk", 00:04:16.758 "block_size": 4096, 00:04:16.758 "num_blocks": 256, 00:04:16.758 "uuid": "0609bc39-6843-4a08-a8ce-eb7d719bfb95", 00:04:16.758 "assigned_rate_limits": { 00:04:16.758 "rw_ios_per_sec": 0, 00:04:16.758 "rw_mbytes_per_sec": 0, 00:04:16.758 "r_mbytes_per_sec": 0, 00:04:16.758 "w_mbytes_per_sec": 0 00:04:16.758 }, 00:04:16.758 "claimed": false, 00:04:16.758 "zoned": false, 00:04:16.758 "supported_io_types": { 00:04:16.758 "read": true, 00:04:16.758 "write": true, 00:04:16.758 "unmap": true, 00:04:16.758 "write_zeroes": true, 00:04:16.758 "flush": true, 00:04:16.758 "reset": true, 00:04:16.758 "compare": false, 00:04:16.758 "compare_and_write": false, 00:04:16.758 "abort": true, 00:04:16.758 "nvme_admin": false, 00:04:16.758 "nvme_io": false 00:04:16.758 }, 00:04:16.758 "memory_domains": [ 00:04:16.758 { 00:04:16.758 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.758 "dma_device_type": 2 00:04:16.758 } 00:04:16.758 ], 00:04:16.758 "driver_specific": {} 00:04:16.758 } 00:04:16.758 ]' 00:04:16.758 08:12:02 -- rpc/rpc.sh@32 -- # jq length 00:04:16.758 08:12:02 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:16.758 08:12:02 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:16.758 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.758 08:12:02 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:16.758 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.758 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.758 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.758 08:12:02 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:16.758 08:12:02 -- rpc/rpc.sh@36 -- # jq length 00:04:16.758 08:12:02 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:16.758 00:04:16.758 real 0m0.107s 00:04:16.758 user 0m0.067s 00:04:16.758 sys 0m0.011s 00:04:16.759 08:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.759 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.759 ************************************ 00:04:16.759 END TEST rpc_plugins 00:04:16.759 ************************************ 00:04:16.759 08:12:02 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:16.759 08:12:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.759 08:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.759 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.759 ************************************ 00:04:16.759 START TEST rpc_trace_cmd_test 00:04:16.759 ************************************ 00:04:16.759 08:12:02 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:16.759 08:12:02 -- rpc/rpc.sh@40 -- # local info 00:04:16.759 08:12:02 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:16.759 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.759 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:16.759 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.759 08:12:02 -- rpc/rpc.sh@42 -- # info='{ 00:04:16.759 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid834682", 00:04:16.759 "tpoint_group_mask": "0x8", 00:04:16.759 "iscsi_conn": { 00:04:16.759 "mask": "0x2", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "scsi": { 00:04:16.759 "mask": "0x4", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "bdev": { 00:04:16.759 "mask": "0x8", 00:04:16.759 "tpoint_mask": "0xffffffffffffffff" 00:04:16.759 }, 00:04:16.759 "nvmf_rdma": { 00:04:16.759 "mask": "0x10", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "nvmf_tcp": { 00:04:16.759 "mask": "0x20", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "ftl": { 00:04:16.759 "mask": "0x40", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "blobfs": { 00:04:16.759 "mask": "0x80", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "dsa": { 00:04:16.759 "mask": "0x200", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "thread": { 00:04:16.759 "mask": "0x400", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "nvme_pcie": { 00:04:16.759 "mask": "0x800", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "iaa": { 00:04:16.759 "mask": "0x1000", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "nvme_tcp": { 00:04:16.759 "mask": "0x2000", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 }, 00:04:16.759 "bdev_nvme": { 00:04:16.759 "mask": "0x4000", 00:04:16.759 "tpoint_mask": "0x0" 00:04:16.759 } 00:04:16.759 }' 00:04:16.759 08:12:02 -- rpc/rpc.sh@43 -- # jq length 00:04:16.759 08:12:02 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:16.759 08:12:02 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:16.759 08:12:02 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:16.759 08:12:02 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:17.017 08:12:02 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:17.017 08:12:02 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:17.017 08:12:02 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:17.017 08:12:02 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:17.017 08:12:02 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:17.017 00:04:17.017 real 0m0.197s 00:04:17.017 user 0m0.178s 00:04:17.017 sys 0m0.011s 00:04:17.017 08:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 ************************************ 00:04:17.017 END TEST rpc_trace_cmd_test 00:04:17.017 ************************************ 00:04:17.017 08:12:02 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:17.017 08:12:02 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:17.017 08:12:02 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:17.017 08:12:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.017 08:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 ************************************ 00:04:17.017 START TEST rpc_daemon_integrity 00:04:17.017 ************************************ 00:04:17.017 08:12:02 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:17.017 08:12:02 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:17.017 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.017 08:12:02 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:17.017 08:12:02 -- rpc/rpc.sh@13 -- # jq length 00:04:17.017 08:12:02 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:17.017 08:12:02 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:17.017 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.017 08:12:02 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:17.017 08:12:02 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:17.017 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.017 08:12:02 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:17.017 { 00:04:17.017 "name": "Malloc2", 00:04:17.017 "aliases": [ 00:04:17.017 "3dbd687a-1825-4e29-ba1e-740ff5fbcb1e" 00:04:17.017 ], 00:04:17.017 "product_name": "Malloc disk", 00:04:17.017 "block_size": 512, 00:04:17.017 "num_blocks": 16384, 00:04:17.017 "uuid": "3dbd687a-1825-4e29-ba1e-740ff5fbcb1e", 00:04:17.017 "assigned_rate_limits": { 00:04:17.017 "rw_ios_per_sec": 0, 00:04:17.017 "rw_mbytes_per_sec": 0, 00:04:17.017 "r_mbytes_per_sec": 0, 00:04:17.017 "w_mbytes_per_sec": 0 00:04:17.017 }, 00:04:17.017 "claimed": false, 00:04:17.017 "zoned": false, 00:04:17.017 "supported_io_types": { 00:04:17.017 "read": true, 00:04:17.017 "write": true, 00:04:17.017 "unmap": true, 00:04:17.017 "write_zeroes": true, 00:04:17.017 "flush": true, 00:04:17.017 "reset": true, 00:04:17.017 "compare": false, 00:04:17.017 "compare_and_write": false, 00:04:17.017 "abort": true, 00:04:17.017 "nvme_admin": false, 00:04:17.017 "nvme_io": false 00:04:17.017 }, 00:04:17.017 "memory_domains": [ 00:04:17.017 { 00:04:17.017 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.017 "dma_device_type": 2 00:04:17.017 } 00:04:17.017 ], 00:04:17.017 "driver_specific": {} 00:04:17.017 } 00:04:17.017 ]' 00:04:17.017 08:12:02 -- rpc/rpc.sh@17 -- # jq length 00:04:17.017 08:12:02 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:17.017 08:12:02 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:17.017 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.017 [2024-11-26 08:12:02.854997] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:17.017 [2024-11-26 08:12:02.855059] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:17.017 [2024-11-26 08:12:02.855085] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12c2590 00:04:17.017 [2024-11-26 08:12:02.855101] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:17.017 [2024-11-26 08:12:02.856434] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:17.017 [2024-11-26 08:12:02.856463] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:17.017 Passthru0 00:04:17.017 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.017 08:12:02 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:17.017 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.017 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.276 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.276 08:12:02 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:17.276 { 00:04:17.276 "name": "Malloc2", 00:04:17.276 "aliases": [ 00:04:17.276 "3dbd687a-1825-4e29-ba1e-740ff5fbcb1e" 00:04:17.276 ], 00:04:17.276 "product_name": "Malloc disk", 00:04:17.276 "block_size": 512, 00:04:17.276 "num_blocks": 16384, 00:04:17.276 "uuid": "3dbd687a-1825-4e29-ba1e-740ff5fbcb1e", 00:04:17.276 "assigned_rate_limits": { 00:04:17.276 "rw_ios_per_sec": 0, 00:04:17.276 "rw_mbytes_per_sec": 0, 00:04:17.276 "r_mbytes_per_sec": 0, 00:04:17.276 "w_mbytes_per_sec": 0 00:04:17.276 }, 00:04:17.276 "claimed": true, 00:04:17.276 "claim_type": "exclusive_write", 00:04:17.276 "zoned": false, 00:04:17.276 "supported_io_types": { 00:04:17.276 "read": true, 00:04:17.276 "write": true, 00:04:17.276 "unmap": true, 00:04:17.276 "write_zeroes": true, 00:04:17.276 "flush": true, 00:04:17.276 "reset": true, 00:04:17.276 "compare": false, 00:04:17.276 "compare_and_write": false, 00:04:17.276 "abort": true, 00:04:17.276 "nvme_admin": false, 00:04:17.276 "nvme_io": false 00:04:17.276 }, 00:04:17.276 "memory_domains": [ 00:04:17.276 { 00:04:17.276 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.276 "dma_device_type": 2 00:04:17.276 } 00:04:17.276 ], 00:04:17.276 "driver_specific": {} 00:04:17.276 }, 00:04:17.276 { 00:04:17.276 "name": "Passthru0", 00:04:17.276 "aliases": [ 00:04:17.276 "fc7dbc36-dabf-5886-9fba-98553575f9f2" 00:04:17.276 ], 00:04:17.276 "product_name": "passthru", 00:04:17.276 "block_size": 512, 00:04:17.276 "num_blocks": 16384, 00:04:17.276 "uuid": "fc7dbc36-dabf-5886-9fba-98553575f9f2", 00:04:17.276 "assigned_rate_limits": { 00:04:17.276 "rw_ios_per_sec": 0, 00:04:17.276 "rw_mbytes_per_sec": 0, 00:04:17.276 "r_mbytes_per_sec": 0, 00:04:17.276 "w_mbytes_per_sec": 0 00:04:17.276 }, 00:04:17.276 "claimed": false, 00:04:17.276 "zoned": false, 00:04:17.276 "supported_io_types": { 00:04:17.276 "read": true, 00:04:17.276 "write": true, 00:04:17.276 "unmap": true, 00:04:17.276 "write_zeroes": true, 00:04:17.276 "flush": true, 00:04:17.276 "reset": true, 00:04:17.276 "compare": false, 00:04:17.276 "compare_and_write": false, 00:04:17.276 "abort": true, 00:04:17.276 "nvme_admin": false, 00:04:17.276 "nvme_io": false 00:04:17.276 }, 00:04:17.276 "memory_domains": [ 00:04:17.276 { 00:04:17.276 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.276 "dma_device_type": 2 00:04:17.276 } 00:04:17.276 ], 00:04:17.276 "driver_specific": { 00:04:17.276 "passthru": { 00:04:17.276 "name": "Passthru0", 00:04:17.276 "base_bdev_name": "Malloc2" 00:04:17.276 } 00:04:17.276 } 00:04:17.276 } 00:04:17.276 ]' 00:04:17.276 08:12:02 -- rpc/rpc.sh@21 -- # jq length 00:04:17.276 08:12:02 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:17.276 08:12:02 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:17.276 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.276 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.276 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.276 08:12:02 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:17.276 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.276 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.276 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.276 08:12:02 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:17.276 08:12:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.276 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.276 08:12:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.276 08:12:02 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:17.276 08:12:02 -- rpc/rpc.sh@26 -- # jq length 00:04:17.276 08:12:02 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:17.276 00:04:17.276 real 0m0.224s 00:04:17.276 user 0m0.145s 00:04:17.276 sys 0m0.023s 00:04:17.276 08:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.276 08:12:02 -- common/autotest_common.sh@10 -- # set +x 00:04:17.276 ************************************ 00:04:17.276 END TEST rpc_daemon_integrity 00:04:17.276 ************************************ 00:04:17.276 08:12:02 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:17.276 08:12:02 -- rpc/rpc.sh@84 -- # killprocess 834682 00:04:17.276 08:12:02 -- common/autotest_common.sh@936 -- # '[' -z 834682 ']' 00:04:17.276 08:12:02 -- common/autotest_common.sh@940 -- # kill -0 834682 00:04:17.276 08:12:02 -- common/autotest_common.sh@941 -- # uname 00:04:17.276 08:12:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:17.276 08:12:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 834682 00:04:17.276 08:12:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:17.276 08:12:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:17.276 08:12:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 834682' 00:04:17.276 killing process with pid 834682 00:04:17.276 08:12:03 -- common/autotest_common.sh@955 -- # kill 834682 00:04:17.276 08:12:03 -- common/autotest_common.sh@960 -- # wait 834682 00:04:17.843 00:04:17.843 real 0m2.498s 00:04:17.843 user 0m3.168s 00:04:17.843 sys 0m0.567s 00:04:17.843 08:12:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.843 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:17.843 ************************************ 00:04:17.843 END TEST rpc 00:04:17.843 ************************************ 00:04:17.843 08:12:03 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:17.843 08:12:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.843 08:12:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.843 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:17.843 ************************************ 00:04:17.843 START TEST rpc_client 00:04:17.843 ************************************ 00:04:17.843 08:12:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:17.843 * Looking for test storage... 00:04:17.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:17.843 08:12:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:17.843 08:12:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:17.843 08:12:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:17.843 08:12:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:17.843 08:12:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:17.843 08:12:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:17.843 08:12:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:17.843 08:12:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:17.843 08:12:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:17.843 08:12:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:17.843 08:12:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:17.843 08:12:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:17.843 08:12:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:17.843 08:12:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:17.843 08:12:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:17.843 08:12:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:17.843 08:12:03 -- scripts/common.sh@344 -- # : 1 00:04:17.843 08:12:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:17.843 08:12:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:17.843 08:12:03 -- scripts/common.sh@364 -- # decimal 1 00:04:17.843 08:12:03 -- scripts/common.sh@352 -- # local d=1 00:04:17.843 08:12:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:17.843 08:12:03 -- scripts/common.sh@354 -- # echo 1 00:04:17.843 08:12:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:17.843 08:12:03 -- scripts/common.sh@365 -- # decimal 2 00:04:17.843 08:12:03 -- scripts/common.sh@352 -- # local d=2 00:04:17.843 08:12:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:17.843 08:12:03 -- scripts/common.sh@354 -- # echo 2 00:04:17.843 08:12:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:17.843 08:12:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:17.843 08:12:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:17.843 08:12:03 -- scripts/common.sh@367 -- # return 0 00:04:17.843 08:12:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:17.843 08:12:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:17.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.843 --rc genhtml_branch_coverage=1 00:04:17.843 --rc genhtml_function_coverage=1 00:04:17.843 --rc genhtml_legend=1 00:04:17.843 --rc geninfo_all_blocks=1 00:04:17.843 --rc geninfo_unexecuted_blocks=1 00:04:17.843 00:04:17.844 ' 00:04:17.844 08:12:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.844 --rc genhtml_branch_coverage=1 00:04:17.844 --rc genhtml_function_coverage=1 00:04:17.844 --rc genhtml_legend=1 00:04:17.844 --rc geninfo_all_blocks=1 00:04:17.844 --rc geninfo_unexecuted_blocks=1 00:04:17.844 00:04:17.844 ' 00:04:17.844 08:12:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.844 --rc genhtml_branch_coverage=1 00:04:17.844 --rc genhtml_function_coverage=1 00:04:17.844 --rc genhtml_legend=1 00:04:17.844 --rc geninfo_all_blocks=1 00:04:17.844 --rc geninfo_unexecuted_blocks=1 00:04:17.844 00:04:17.844 ' 00:04:17.844 08:12:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.844 --rc genhtml_branch_coverage=1 00:04:17.844 --rc genhtml_function_coverage=1 00:04:17.844 --rc genhtml_legend=1 00:04:17.844 --rc geninfo_all_blocks=1 00:04:17.844 --rc geninfo_unexecuted_blocks=1 00:04:17.844 00:04:17.844 ' 00:04:17.844 08:12:03 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:17.844 OK 00:04:17.844 08:12:03 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:17.844 00:04:17.844 real 0m0.146s 00:04:17.844 user 0m0.098s 00:04:17.844 sys 0m0.056s 00:04:17.844 08:12:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.844 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:17.844 ************************************ 00:04:17.844 END TEST rpc_client 00:04:17.844 ************************************ 00:04:17.844 08:12:03 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:17.844 08:12:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.844 08:12:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.844 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:17.844 ************************************ 00:04:17.844 START TEST json_config 00:04:17.844 ************************************ 00:04:17.844 08:12:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:18.103 08:12:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:18.103 08:12:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:18.103 08:12:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:18.103 08:12:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:18.103 08:12:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:18.103 08:12:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:18.103 08:12:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:18.103 08:12:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:18.103 08:12:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:18.103 08:12:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:18.103 08:12:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:18.103 08:12:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:18.103 08:12:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:18.103 08:12:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:18.103 08:12:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:18.103 08:12:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:18.103 08:12:03 -- scripts/common.sh@344 -- # : 1 00:04:18.103 08:12:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:18.103 08:12:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:18.103 08:12:03 -- scripts/common.sh@364 -- # decimal 1 00:04:18.103 08:12:03 -- scripts/common.sh@352 -- # local d=1 00:04:18.103 08:12:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:18.103 08:12:03 -- scripts/common.sh@354 -- # echo 1 00:04:18.103 08:12:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:18.103 08:12:03 -- scripts/common.sh@365 -- # decimal 2 00:04:18.103 08:12:03 -- scripts/common.sh@352 -- # local d=2 00:04:18.103 08:12:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:18.103 08:12:03 -- scripts/common.sh@354 -- # echo 2 00:04:18.103 08:12:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:18.103 08:12:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:18.103 08:12:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:18.103 08:12:03 -- scripts/common.sh@367 -- # return 0 00:04:18.103 08:12:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:18.103 08:12:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:18.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.104 --rc genhtml_branch_coverage=1 00:04:18.104 --rc genhtml_function_coverage=1 00:04:18.104 --rc genhtml_legend=1 00:04:18.104 --rc geninfo_all_blocks=1 00:04:18.104 --rc geninfo_unexecuted_blocks=1 00:04:18.104 00:04:18.104 ' 00:04:18.104 08:12:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:18.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.104 --rc genhtml_branch_coverage=1 00:04:18.104 --rc genhtml_function_coverage=1 00:04:18.104 --rc genhtml_legend=1 00:04:18.104 --rc geninfo_all_blocks=1 00:04:18.104 --rc geninfo_unexecuted_blocks=1 00:04:18.104 00:04:18.104 ' 00:04:18.104 08:12:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:18.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.104 --rc genhtml_branch_coverage=1 00:04:18.104 --rc genhtml_function_coverage=1 00:04:18.104 --rc genhtml_legend=1 00:04:18.104 --rc geninfo_all_blocks=1 00:04:18.104 --rc geninfo_unexecuted_blocks=1 00:04:18.104 00:04:18.104 ' 00:04:18.104 08:12:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:18.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.104 --rc genhtml_branch_coverage=1 00:04:18.104 --rc genhtml_function_coverage=1 00:04:18.104 --rc genhtml_legend=1 00:04:18.104 --rc geninfo_all_blocks=1 00:04:18.104 --rc geninfo_unexecuted_blocks=1 00:04:18.104 00:04:18.104 ' 00:04:18.104 08:12:03 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:18.104 08:12:03 -- nvmf/common.sh@7 -- # uname -s 00:04:18.104 08:12:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:18.104 08:12:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:18.104 08:12:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:18.104 08:12:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:18.104 08:12:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:18.104 08:12:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:18.104 08:12:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:18.104 08:12:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:18.104 08:12:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:18.104 08:12:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:18.104 08:12:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:18.104 08:12:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:18.104 08:12:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:18.104 08:12:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:18.104 08:12:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:18.104 08:12:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:18.104 08:12:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:18.104 08:12:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:18.104 08:12:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:18.104 08:12:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.104 08:12:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.104 08:12:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.104 08:12:03 -- paths/export.sh@5 -- # export PATH 00:04:18.104 08:12:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.104 08:12:03 -- nvmf/common.sh@46 -- # : 0 00:04:18.104 08:12:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:18.104 08:12:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:18.104 08:12:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:18.104 08:12:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:18.104 08:12:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:18.104 08:12:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:18.104 08:12:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:18.104 08:12:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:18.104 08:12:03 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:18.104 08:12:03 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:18.104 08:12:03 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:18.104 08:12:03 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:18.104 08:12:03 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:18.104 08:12:03 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:18.104 08:12:03 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:18.104 08:12:03 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:18.104 08:12:03 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:18.104 08:12:03 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:18.104 08:12:03 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:18.104 08:12:03 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:18.104 INFO: JSON configuration test init 00:04:18.104 08:12:03 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:18.104 08:12:03 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:18.104 08:12:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:18.104 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:18.104 08:12:03 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:18.104 08:12:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:18.104 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:18.104 08:12:03 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:18.104 08:12:03 -- json_config/json_config.sh@98 -- # local app=target 00:04:18.104 08:12:03 -- json_config/json_config.sh@99 -- # shift 00:04:18.104 08:12:03 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:18.104 08:12:03 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.104 08:12:03 -- json_config/json_config.sh@111 -- # app_pid[$app]=835229 00:04:18.104 08:12:03 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:18.104 08:12:03 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:18.104 Waiting for target to run... 00:04:18.104 08:12:03 -- json_config/json_config.sh@114 -- # waitforlisten 835229 /var/tmp/spdk_tgt.sock 00:04:18.104 08:12:03 -- common/autotest_common.sh@829 -- # '[' -z 835229 ']' 00:04:18.104 08:12:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:18.104 08:12:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:18.105 08:12:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:18.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:18.105 08:12:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:18.105 08:12:03 -- common/autotest_common.sh@10 -- # set +x 00:04:18.105 [2024-11-26 08:12:03.893755] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:18.105 [2024-11-26 08:12:03.893835] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid835229 ] 00:04:18.105 EAL: No free 2048 kB hugepages reported on node 1 00:04:18.674 [2024-11-26 08:12:04.402405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:18.674 [2024-11-26 08:12:04.507371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:18.674 [2024-11-26 08:12:04.507588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.325 08:12:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.325 08:12:04 -- common/autotest_common.sh@862 -- # return 0 00:04:19.325 08:12:04 -- json_config/json_config.sh@115 -- # echo '' 00:04:19.325 00:04:19.325 08:12:04 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:19.325 08:12:04 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:19.325 08:12:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:19.325 08:12:04 -- common/autotest_common.sh@10 -- # set +x 00:04:19.325 08:12:04 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:19.325 08:12:04 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:19.325 08:12:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.325 08:12:04 -- common/autotest_common.sh@10 -- # set +x 00:04:19.325 08:12:04 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:19.325 08:12:04 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:19.325 08:12:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:22.608 08:12:08 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:22.608 08:12:08 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:22.608 08:12:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:22.608 08:12:08 -- common/autotest_common.sh@10 -- # set +x 00:04:22.608 08:12:08 -- json_config/json_config.sh@48 -- # local ret=0 00:04:22.608 08:12:08 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:22.608 08:12:08 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:22.608 08:12:08 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:22.608 08:12:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:22.608 08:12:08 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:22.608 08:12:08 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:22.608 08:12:08 -- json_config/json_config.sh@51 -- # local get_types 00:04:22.608 08:12:08 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:22.608 08:12:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:22.608 08:12:08 -- common/autotest_common.sh@10 -- # set +x 00:04:22.608 08:12:08 -- json_config/json_config.sh@58 -- # return 0 00:04:22.608 08:12:08 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:22.608 08:12:08 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:22.608 08:12:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:22.608 08:12:08 -- common/autotest_common.sh@10 -- # set +x 00:04:22.608 08:12:08 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:22.608 08:12:08 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:22.608 08:12:08 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:22.608 08:12:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:22.867 MallocForNvmf0 00:04:22.867 08:12:08 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:22.867 08:12:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:23.125 MallocForNvmf1 00:04:23.125 08:12:08 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:23.125 08:12:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:23.383 [2024-11-26 08:12:09.129462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:23.383 08:12:09 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:23.383 08:12:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:23.639 08:12:09 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:23.640 08:12:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:23.897 08:12:09 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:23.897 08:12:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:24.155 08:12:09 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:24.155 08:12:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:24.414 [2024-11-26 08:12:10.144892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:24.414 08:12:10 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:24.414 08:12:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.414 08:12:10 -- common/autotest_common.sh@10 -- # set +x 00:04:24.414 08:12:10 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:24.414 08:12:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.414 08:12:10 -- common/autotest_common.sh@10 -- # set +x 00:04:24.414 08:12:10 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:24.414 08:12:10 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:24.414 08:12:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:24.672 MallocBdevForConfigChangeCheck 00:04:24.672 08:12:10 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:24.672 08:12:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.672 08:12:10 -- common/autotest_common.sh@10 -- # set +x 00:04:24.672 08:12:10 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:24.672 08:12:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:25.238 08:12:10 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:25.238 INFO: shutting down applications... 00:04:25.238 08:12:10 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:25.238 08:12:10 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:25.238 08:12:10 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:25.238 08:12:10 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:26.611 Calling clear_iscsi_subsystem 00:04:26.611 Calling clear_nvmf_subsystem 00:04:26.611 Calling clear_nbd_subsystem 00:04:26.611 Calling clear_ublk_subsystem 00:04:26.611 Calling clear_vhost_blk_subsystem 00:04:26.611 Calling clear_vhost_scsi_subsystem 00:04:26.611 Calling clear_scheduler_subsystem 00:04:26.611 Calling clear_bdev_subsystem 00:04:26.612 Calling clear_accel_subsystem 00:04:26.612 Calling clear_vmd_subsystem 00:04:26.612 Calling clear_sock_subsystem 00:04:26.612 Calling clear_iobuf_subsystem 00:04:26.612 08:12:12 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:26.612 08:12:12 -- json_config/json_config.sh@396 -- # count=100 00:04:26.612 08:12:12 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:26.612 08:12:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.612 08:12:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:26.612 08:12:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:27.178 08:12:12 -- json_config/json_config.sh@398 -- # break 00:04:27.178 08:12:12 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:27.178 08:12:12 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:27.178 08:12:12 -- json_config/json_config.sh@120 -- # local app=target 00:04:27.178 08:12:12 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:27.178 08:12:12 -- json_config/json_config.sh@124 -- # [[ -n 835229 ]] 00:04:27.178 08:12:12 -- json_config/json_config.sh@127 -- # kill -SIGINT 835229 00:04:27.178 08:12:12 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:27.178 08:12:12 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:27.178 08:12:12 -- json_config/json_config.sh@130 -- # kill -0 835229 00:04:27.178 08:12:12 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:27.745 08:12:13 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:27.745 08:12:13 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:27.745 08:12:13 -- json_config/json_config.sh@130 -- # kill -0 835229 00:04:27.745 08:12:13 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:27.745 08:12:13 -- json_config/json_config.sh@132 -- # break 00:04:27.745 08:12:13 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:27.745 08:12:13 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:27.745 SPDK target shutdown done 00:04:27.745 08:12:13 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:27.745 INFO: relaunching applications... 00:04:27.745 08:12:13 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.745 08:12:13 -- json_config/json_config.sh@98 -- # local app=target 00:04:27.745 08:12:13 -- json_config/json_config.sh@99 -- # shift 00:04:27.745 08:12:13 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:27.745 08:12:13 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:27.745 08:12:13 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:27.745 08:12:13 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:27.745 08:12:13 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:27.745 08:12:13 -- json_config/json_config.sh@111 -- # app_pid[$app]=837079 00:04:27.745 08:12:13 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.745 08:12:13 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:27.745 Waiting for target to run... 00:04:27.745 08:12:13 -- json_config/json_config.sh@114 -- # waitforlisten 837079 /var/tmp/spdk_tgt.sock 00:04:27.745 08:12:13 -- common/autotest_common.sh@829 -- # '[' -z 837079 ']' 00:04:27.745 08:12:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:27.745 08:12:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:27.745 08:12:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:27.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:27.745 08:12:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:27.745 08:12:13 -- common/autotest_common.sh@10 -- # set +x 00:04:27.745 [2024-11-26 08:12:13.387049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:27.745 [2024-11-26 08:12:13.387157] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid837079 ] 00:04:27.745 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.003 [2024-11-26 08:12:13.740329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.003 [2024-11-26 08:12:13.826440] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.003 [2024-11-26 08:12:13.826635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.285 [2024-11-26 08:12:16.854559] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:31.285 [2024-11-26 08:12:16.887091] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:31.543 08:12:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.543 08:12:17 -- common/autotest_common.sh@862 -- # return 0 00:04:31.543 08:12:17 -- json_config/json_config.sh@115 -- # echo '' 00:04:31.543 00:04:31.543 08:12:17 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:31.543 08:12:17 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:31.543 INFO: Checking if target configuration is the same... 00:04:31.543 08:12:17 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.543 08:12:17 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:31.543 08:12:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:31.543 + '[' 2 -ne 2 ']' 00:04:31.543 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:31.543 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:31.543 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:31.543 +++ basename /dev/fd/62 00:04:31.543 ++ mktemp /tmp/62.XXX 00:04:31.543 + tmp_file_1=/tmp/62.a7w 00:04:31.543 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.543 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:31.543 + tmp_file_2=/tmp/spdk_tgt_config.json.5Uf 00:04:31.543 + ret=0 00:04:31.543 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.109 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.109 + diff -u /tmp/62.a7w /tmp/spdk_tgt_config.json.5Uf 00:04:32.109 + echo 'INFO: JSON config files are the same' 00:04:32.109 INFO: JSON config files are the same 00:04:32.109 + rm /tmp/62.a7w /tmp/spdk_tgt_config.json.5Uf 00:04:32.109 + exit 0 00:04:32.109 08:12:17 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:32.109 08:12:17 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:32.109 INFO: changing configuration and checking if this can be detected... 00:04:32.109 08:12:17 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:32.109 08:12:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:32.367 08:12:18 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.367 08:12:18 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:32.367 08:12:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:32.367 + '[' 2 -ne 2 ']' 00:04:32.367 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:32.367 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:32.367 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:32.367 +++ basename /dev/fd/62 00:04:32.367 ++ mktemp /tmp/62.XXX 00:04:32.367 + tmp_file_1=/tmp/62.m4r 00:04:32.367 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.367 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:32.367 + tmp_file_2=/tmp/spdk_tgt_config.json.M0y 00:04:32.367 + ret=0 00:04:32.367 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.625 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.625 + diff -u /tmp/62.m4r /tmp/spdk_tgt_config.json.M0y 00:04:32.625 + ret=1 00:04:32.625 + echo '=== Start of file: /tmp/62.m4r ===' 00:04:32.625 + cat /tmp/62.m4r 00:04:32.625 + echo '=== End of file: /tmp/62.m4r ===' 00:04:32.625 + echo '' 00:04:32.625 + echo '=== Start of file: /tmp/spdk_tgt_config.json.M0y ===' 00:04:32.625 + cat /tmp/spdk_tgt_config.json.M0y 00:04:32.625 + echo '=== End of file: /tmp/spdk_tgt_config.json.M0y ===' 00:04:32.625 + echo '' 00:04:32.625 + rm /tmp/62.m4r /tmp/spdk_tgt_config.json.M0y 00:04:32.625 + exit 1 00:04:32.625 08:12:18 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:32.625 INFO: configuration change detected. 00:04:32.625 08:12:18 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:32.625 08:12:18 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:32.625 08:12:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.625 08:12:18 -- common/autotest_common.sh@10 -- # set +x 00:04:32.625 08:12:18 -- json_config/json_config.sh@360 -- # local ret=0 00:04:32.625 08:12:18 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:32.625 08:12:18 -- json_config/json_config.sh@370 -- # [[ -n 837079 ]] 00:04:32.625 08:12:18 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:32.625 08:12:18 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:32.625 08:12:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.625 08:12:18 -- common/autotest_common.sh@10 -- # set +x 00:04:32.625 08:12:18 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:32.625 08:12:18 -- json_config/json_config.sh@246 -- # uname -s 00:04:32.625 08:12:18 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:32.625 08:12:18 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:32.625 08:12:18 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:32.625 08:12:18 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:32.625 08:12:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:32.625 08:12:18 -- common/autotest_common.sh@10 -- # set +x 00:04:32.625 08:12:18 -- json_config/json_config.sh@376 -- # killprocess 837079 00:04:32.625 08:12:18 -- common/autotest_common.sh@936 -- # '[' -z 837079 ']' 00:04:32.625 08:12:18 -- common/autotest_common.sh@940 -- # kill -0 837079 00:04:32.625 08:12:18 -- common/autotest_common.sh@941 -- # uname 00:04:32.883 08:12:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:32.883 08:12:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 837079 00:04:32.883 08:12:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:32.883 08:12:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:32.883 08:12:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 837079' 00:04:32.883 killing process with pid 837079 00:04:32.883 08:12:18 -- common/autotest_common.sh@955 -- # kill 837079 00:04:32.883 08:12:18 -- common/autotest_common.sh@960 -- # wait 837079 00:04:34.780 08:12:20 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.780 08:12:20 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:34.780 08:12:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:34.780 08:12:20 -- common/autotest_common.sh@10 -- # set +x 00:04:34.780 08:12:20 -- json_config/json_config.sh@381 -- # return 0 00:04:34.780 08:12:20 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:34.780 INFO: Success 00:04:34.780 00:04:34.780 real 0m16.466s 00:04:34.780 user 0m19.106s 00:04:34.780 sys 0m2.087s 00:04:34.780 08:12:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.780 08:12:20 -- common/autotest_common.sh@10 -- # set +x 00:04:34.780 ************************************ 00:04:34.780 END TEST json_config 00:04:34.780 ************************************ 00:04:34.780 08:12:20 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:34.780 08:12:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.780 08:12:20 -- common/autotest_common.sh@10 -- # set +x 00:04:34.780 ************************************ 00:04:34.780 START TEST json_config_extra_key 00:04:34.780 ************************************ 00:04:34.780 08:12:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:34.780 08:12:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.780 08:12:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.780 08:12:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.780 08:12:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.780 08:12:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.780 08:12:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.780 08:12:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.780 08:12:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.780 08:12:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.780 08:12:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.780 08:12:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.780 08:12:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.780 08:12:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.780 08:12:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.780 08:12:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.780 08:12:20 -- scripts/common.sh@344 -- # : 1 00:04:34.780 08:12:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.780 08:12:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.780 08:12:20 -- scripts/common.sh@364 -- # decimal 1 00:04:34.780 08:12:20 -- scripts/common.sh@352 -- # local d=1 00:04:34.780 08:12:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.780 08:12:20 -- scripts/common.sh@354 -- # echo 1 00:04:34.780 08:12:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.780 08:12:20 -- scripts/common.sh@365 -- # decimal 2 00:04:34.780 08:12:20 -- scripts/common.sh@352 -- # local d=2 00:04:34.780 08:12:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.780 08:12:20 -- scripts/common.sh@354 -- # echo 2 00:04:34.780 08:12:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.780 08:12:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.780 08:12:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.780 08:12:20 -- scripts/common.sh@367 -- # return 0 00:04:34.780 08:12:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.780 --rc genhtml_branch_coverage=1 00:04:34.780 --rc genhtml_function_coverage=1 00:04:34.780 --rc genhtml_legend=1 00:04:34.780 --rc geninfo_all_blocks=1 00:04:34.780 --rc geninfo_unexecuted_blocks=1 00:04:34.780 00:04:34.780 ' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.780 --rc genhtml_branch_coverage=1 00:04:34.780 --rc genhtml_function_coverage=1 00:04:34.780 --rc genhtml_legend=1 00:04:34.780 --rc geninfo_all_blocks=1 00:04:34.780 --rc geninfo_unexecuted_blocks=1 00:04:34.780 00:04:34.780 ' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.780 --rc genhtml_branch_coverage=1 00:04:34.780 --rc genhtml_function_coverage=1 00:04:34.780 --rc genhtml_legend=1 00:04:34.780 --rc geninfo_all_blocks=1 00:04:34.780 --rc geninfo_unexecuted_blocks=1 00:04:34.780 00:04:34.780 ' 00:04:34.780 08:12:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.780 --rc genhtml_branch_coverage=1 00:04:34.780 --rc genhtml_function_coverage=1 00:04:34.780 --rc genhtml_legend=1 00:04:34.780 --rc geninfo_all_blocks=1 00:04:34.780 --rc geninfo_unexecuted_blocks=1 00:04:34.780 00:04:34.780 ' 00:04:34.780 08:12:20 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:34.780 08:12:20 -- nvmf/common.sh@7 -- # uname -s 00:04:34.780 08:12:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:34.780 08:12:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:34.780 08:12:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:34.780 08:12:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:34.780 08:12:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:34.780 08:12:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:34.780 08:12:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:34.780 08:12:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:34.780 08:12:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:34.780 08:12:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:34.780 08:12:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:34.780 08:12:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:34.780 08:12:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:34.780 08:12:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:34.780 08:12:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:34.780 08:12:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:34.780 08:12:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:34.780 08:12:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:34.780 08:12:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:34.780 08:12:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.780 08:12:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.780 08:12:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.780 08:12:20 -- paths/export.sh@5 -- # export PATH 00:04:34.780 08:12:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.781 08:12:20 -- nvmf/common.sh@46 -- # : 0 00:04:34.781 08:12:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:34.781 08:12:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:34.781 08:12:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:34.781 08:12:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:34.781 08:12:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:34.781 08:12:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:34.781 08:12:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:34.781 08:12:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:34.781 INFO: launching applications... 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=838032 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:34.781 Waiting for target to run... 00:04:34.781 08:12:20 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 838032 /var/tmp/spdk_tgt.sock 00:04:34.781 08:12:20 -- common/autotest_common.sh@829 -- # '[' -z 838032 ']' 00:04:34.781 08:12:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:34.781 08:12:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.781 08:12:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:34.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:34.781 08:12:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.781 08:12:20 -- common/autotest_common.sh@10 -- # set +x 00:04:34.781 [2024-11-26 08:12:20.375173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.781 [2024-11-26 08:12:20.375250] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838032 ] 00:04:34.781 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.038 [2024-11-26 08:12:20.867057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.296 [2024-11-26 08:12:20.967783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.296 [2024-11-26 08:12:20.967942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.553 08:12:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.553 08:12:21 -- common/autotest_common.sh@862 -- # return 0 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:35.553 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:35.553 INFO: shutting down applications... 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 838032 ]] 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 838032 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@50 -- # kill -0 838032 00:04:35.553 08:12:21 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:36.119 08:12:21 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:36.119 08:12:21 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:36.119 08:12:21 -- json_config/json_config_extra_key.sh@50 -- # kill -0 838032 00:04:36.119 08:12:21 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@50 -- # kill -0 838032 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:36.685 SPDK target shutdown done 00:04:36.685 08:12:22 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:36.685 Success 00:04:36.685 00:04:36.685 real 0m2.190s 00:04:36.685 user 0m1.619s 00:04:36.685 sys 0m0.585s 00:04:36.685 08:12:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.685 08:12:22 -- common/autotest_common.sh@10 -- # set +x 00:04:36.685 ************************************ 00:04:36.685 END TEST json_config_extra_key 00:04:36.685 ************************************ 00:04:36.685 08:12:22 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:36.685 08:12:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:36.685 08:12:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.685 08:12:22 -- common/autotest_common.sh@10 -- # set +x 00:04:36.685 ************************************ 00:04:36.685 START TEST alias_rpc 00:04:36.685 ************************************ 00:04:36.685 08:12:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:36.685 * Looking for test storage... 00:04:36.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:36.685 08:12:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:36.685 08:12:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:36.685 08:12:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:36.685 08:12:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:36.685 08:12:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:36.685 08:12:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:36.685 08:12:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:36.685 08:12:22 -- scripts/common.sh@335 -- # IFS=.-: 00:04:36.685 08:12:22 -- scripts/common.sh@335 -- # read -ra ver1 00:04:36.685 08:12:22 -- scripts/common.sh@336 -- # IFS=.-: 00:04:36.685 08:12:22 -- scripts/common.sh@336 -- # read -ra ver2 00:04:36.685 08:12:22 -- scripts/common.sh@337 -- # local 'op=<' 00:04:36.685 08:12:22 -- scripts/common.sh@339 -- # ver1_l=2 00:04:36.685 08:12:22 -- scripts/common.sh@340 -- # ver2_l=1 00:04:36.685 08:12:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:36.685 08:12:22 -- scripts/common.sh@343 -- # case "$op" in 00:04:36.685 08:12:22 -- scripts/common.sh@344 -- # : 1 00:04:36.685 08:12:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:36.685 08:12:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:36.685 08:12:22 -- scripts/common.sh@364 -- # decimal 1 00:04:36.685 08:12:22 -- scripts/common.sh@352 -- # local d=1 00:04:36.685 08:12:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:36.685 08:12:22 -- scripts/common.sh@354 -- # echo 1 00:04:36.685 08:12:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:36.685 08:12:22 -- scripts/common.sh@365 -- # decimal 2 00:04:36.685 08:12:22 -- scripts/common.sh@352 -- # local d=2 00:04:36.944 08:12:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:36.944 08:12:22 -- scripts/common.sh@354 -- # echo 2 00:04:36.944 08:12:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:36.944 08:12:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:36.944 08:12:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:36.944 08:12:22 -- scripts/common.sh@367 -- # return 0 00:04:36.944 08:12:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:36.944 08:12:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:36.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.944 --rc genhtml_branch_coverage=1 00:04:36.944 --rc genhtml_function_coverage=1 00:04:36.944 --rc genhtml_legend=1 00:04:36.944 --rc geninfo_all_blocks=1 00:04:36.944 --rc geninfo_unexecuted_blocks=1 00:04:36.944 00:04:36.944 ' 00:04:36.944 08:12:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:36.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.944 --rc genhtml_branch_coverage=1 00:04:36.944 --rc genhtml_function_coverage=1 00:04:36.944 --rc genhtml_legend=1 00:04:36.944 --rc geninfo_all_blocks=1 00:04:36.944 --rc geninfo_unexecuted_blocks=1 00:04:36.944 00:04:36.944 ' 00:04:36.944 08:12:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:36.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.944 --rc genhtml_branch_coverage=1 00:04:36.944 --rc genhtml_function_coverage=1 00:04:36.944 --rc genhtml_legend=1 00:04:36.944 --rc geninfo_all_blocks=1 00:04:36.944 --rc geninfo_unexecuted_blocks=1 00:04:36.944 00:04:36.944 ' 00:04:36.944 08:12:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:36.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.944 --rc genhtml_branch_coverage=1 00:04:36.944 --rc genhtml_function_coverage=1 00:04:36.944 --rc genhtml_legend=1 00:04:36.944 --rc geninfo_all_blocks=1 00:04:36.944 --rc geninfo_unexecuted_blocks=1 00:04:36.944 00:04:36.944 ' 00:04:36.944 08:12:22 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:36.944 08:12:22 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=838360 00:04:36.944 08:12:22 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:36.944 08:12:22 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 838360 00:04:36.944 08:12:22 -- common/autotest_common.sh@829 -- # '[' -z 838360 ']' 00:04:36.944 08:12:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:36.944 08:12:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:36.944 08:12:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:36.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:36.944 08:12:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:36.944 08:12:22 -- common/autotest_common.sh@10 -- # set +x 00:04:36.944 [2024-11-26 08:12:22.589744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.944 [2024-11-26 08:12:22.589823] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838360 ] 00:04:36.944 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.944 [2024-11-26 08:12:22.645827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.944 [2024-11-26 08:12:22.755895] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.944 [2024-11-26 08:12:22.756089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.879 08:12:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:37.879 08:12:23 -- common/autotest_common.sh@862 -- # return 0 00:04:37.879 08:12:23 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:38.137 08:12:23 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 838360 00:04:38.137 08:12:23 -- common/autotest_common.sh@936 -- # '[' -z 838360 ']' 00:04:38.137 08:12:23 -- common/autotest_common.sh@940 -- # kill -0 838360 00:04:38.137 08:12:23 -- common/autotest_common.sh@941 -- # uname 00:04:38.137 08:12:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.137 08:12:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 838360 00:04:38.137 08:12:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.137 08:12:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.137 08:12:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 838360' 00:04:38.137 killing process with pid 838360 00:04:38.137 08:12:23 -- common/autotest_common.sh@955 -- # kill 838360 00:04:38.137 08:12:23 -- common/autotest_common.sh@960 -- # wait 838360 00:04:38.704 00:04:38.704 real 0m1.895s 00:04:38.704 user 0m2.148s 00:04:38.704 sys 0m0.494s 00:04:38.704 08:12:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.704 08:12:24 -- common/autotest_common.sh@10 -- # set +x 00:04:38.704 ************************************ 00:04:38.704 END TEST alias_rpc 00:04:38.704 ************************************ 00:04:38.704 08:12:24 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:38.704 08:12:24 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:38.704 08:12:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.704 08:12:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.704 08:12:24 -- common/autotest_common.sh@10 -- # set +x 00:04:38.704 ************************************ 00:04:38.704 START TEST spdkcli_tcp 00:04:38.704 ************************************ 00:04:38.704 08:12:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:38.704 * Looking for test storage... 00:04:38.704 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:38.704 08:12:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.704 08:12:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.704 08:12:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.704 08:12:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.704 08:12:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.704 08:12:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.704 08:12:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.704 08:12:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.704 08:12:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.704 08:12:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.704 08:12:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.704 08:12:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.704 08:12:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.704 08:12:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.704 08:12:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.704 08:12:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.704 08:12:24 -- scripts/common.sh@344 -- # : 1 00:04:38.704 08:12:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.704 08:12:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.704 08:12:24 -- scripts/common.sh@364 -- # decimal 1 00:04:38.704 08:12:24 -- scripts/common.sh@352 -- # local d=1 00:04:38.704 08:12:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.704 08:12:24 -- scripts/common.sh@354 -- # echo 1 00:04:38.704 08:12:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.704 08:12:24 -- scripts/common.sh@365 -- # decimal 2 00:04:38.704 08:12:24 -- scripts/common.sh@352 -- # local d=2 00:04:38.704 08:12:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.704 08:12:24 -- scripts/common.sh@354 -- # echo 2 00:04:38.704 08:12:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.704 08:12:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.704 08:12:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.704 08:12:24 -- scripts/common.sh@367 -- # return 0 00:04:38.704 08:12:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.704 08:12:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 08:12:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 08:12:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.705 --rc geninfo_all_blocks=1 00:04:38.705 --rc geninfo_unexecuted_blocks=1 00:04:38.705 00:04:38.705 ' 00:04:38.705 08:12:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.705 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.705 --rc genhtml_branch_coverage=1 00:04:38.705 --rc genhtml_function_coverage=1 00:04:38.705 --rc genhtml_legend=1 00:04:38.705 --rc geninfo_all_blocks=1 00:04:38.705 --rc geninfo_unexecuted_blocks=1 00:04:38.705 00:04:38.705 ' 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:38.705 08:12:24 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:38.705 08:12:24 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:38.705 08:12:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:38.705 08:12:24 -- common/autotest_common.sh@10 -- # set +x 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=838685 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:38.705 08:12:24 -- spdkcli/tcp.sh@27 -- # waitforlisten 838685 00:04:38.705 08:12:24 -- common/autotest_common.sh@829 -- # '[' -z 838685 ']' 00:04:38.705 08:12:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:38.705 08:12:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.705 08:12:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:38.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:38.705 08:12:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.705 08:12:24 -- common/autotest_common.sh@10 -- # set +x 00:04:38.705 [2024-11-26 08:12:24.510523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.705 [2024-11-26 08:12:24.510622] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838685 ] 00:04:38.705 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.963 [2024-11-26 08:12:24.570588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:38.963 [2024-11-26 08:12:24.682156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.963 [2024-11-26 08:12:24.682389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:38.963 [2024-11-26 08:12:24.682396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.897 08:12:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.897 08:12:25 -- common/autotest_common.sh@862 -- # return 0 00:04:39.897 08:12:25 -- spdkcli/tcp.sh@31 -- # socat_pid=838770 00:04:39.897 08:12:25 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:39.897 08:12:25 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:39.897 [ 00:04:39.897 "bdev_malloc_delete", 00:04:39.897 "bdev_malloc_create", 00:04:39.897 "bdev_null_resize", 00:04:39.897 "bdev_null_delete", 00:04:39.897 "bdev_null_create", 00:04:39.897 "bdev_nvme_cuse_unregister", 00:04:39.897 "bdev_nvme_cuse_register", 00:04:39.897 "bdev_opal_new_user", 00:04:39.897 "bdev_opal_set_lock_state", 00:04:39.897 "bdev_opal_delete", 00:04:39.897 "bdev_opal_get_info", 00:04:39.897 "bdev_opal_create", 00:04:39.897 "bdev_nvme_opal_revert", 00:04:39.897 "bdev_nvme_opal_init", 00:04:39.897 "bdev_nvme_send_cmd", 00:04:39.897 "bdev_nvme_get_path_iostat", 00:04:39.897 "bdev_nvme_get_mdns_discovery_info", 00:04:39.897 "bdev_nvme_stop_mdns_discovery", 00:04:39.897 "bdev_nvme_start_mdns_discovery", 00:04:39.897 "bdev_nvme_set_multipath_policy", 00:04:39.897 "bdev_nvme_set_preferred_path", 00:04:39.897 "bdev_nvme_get_io_paths", 00:04:39.897 "bdev_nvme_remove_error_injection", 00:04:39.897 "bdev_nvme_add_error_injection", 00:04:39.897 "bdev_nvme_get_discovery_info", 00:04:39.897 "bdev_nvme_stop_discovery", 00:04:39.897 "bdev_nvme_start_discovery", 00:04:39.897 "bdev_nvme_get_controller_health_info", 00:04:39.897 "bdev_nvme_disable_controller", 00:04:39.897 "bdev_nvme_enable_controller", 00:04:39.897 "bdev_nvme_reset_controller", 00:04:39.897 "bdev_nvme_get_transport_statistics", 00:04:39.897 "bdev_nvme_apply_firmware", 00:04:39.897 "bdev_nvme_detach_controller", 00:04:39.897 "bdev_nvme_get_controllers", 00:04:39.897 "bdev_nvme_attach_controller", 00:04:39.897 "bdev_nvme_set_hotplug", 00:04:39.897 "bdev_nvme_set_options", 00:04:39.897 "bdev_passthru_delete", 00:04:39.897 "bdev_passthru_create", 00:04:39.897 "bdev_lvol_grow_lvstore", 00:04:39.898 "bdev_lvol_get_lvols", 00:04:39.898 "bdev_lvol_get_lvstores", 00:04:39.898 "bdev_lvol_delete", 00:04:39.898 "bdev_lvol_set_read_only", 00:04:39.898 "bdev_lvol_resize", 00:04:39.898 "bdev_lvol_decouple_parent", 00:04:39.898 "bdev_lvol_inflate", 00:04:39.898 "bdev_lvol_rename", 00:04:39.898 "bdev_lvol_clone_bdev", 00:04:39.898 "bdev_lvol_clone", 00:04:39.898 "bdev_lvol_snapshot", 00:04:39.898 "bdev_lvol_create", 00:04:39.898 "bdev_lvol_delete_lvstore", 00:04:39.898 "bdev_lvol_rename_lvstore", 00:04:39.898 "bdev_lvol_create_lvstore", 00:04:39.898 "bdev_raid_set_options", 00:04:39.898 "bdev_raid_remove_base_bdev", 00:04:39.898 "bdev_raid_add_base_bdev", 00:04:39.898 "bdev_raid_delete", 00:04:39.898 "bdev_raid_create", 00:04:39.898 "bdev_raid_get_bdevs", 00:04:39.898 "bdev_error_inject_error", 00:04:39.898 "bdev_error_delete", 00:04:39.898 "bdev_error_create", 00:04:39.898 "bdev_split_delete", 00:04:39.898 "bdev_split_create", 00:04:39.898 "bdev_delay_delete", 00:04:39.898 "bdev_delay_create", 00:04:39.898 "bdev_delay_update_latency", 00:04:39.898 "bdev_zone_block_delete", 00:04:39.898 "bdev_zone_block_create", 00:04:39.898 "blobfs_create", 00:04:39.898 "blobfs_detect", 00:04:39.898 "blobfs_set_cache_size", 00:04:39.898 "bdev_aio_delete", 00:04:39.898 "bdev_aio_rescan", 00:04:39.898 "bdev_aio_create", 00:04:39.898 "bdev_ftl_set_property", 00:04:39.898 "bdev_ftl_get_properties", 00:04:39.898 "bdev_ftl_get_stats", 00:04:39.898 "bdev_ftl_unmap", 00:04:39.898 "bdev_ftl_unload", 00:04:39.898 "bdev_ftl_delete", 00:04:39.898 "bdev_ftl_load", 00:04:39.898 "bdev_ftl_create", 00:04:39.898 "bdev_virtio_attach_controller", 00:04:39.898 "bdev_virtio_scsi_get_devices", 00:04:39.898 "bdev_virtio_detach_controller", 00:04:39.898 "bdev_virtio_blk_set_hotplug", 00:04:39.898 "bdev_iscsi_delete", 00:04:39.898 "bdev_iscsi_create", 00:04:39.898 "bdev_iscsi_set_options", 00:04:39.898 "accel_error_inject_error", 00:04:39.898 "ioat_scan_accel_module", 00:04:39.898 "dsa_scan_accel_module", 00:04:39.898 "iaa_scan_accel_module", 00:04:39.898 "iscsi_set_options", 00:04:39.898 "iscsi_get_auth_groups", 00:04:39.898 "iscsi_auth_group_remove_secret", 00:04:39.898 "iscsi_auth_group_add_secret", 00:04:39.898 "iscsi_delete_auth_group", 00:04:39.898 "iscsi_create_auth_group", 00:04:39.898 "iscsi_set_discovery_auth", 00:04:39.898 "iscsi_get_options", 00:04:39.898 "iscsi_target_node_request_logout", 00:04:39.898 "iscsi_target_node_set_redirect", 00:04:39.898 "iscsi_target_node_set_auth", 00:04:39.898 "iscsi_target_node_add_lun", 00:04:39.898 "iscsi_get_connections", 00:04:39.898 "iscsi_portal_group_set_auth", 00:04:39.898 "iscsi_start_portal_group", 00:04:39.898 "iscsi_delete_portal_group", 00:04:39.898 "iscsi_create_portal_group", 00:04:39.898 "iscsi_get_portal_groups", 00:04:39.898 "iscsi_delete_target_node", 00:04:39.898 "iscsi_target_node_remove_pg_ig_maps", 00:04:39.898 "iscsi_target_node_add_pg_ig_maps", 00:04:39.898 "iscsi_create_target_node", 00:04:39.898 "iscsi_get_target_nodes", 00:04:39.898 "iscsi_delete_initiator_group", 00:04:39.898 "iscsi_initiator_group_remove_initiators", 00:04:39.898 "iscsi_initiator_group_add_initiators", 00:04:39.898 "iscsi_create_initiator_group", 00:04:39.898 "iscsi_get_initiator_groups", 00:04:39.898 "nvmf_set_crdt", 00:04:39.898 "nvmf_set_config", 00:04:39.898 "nvmf_set_max_subsystems", 00:04:39.898 "nvmf_subsystem_get_listeners", 00:04:39.898 "nvmf_subsystem_get_qpairs", 00:04:39.898 "nvmf_subsystem_get_controllers", 00:04:39.898 "nvmf_get_stats", 00:04:39.898 "nvmf_get_transports", 00:04:39.898 "nvmf_create_transport", 00:04:39.898 "nvmf_get_targets", 00:04:39.898 "nvmf_delete_target", 00:04:39.898 "nvmf_create_target", 00:04:39.898 "nvmf_subsystem_allow_any_host", 00:04:39.898 "nvmf_subsystem_remove_host", 00:04:39.898 "nvmf_subsystem_add_host", 00:04:39.898 "nvmf_subsystem_remove_ns", 00:04:39.898 "nvmf_subsystem_add_ns", 00:04:39.898 "nvmf_subsystem_listener_set_ana_state", 00:04:39.898 "nvmf_discovery_get_referrals", 00:04:39.898 "nvmf_discovery_remove_referral", 00:04:39.898 "nvmf_discovery_add_referral", 00:04:39.898 "nvmf_subsystem_remove_listener", 00:04:39.898 "nvmf_subsystem_add_listener", 00:04:39.898 "nvmf_delete_subsystem", 00:04:39.898 "nvmf_create_subsystem", 00:04:39.898 "nvmf_get_subsystems", 00:04:39.898 "env_dpdk_get_mem_stats", 00:04:39.898 "nbd_get_disks", 00:04:39.898 "nbd_stop_disk", 00:04:39.898 "nbd_start_disk", 00:04:39.898 "ublk_recover_disk", 00:04:39.898 "ublk_get_disks", 00:04:39.898 "ublk_stop_disk", 00:04:39.898 "ublk_start_disk", 00:04:39.898 "ublk_destroy_target", 00:04:39.898 "ublk_create_target", 00:04:39.898 "virtio_blk_create_transport", 00:04:39.898 "virtio_blk_get_transports", 00:04:39.898 "vhost_controller_set_coalescing", 00:04:39.898 "vhost_get_controllers", 00:04:39.898 "vhost_delete_controller", 00:04:39.898 "vhost_create_blk_controller", 00:04:39.898 "vhost_scsi_controller_remove_target", 00:04:39.898 "vhost_scsi_controller_add_target", 00:04:39.898 "vhost_start_scsi_controller", 00:04:39.898 "vhost_create_scsi_controller", 00:04:39.898 "thread_set_cpumask", 00:04:39.898 "framework_get_scheduler", 00:04:39.898 "framework_set_scheduler", 00:04:39.898 "framework_get_reactors", 00:04:39.898 "thread_get_io_channels", 00:04:39.898 "thread_get_pollers", 00:04:39.898 "thread_get_stats", 00:04:39.898 "framework_monitor_context_switch", 00:04:39.898 "spdk_kill_instance", 00:04:39.898 "log_enable_timestamps", 00:04:39.898 "log_get_flags", 00:04:39.898 "log_clear_flag", 00:04:39.898 "log_set_flag", 00:04:39.898 "log_get_level", 00:04:39.898 "log_set_level", 00:04:39.898 "log_get_print_level", 00:04:39.898 "log_set_print_level", 00:04:39.898 "framework_enable_cpumask_locks", 00:04:39.898 "framework_disable_cpumask_locks", 00:04:39.898 "framework_wait_init", 00:04:39.898 "framework_start_init", 00:04:39.898 "scsi_get_devices", 00:04:39.898 "bdev_get_histogram", 00:04:39.898 "bdev_enable_histogram", 00:04:39.898 "bdev_set_qos_limit", 00:04:39.898 "bdev_set_qd_sampling_period", 00:04:39.898 "bdev_get_bdevs", 00:04:39.898 "bdev_reset_iostat", 00:04:39.898 "bdev_get_iostat", 00:04:39.898 "bdev_examine", 00:04:39.898 "bdev_wait_for_examine", 00:04:39.898 "bdev_set_options", 00:04:39.898 "notify_get_notifications", 00:04:39.898 "notify_get_types", 00:04:39.898 "accel_get_stats", 00:04:39.898 "accel_set_options", 00:04:39.898 "accel_set_driver", 00:04:39.898 "accel_crypto_key_destroy", 00:04:39.898 "accel_crypto_keys_get", 00:04:39.898 "accel_crypto_key_create", 00:04:39.898 "accel_assign_opc", 00:04:39.898 "accel_get_module_info", 00:04:39.898 "accel_get_opc_assignments", 00:04:39.898 "vmd_rescan", 00:04:39.898 "vmd_remove_device", 00:04:39.898 "vmd_enable", 00:04:39.898 "sock_set_default_impl", 00:04:39.898 "sock_impl_set_options", 00:04:39.898 "sock_impl_get_options", 00:04:39.898 "iobuf_get_stats", 00:04:39.898 "iobuf_set_options", 00:04:39.898 "framework_get_pci_devices", 00:04:39.898 "framework_get_config", 00:04:39.898 "framework_get_subsystems", 00:04:39.898 "trace_get_info", 00:04:39.898 "trace_get_tpoint_group_mask", 00:04:39.898 "trace_disable_tpoint_group", 00:04:39.898 "trace_enable_tpoint_group", 00:04:39.898 "trace_clear_tpoint_mask", 00:04:39.898 "trace_set_tpoint_mask", 00:04:39.898 "spdk_get_version", 00:04:39.898 "rpc_get_methods" 00:04:39.898 ] 00:04:39.898 08:12:25 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:39.898 08:12:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:39.898 08:12:25 -- common/autotest_common.sh@10 -- # set +x 00:04:39.898 08:12:25 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:39.898 08:12:25 -- spdkcli/tcp.sh@38 -- # killprocess 838685 00:04:39.898 08:12:25 -- common/autotest_common.sh@936 -- # '[' -z 838685 ']' 00:04:39.898 08:12:25 -- common/autotest_common.sh@940 -- # kill -0 838685 00:04:39.898 08:12:25 -- common/autotest_common.sh@941 -- # uname 00:04:39.898 08:12:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.898 08:12:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 838685 00:04:40.156 08:12:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.156 08:12:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.156 08:12:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 838685' 00:04:40.156 killing process with pid 838685 00:04:40.156 08:12:25 -- common/autotest_common.sh@955 -- # kill 838685 00:04:40.156 08:12:25 -- common/autotest_common.sh@960 -- # wait 838685 00:04:40.414 00:04:40.414 real 0m1.914s 00:04:40.414 user 0m3.622s 00:04:40.414 sys 0m0.506s 00:04:40.414 08:12:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.414 08:12:26 -- common/autotest_common.sh@10 -- # set +x 00:04:40.414 ************************************ 00:04:40.414 END TEST spdkcli_tcp 00:04:40.414 ************************************ 00:04:40.414 08:12:26 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:40.414 08:12:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.414 08:12:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.414 08:12:26 -- common/autotest_common.sh@10 -- # set +x 00:04:40.414 ************************************ 00:04:40.414 START TEST dpdk_mem_utility 00:04:40.414 ************************************ 00:04:40.414 08:12:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:40.673 * Looking for test storage... 00:04:40.673 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:40.673 08:12:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.673 08:12:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.673 08:12:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.673 08:12:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.673 08:12:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.673 08:12:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.673 08:12:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.673 08:12:26 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.673 08:12:26 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.673 08:12:26 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.673 08:12:26 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.673 08:12:26 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.673 08:12:26 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.673 08:12:26 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.673 08:12:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.673 08:12:26 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.673 08:12:26 -- scripts/common.sh@344 -- # : 1 00:04:40.673 08:12:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.673 08:12:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.673 08:12:26 -- scripts/common.sh@364 -- # decimal 1 00:04:40.673 08:12:26 -- scripts/common.sh@352 -- # local d=1 00:04:40.673 08:12:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.673 08:12:26 -- scripts/common.sh@354 -- # echo 1 00:04:40.673 08:12:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.673 08:12:26 -- scripts/common.sh@365 -- # decimal 2 00:04:40.673 08:12:26 -- scripts/common.sh@352 -- # local d=2 00:04:40.673 08:12:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.673 08:12:26 -- scripts/common.sh@354 -- # echo 2 00:04:40.673 08:12:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.673 08:12:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.673 08:12:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.673 08:12:26 -- scripts/common.sh@367 -- # return 0 00:04:40.673 08:12:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.673 08:12:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.673 --rc genhtml_branch_coverage=1 00:04:40.673 --rc genhtml_function_coverage=1 00:04:40.673 --rc genhtml_legend=1 00:04:40.673 --rc geninfo_all_blocks=1 00:04:40.673 --rc geninfo_unexecuted_blocks=1 00:04:40.673 00:04:40.673 ' 00:04:40.673 08:12:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.673 --rc genhtml_branch_coverage=1 00:04:40.673 --rc genhtml_function_coverage=1 00:04:40.673 --rc genhtml_legend=1 00:04:40.673 --rc geninfo_all_blocks=1 00:04:40.673 --rc geninfo_unexecuted_blocks=1 00:04:40.673 00:04:40.673 ' 00:04:40.673 08:12:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.673 --rc genhtml_branch_coverage=1 00:04:40.673 --rc genhtml_function_coverage=1 00:04:40.673 --rc genhtml_legend=1 00:04:40.673 --rc geninfo_all_blocks=1 00:04:40.673 --rc geninfo_unexecuted_blocks=1 00:04:40.673 00:04:40.673 ' 00:04:40.673 08:12:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.673 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.673 --rc genhtml_branch_coverage=1 00:04:40.673 --rc genhtml_function_coverage=1 00:04:40.673 --rc genhtml_legend=1 00:04:40.673 --rc geninfo_all_blocks=1 00:04:40.673 --rc geninfo_unexecuted_blocks=1 00:04:40.673 00:04:40.673 ' 00:04:40.673 08:12:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:40.673 08:12:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=838910 00:04:40.673 08:12:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:40.673 08:12:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 838910 00:04:40.673 08:12:26 -- common/autotest_common.sh@829 -- # '[' -z 838910 ']' 00:04:40.673 08:12:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.673 08:12:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.673 08:12:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.673 08:12:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.673 08:12:26 -- common/autotest_common.sh@10 -- # set +x 00:04:40.673 [2024-11-26 08:12:26.450253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.673 [2024-11-26 08:12:26.450338] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838910 ] 00:04:40.673 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.673 [2024-11-26 08:12:26.505735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.932 [2024-11-26 08:12:26.612768] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.932 [2024-11-26 08:12:26.612927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.866 08:12:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:41.866 08:12:27 -- common/autotest_common.sh@862 -- # return 0 00:04:41.866 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:41.866 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:41.866 08:12:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.866 08:12:27 -- common/autotest_common.sh@10 -- # set +x 00:04:41.866 { 00:04:41.866 "filename": "/tmp/spdk_mem_dump.txt" 00:04:41.866 } 00:04:41.866 08:12:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.866 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:41.866 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:41.866 1 heaps totaling size 814.000000 MiB 00:04:41.866 size: 814.000000 MiB heap id: 0 00:04:41.866 end heaps---------- 00:04:41.866 8 mempools totaling size 598.116089 MiB 00:04:41.866 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:41.866 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:41.866 size: 84.521057 MiB name: bdev_io_838910 00:04:41.866 size: 51.011292 MiB name: evtpool_838910 00:04:41.866 size: 50.003479 MiB name: msgpool_838910 00:04:41.866 size: 21.763794 MiB name: PDU_Pool 00:04:41.866 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:41.866 size: 0.026123 MiB name: Session_Pool 00:04:41.866 end mempools------- 00:04:41.866 6 memzones totaling size 4.142822 MiB 00:04:41.866 size: 1.000366 MiB name: RG_ring_0_838910 00:04:41.866 size: 1.000366 MiB name: RG_ring_1_838910 00:04:41.866 size: 1.000366 MiB name: RG_ring_4_838910 00:04:41.866 size: 1.000366 MiB name: RG_ring_5_838910 00:04:41.866 size: 0.125366 MiB name: RG_ring_2_838910 00:04:41.866 size: 0.015991 MiB name: RG_ring_3_838910 00:04:41.866 end memzones------- 00:04:41.866 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:41.866 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:41.866 list of free elements. size: 12.519348 MiB 00:04:41.866 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:41.866 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:41.866 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:41.866 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:41.866 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:41.866 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:41.866 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:41.866 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:41.866 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:41.866 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:41.866 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:41.866 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:41.866 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:41.866 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:41.866 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:41.866 list of standard malloc elements. size: 199.218079 MiB 00:04:41.866 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:41.866 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:41.866 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:41.866 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:41.866 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:41.866 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:41.866 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:41.866 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:41.866 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:41.867 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:41.867 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:41.867 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:41.867 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:41.867 list of memzone associated elements. size: 602.262573 MiB 00:04:41.867 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:41.867 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:41.867 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:41.867 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:41.867 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:41.867 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_838910_0 00:04:41.867 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:41.867 associated memzone info: size: 48.002930 MiB name: MP_evtpool_838910_0 00:04:41.867 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:41.867 associated memzone info: size: 48.002930 MiB name: MP_msgpool_838910_0 00:04:41.867 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:41.867 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:41.867 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:41.867 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:41.867 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:41.867 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_838910 00:04:41.867 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:41.867 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_838910 00:04:41.867 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:41.867 associated memzone info: size: 1.007996 MiB name: MP_evtpool_838910 00:04:41.867 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:41.867 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:41.867 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:41.867 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:41.867 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:41.867 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:41.867 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:41.867 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:41.867 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:41.867 associated memzone info: size: 1.000366 MiB name: RG_ring_0_838910 00:04:41.867 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:41.867 associated memzone info: size: 1.000366 MiB name: RG_ring_1_838910 00:04:41.867 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:41.867 associated memzone info: size: 1.000366 MiB name: RG_ring_4_838910 00:04:41.867 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:41.867 associated memzone info: size: 1.000366 MiB name: RG_ring_5_838910 00:04:41.867 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:41.867 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_838910 00:04:41.867 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:41.867 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:41.867 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:41.867 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:41.867 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:41.867 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:41.867 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:41.867 associated memzone info: size: 0.125366 MiB name: RG_ring_2_838910 00:04:41.867 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:41.867 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:41.867 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:41.867 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:41.867 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:41.867 associated memzone info: size: 0.015991 MiB name: RG_ring_3_838910 00:04:41.867 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:41.867 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:41.867 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:41.867 associated memzone info: size: 0.000183 MiB name: MP_msgpool_838910 00:04:41.867 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:41.867 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_838910 00:04:41.867 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:41.867 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:41.867 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:41.867 08:12:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 838910 00:04:41.867 08:12:27 -- common/autotest_common.sh@936 -- # '[' -z 838910 ']' 00:04:41.867 08:12:27 -- common/autotest_common.sh@940 -- # kill -0 838910 00:04:41.867 08:12:27 -- common/autotest_common.sh@941 -- # uname 00:04:41.867 08:12:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.867 08:12:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 838910 00:04:41.867 08:12:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.867 08:12:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.867 08:12:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 838910' 00:04:41.867 killing process with pid 838910 00:04:41.867 08:12:27 -- common/autotest_common.sh@955 -- # kill 838910 00:04:41.867 08:12:27 -- common/autotest_common.sh@960 -- # wait 838910 00:04:42.433 00:04:42.433 real 0m1.737s 00:04:42.433 user 0m1.918s 00:04:42.433 sys 0m0.439s 00:04:42.433 08:12:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.433 08:12:28 -- common/autotest_common.sh@10 -- # set +x 00:04:42.433 ************************************ 00:04:42.433 END TEST dpdk_mem_utility 00:04:42.433 ************************************ 00:04:42.433 08:12:28 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:42.433 08:12:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.433 08:12:28 -- common/autotest_common.sh@10 -- # set +x 00:04:42.433 ************************************ 00:04:42.433 START TEST event 00:04:42.433 ************************************ 00:04:42.433 08:12:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:42.433 * Looking for test storage... 00:04:42.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:42.433 08:12:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.433 08:12:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.433 08:12:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.433 08:12:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.433 08:12:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.433 08:12:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.433 08:12:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.433 08:12:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.433 08:12:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.433 08:12:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.433 08:12:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.433 08:12:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.433 08:12:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.433 08:12:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.433 08:12:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.433 08:12:28 -- scripts/common.sh@344 -- # : 1 00:04:42.433 08:12:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.433 08:12:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.433 08:12:28 -- scripts/common.sh@364 -- # decimal 1 00:04:42.433 08:12:28 -- scripts/common.sh@352 -- # local d=1 00:04:42.433 08:12:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.433 08:12:28 -- scripts/common.sh@354 -- # echo 1 00:04:42.433 08:12:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.433 08:12:28 -- scripts/common.sh@365 -- # decimal 2 00:04:42.433 08:12:28 -- scripts/common.sh@352 -- # local d=2 00:04:42.433 08:12:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.433 08:12:28 -- scripts/common.sh@354 -- # echo 2 00:04:42.433 08:12:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.433 08:12:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.433 08:12:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.433 08:12:28 -- scripts/common.sh@367 -- # return 0 00:04:42.433 08:12:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.433 --rc genhtml_branch_coverage=1 00:04:42.433 --rc genhtml_function_coverage=1 00:04:42.433 --rc genhtml_legend=1 00:04:42.433 --rc geninfo_all_blocks=1 00:04:42.433 --rc geninfo_unexecuted_blocks=1 00:04:42.433 00:04:42.433 ' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.433 --rc genhtml_branch_coverage=1 00:04:42.433 --rc genhtml_function_coverage=1 00:04:42.433 --rc genhtml_legend=1 00:04:42.433 --rc geninfo_all_blocks=1 00:04:42.433 --rc geninfo_unexecuted_blocks=1 00:04:42.433 00:04:42.433 ' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.433 --rc genhtml_branch_coverage=1 00:04:42.433 --rc genhtml_function_coverage=1 00:04:42.433 --rc genhtml_legend=1 00:04:42.433 --rc geninfo_all_blocks=1 00:04:42.433 --rc geninfo_unexecuted_blocks=1 00:04:42.433 00:04:42.433 ' 00:04:42.433 08:12:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.433 --rc genhtml_branch_coverage=1 00:04:42.433 --rc genhtml_function_coverage=1 00:04:42.433 --rc genhtml_legend=1 00:04:42.433 --rc geninfo_all_blocks=1 00:04:42.433 --rc geninfo_unexecuted_blocks=1 00:04:42.433 00:04:42.433 ' 00:04:42.433 08:12:28 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:42.433 08:12:28 -- bdev/nbd_common.sh@6 -- # set -e 00:04:42.433 08:12:28 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:42.433 08:12:28 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:42.434 08:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.434 08:12:28 -- common/autotest_common.sh@10 -- # set +x 00:04:42.434 ************************************ 00:04:42.434 START TEST event_perf 00:04:42.434 ************************************ 00:04:42.434 08:12:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:42.434 Running I/O for 1 seconds...[2024-11-26 08:12:28.193087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.434 [2024-11-26 08:12:28.193170] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839242 ] 00:04:42.434 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.434 [2024-11-26 08:12:28.252380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:42.692 [2024-11-26 08:12:28.368508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.692 [2024-11-26 08:12:28.368566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:42.692 [2024-11-26 08:12:28.368682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:42.692 [2024-11-26 08:12:28.368692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.066 Running I/O for 1 seconds... 00:04:44.066 lcore 0: 230611 00:04:44.066 lcore 1: 230610 00:04:44.066 lcore 2: 230612 00:04:44.066 lcore 3: 230612 00:04:44.066 done. 00:04:44.066 00:04:44.066 real 0m1.316s 00:04:44.066 user 0m4.216s 00:04:44.066 sys 0m0.095s 00:04:44.066 08:12:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.066 08:12:29 -- common/autotest_common.sh@10 -- # set +x 00:04:44.066 ************************************ 00:04:44.066 END TEST event_perf 00:04:44.066 ************************************ 00:04:44.066 08:12:29 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:44.066 08:12:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:44.066 08:12:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.066 08:12:29 -- common/autotest_common.sh@10 -- # set +x 00:04:44.066 ************************************ 00:04:44.066 START TEST event_reactor 00:04:44.066 ************************************ 00:04:44.066 08:12:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:44.066 [2024-11-26 08:12:29.538200] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.066 [2024-11-26 08:12:29.538282] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839401 ] 00:04:44.066 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.066 [2024-11-26 08:12:29.602715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.066 [2024-11-26 08:12:29.715073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.082 test_start 00:04:45.082 oneshot 00:04:45.082 tick 100 00:04:45.082 tick 100 00:04:45.082 tick 250 00:04:45.082 tick 100 00:04:45.082 tick 100 00:04:45.082 tick 100 00:04:45.082 tick 250 00:04:45.082 tick 500 00:04:45.082 tick 100 00:04:45.082 tick 100 00:04:45.082 tick 250 00:04:45.082 tick 100 00:04:45.082 tick 100 00:04:45.082 test_end 00:04:45.082 00:04:45.082 real 0m1.316s 00:04:45.082 user 0m1.229s 00:04:45.082 sys 0m0.082s 00:04:45.082 08:12:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.082 08:12:30 -- common/autotest_common.sh@10 -- # set +x 00:04:45.082 ************************************ 00:04:45.082 END TEST event_reactor 00:04:45.082 ************************************ 00:04:45.082 08:12:30 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:45.082 08:12:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:45.082 08:12:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.082 08:12:30 -- common/autotest_common.sh@10 -- # set +x 00:04:45.082 ************************************ 00:04:45.082 START TEST event_reactor_perf 00:04:45.082 ************************************ 00:04:45.082 08:12:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:45.082 [2024-11-26 08:12:30.884207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.082 [2024-11-26 08:12:30.884289] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839558 ] 00:04:45.082 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.340 [2024-11-26 08:12:30.947339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.340 [2024-11-26 08:12:31.059753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.719 test_start 00:04:46.719 test_end 00:04:46.719 Performance: 352761 events per second 00:04:46.719 00:04:46.719 real 0m1.314s 00:04:46.719 user 0m1.227s 00:04:46.719 sys 0m0.080s 00:04:46.719 08:12:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.719 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.719 ************************************ 00:04:46.719 END TEST event_reactor_perf 00:04:46.719 ************************************ 00:04:46.719 08:12:32 -- event/event.sh@49 -- # uname -s 00:04:46.719 08:12:32 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:46.719 08:12:32 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:46.719 08:12:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.719 08:12:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.719 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.719 ************************************ 00:04:46.719 START TEST event_scheduler 00:04:46.719 ************************************ 00:04:46.719 08:12:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:46.719 * Looking for test storage... 00:04:46.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:46.719 08:12:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:46.719 08:12:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:46.719 08:12:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:46.719 08:12:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:46.719 08:12:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:46.719 08:12:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:46.719 08:12:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:46.719 08:12:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:46.719 08:12:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:46.719 08:12:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:46.719 08:12:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:46.719 08:12:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:46.719 08:12:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:46.719 08:12:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:46.719 08:12:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:46.719 08:12:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:46.719 08:12:32 -- scripts/common.sh@344 -- # : 1 00:04:46.719 08:12:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:46.719 08:12:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:46.719 08:12:32 -- scripts/common.sh@364 -- # decimal 1 00:04:46.719 08:12:32 -- scripts/common.sh@352 -- # local d=1 00:04:46.719 08:12:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:46.719 08:12:32 -- scripts/common.sh@354 -- # echo 1 00:04:46.719 08:12:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:46.719 08:12:32 -- scripts/common.sh@365 -- # decimal 2 00:04:46.719 08:12:32 -- scripts/common.sh@352 -- # local d=2 00:04:46.719 08:12:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:46.719 08:12:32 -- scripts/common.sh@354 -- # echo 2 00:04:46.719 08:12:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:46.719 08:12:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:46.719 08:12:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:46.719 08:12:32 -- scripts/common.sh@367 -- # return 0 00:04:46.719 08:12:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:46.719 08:12:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:46.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.719 --rc genhtml_branch_coverage=1 00:04:46.720 --rc genhtml_function_coverage=1 00:04:46.720 --rc genhtml_legend=1 00:04:46.720 --rc geninfo_all_blocks=1 00:04:46.720 --rc geninfo_unexecuted_blocks=1 00:04:46.720 00:04:46.720 ' 00:04:46.720 08:12:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:46.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.720 --rc genhtml_branch_coverage=1 00:04:46.720 --rc genhtml_function_coverage=1 00:04:46.720 --rc genhtml_legend=1 00:04:46.720 --rc geninfo_all_blocks=1 00:04:46.720 --rc geninfo_unexecuted_blocks=1 00:04:46.720 00:04:46.720 ' 00:04:46.720 08:12:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:46.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.720 --rc genhtml_branch_coverage=1 00:04:46.720 --rc genhtml_function_coverage=1 00:04:46.720 --rc genhtml_legend=1 00:04:46.720 --rc geninfo_all_blocks=1 00:04:46.720 --rc geninfo_unexecuted_blocks=1 00:04:46.720 00:04:46.720 ' 00:04:46.720 08:12:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:46.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.720 --rc genhtml_branch_coverage=1 00:04:46.720 --rc genhtml_function_coverage=1 00:04:46.720 --rc genhtml_legend=1 00:04:46.720 --rc geninfo_all_blocks=1 00:04:46.720 --rc geninfo_unexecuted_blocks=1 00:04:46.720 00:04:46.720 ' 00:04:46.720 08:12:32 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:46.720 08:12:32 -- scheduler/scheduler.sh@35 -- # scheduler_pid=839876 00:04:46.720 08:12:32 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:46.720 08:12:32 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:46.720 08:12:32 -- scheduler/scheduler.sh@37 -- # waitforlisten 839876 00:04:46.720 08:12:32 -- common/autotest_common.sh@829 -- # '[' -z 839876 ']' 00:04:46.720 08:12:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.720 08:12:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.720 08:12:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.720 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.720 08:12:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.720 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.720 [2024-11-26 08:12:32.392006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.720 [2024-11-26 08:12:32.392113] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839876 ] 00:04:46.720 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.720 [2024-11-26 08:12:32.457776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:46.720 [2024-11-26 08:12:32.562423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.720 [2024-11-26 08:12:32.562476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.720 [2024-11-26 08:12:32.562562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:46.720 [2024-11-26 08:12:32.562564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:46.980 08:12:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.980 08:12:32 -- common/autotest_common.sh@862 -- # return 0 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 POWER: Env isn't set yet! 00:04:46.980 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:46.980 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:46.980 POWER: Cannot get available frequencies of lcore 0 00:04:46.980 POWER: Attempting to initialise PSTAT power management... 00:04:46.980 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:46.980 POWER: Initialized successfully for lcore 0 power management 00:04:46.980 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:46.980 POWER: Initialized successfully for lcore 1 power management 00:04:46.980 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:46.980 POWER: Initialized successfully for lcore 2 power management 00:04:46.980 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:46.980 POWER: Initialized successfully for lcore 3 power management 00:04:46.980 [2024-11-26 08:12:32.661888] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:46.980 [2024-11-26 08:12:32.661906] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:46.980 [2024-11-26 08:12:32.661917] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:46.980 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 [2024-11-26 08:12:32.765719] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:46.980 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:46.980 08:12:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.980 08:12:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 ************************************ 00:04:46.980 START TEST scheduler_create_thread 00:04:46.980 ************************************ 00:04:46.980 08:12:32 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 2 00:04:46.980 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 3 00:04:46.980 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 4 00:04:46.980 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.980 08:12:32 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:46.980 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.980 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:46.980 5 00:04:46.981 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.981 08:12:32 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:46.981 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.981 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 6 00:04:47.241 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.241 08:12:32 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:47.241 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.241 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 7 00:04:47.241 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.241 08:12:32 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:47.241 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.241 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 8 00:04:47.241 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.241 08:12:32 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:47.241 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.241 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 9 00:04:47.241 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.241 08:12:32 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:47.241 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.241 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 10 00:04:47.241 08:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.241 08:12:32 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:47.241 08:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.241 08:12:32 -- common/autotest_common.sh@10 -- # set +x 00:04:48.620 08:12:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.620 08:12:34 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:48.620 08:12:34 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:48.620 08:12:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.620 08:12:34 -- common/autotest_common.sh@10 -- # set +x 00:04:49.187 08:12:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.187 08:12:35 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:49.187 08:12:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.187 08:12:35 -- common/autotest_common.sh@10 -- # set +x 00:04:50.124 08:12:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:50.124 08:12:35 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:50.124 08:12:35 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:50.124 08:12:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:50.124 08:12:35 -- common/autotest_common.sh@10 -- # set +x 00:04:51.062 08:12:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:51.062 00:04:51.062 real 0m3.893s 00:04:51.062 user 0m0.019s 00:04:51.063 sys 0m0.002s 00:04:51.063 08:12:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.063 08:12:36 -- common/autotest_common.sh@10 -- # set +x 00:04:51.063 ************************************ 00:04:51.063 END TEST scheduler_create_thread 00:04:51.063 ************************************ 00:04:51.063 08:12:36 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:51.063 08:12:36 -- scheduler/scheduler.sh@46 -- # killprocess 839876 00:04:51.063 08:12:36 -- common/autotest_common.sh@936 -- # '[' -z 839876 ']' 00:04:51.063 08:12:36 -- common/autotest_common.sh@940 -- # kill -0 839876 00:04:51.063 08:12:36 -- common/autotest_common.sh@941 -- # uname 00:04:51.063 08:12:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:51.063 08:12:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 839876 00:04:51.063 08:12:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:51.063 08:12:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:51.063 08:12:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 839876' 00:04:51.063 killing process with pid 839876 00:04:51.063 08:12:36 -- common/autotest_common.sh@955 -- # kill 839876 00:04:51.063 08:12:36 -- common/autotest_common.sh@960 -- # wait 839876 00:04:51.321 [2024-11-26 08:12:37.046654] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:51.579 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:51.579 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:51.579 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:51.579 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:51.579 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:51.579 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:51.579 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:51.579 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:51.579 00:04:51.579 real 0m5.184s 00:04:51.579 user 0m9.810s 00:04:51.579 sys 0m0.328s 00:04:51.579 08:12:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.579 08:12:37 -- common/autotest_common.sh@10 -- # set +x 00:04:51.579 ************************************ 00:04:51.579 END TEST event_scheduler 00:04:51.579 ************************************ 00:04:51.579 08:12:37 -- event/event.sh@51 -- # modprobe -n nbd 00:04:51.579 08:12:37 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:51.579 08:12:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.579 08:12:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.579 08:12:37 -- common/autotest_common.sh@10 -- # set +x 00:04:51.579 ************************************ 00:04:51.579 START TEST app_repeat 00:04:51.579 ************************************ 00:04:51.579 08:12:37 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:51.579 08:12:37 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.839 08:12:37 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.839 08:12:37 -- event/event.sh@13 -- # local nbd_list 00:04:51.839 08:12:37 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.839 08:12:37 -- event/event.sh@14 -- # local bdev_list 00:04:51.839 08:12:37 -- event/event.sh@15 -- # local repeat_times=4 00:04:51.839 08:12:37 -- event/event.sh@17 -- # modprobe nbd 00:04:51.839 08:12:37 -- event/event.sh@19 -- # repeat_pid=840481 00:04:51.839 08:12:37 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:51.839 08:12:37 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:51.839 08:12:37 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 840481' 00:04:51.839 Process app_repeat pid: 840481 00:04:51.839 08:12:37 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.839 08:12:37 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:51.839 spdk_app_start Round 0 00:04:51.839 08:12:37 -- event/event.sh@25 -- # waitforlisten 840481 /var/tmp/spdk-nbd.sock 00:04:51.839 08:12:37 -- common/autotest_common.sh@829 -- # '[' -z 840481 ']' 00:04:51.839 08:12:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.839 08:12:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.839 08:12:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.839 08:12:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.839 08:12:37 -- common/autotest_common.sh@10 -- # set +x 00:04:51.839 [2024-11-26 08:12:37.458299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.839 [2024-11-26 08:12:37.458382] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840481 ] 00:04:51.839 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.839 [2024-11-26 08:12:37.521418] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:51.839 [2024-11-26 08:12:37.634494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.839 [2024-11-26 08:12:37.634499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.773 08:12:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.773 08:12:38 -- common/autotest_common.sh@862 -- # return 0 00:04:52.773 08:12:38 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:53.031 Malloc0 00:04:53.031 08:12:38 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:53.288 Malloc1 00:04:53.288 08:12:38 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@12 -- # local i 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.288 08:12:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:53.546 /dev/nbd0 00:04:53.546 08:12:39 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:53.546 08:12:39 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:53.546 08:12:39 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:53.546 08:12:39 -- common/autotest_common.sh@867 -- # local i 00:04:53.546 08:12:39 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.546 08:12:39 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.546 08:12:39 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:53.546 08:12:39 -- common/autotest_common.sh@871 -- # break 00:04:53.546 08:12:39 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.546 08:12:39 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.546 08:12:39 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.546 1+0 records in 00:04:53.546 1+0 records out 00:04:53.546 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000154302 s, 26.5 MB/s 00:04:53.546 08:12:39 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.546 08:12:39 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.546 08:12:39 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.546 08:12:39 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.546 08:12:39 -- common/autotest_common.sh@887 -- # return 0 00:04:53.546 08:12:39 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.546 08:12:39 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.546 08:12:39 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:53.802 /dev/nbd1 00:04:53.802 08:12:39 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:53.802 08:12:39 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:53.802 08:12:39 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:53.802 08:12:39 -- common/autotest_common.sh@867 -- # local i 00:04:53.802 08:12:39 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.802 08:12:39 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.802 08:12:39 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:53.802 08:12:39 -- common/autotest_common.sh@871 -- # break 00:04:53.803 08:12:39 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.803 08:12:39 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.803 08:12:39 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.803 1+0 records in 00:04:53.803 1+0 records out 00:04:53.803 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000213427 s, 19.2 MB/s 00:04:53.803 08:12:39 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.803 08:12:39 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.803 08:12:39 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.803 08:12:39 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.803 08:12:39 -- common/autotest_common.sh@887 -- # return 0 00:04:53.803 08:12:39 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.803 08:12:39 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.803 08:12:39 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.803 08:12:39 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.803 08:12:39 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.059 08:12:39 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:54.059 { 00:04:54.059 "nbd_device": "/dev/nbd0", 00:04:54.059 "bdev_name": "Malloc0" 00:04:54.060 }, 00:04:54.060 { 00:04:54.060 "nbd_device": "/dev/nbd1", 00:04:54.060 "bdev_name": "Malloc1" 00:04:54.060 } 00:04:54.060 ]' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:54.060 { 00:04:54.060 "nbd_device": "/dev/nbd0", 00:04:54.060 "bdev_name": "Malloc0" 00:04:54.060 }, 00:04:54.060 { 00:04:54.060 "nbd_device": "/dev/nbd1", 00:04:54.060 "bdev_name": "Malloc1" 00:04:54.060 } 00:04:54.060 ]' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:54.060 /dev/nbd1' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:54.060 /dev/nbd1' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@65 -- # count=2 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@95 -- # count=2 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:54.060 256+0 records in 00:04:54.060 256+0 records out 00:04:54.060 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00474324 s, 221 MB/s 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:54.060 256+0 records in 00:04:54.060 256+0 records out 00:04:54.060 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223169 s, 47.0 MB/s 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:54.060 256+0 records in 00:04:54.060 256+0 records out 00:04:54.060 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243007 s, 43.2 MB/s 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@51 -- # local i 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.060 08:12:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:54.626 08:12:40 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:54.626 08:12:40 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:54.626 08:12:40 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:54.626 08:12:40 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@41 -- # break 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@41 -- # break 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:54.627 08:12:40 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.885 08:12:40 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.885 08:12:40 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:54.885 08:12:40 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:54.885 08:12:40 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@65 -- # true 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@65 -- # count=0 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@104 -- # count=0 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:55.146 08:12:40 -- bdev/nbd_common.sh@109 -- # return 0 00:04:55.146 08:12:40 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:55.405 08:12:41 -- event/event.sh@35 -- # sleep 3 00:04:55.663 [2024-11-26 08:12:41.322302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:55.663 [2024-11-26 08:12:41.432789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.663 [2024-11-26 08:12:41.432789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:55.663 [2024-11-26 08:12:41.494303] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:55.663 [2024-11-26 08:12:41.494401] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:58.201 08:12:44 -- event/event.sh@23 -- # for i in {0..2} 00:04:58.201 08:12:44 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:58.201 spdk_app_start Round 1 00:04:58.201 08:12:44 -- event/event.sh@25 -- # waitforlisten 840481 /var/tmp/spdk-nbd.sock 00:04:58.201 08:12:44 -- common/autotest_common.sh@829 -- # '[' -z 840481 ']' 00:04:58.201 08:12:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:58.201 08:12:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.201 08:12:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:58.201 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:58.201 08:12:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.201 08:12:44 -- common/autotest_common.sh@10 -- # set +x 00:04:58.458 08:12:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.458 08:12:44 -- common/autotest_common.sh@862 -- # return 0 00:04:58.458 08:12:44 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:58.716 Malloc0 00:04:58.716 08:12:44 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:58.976 Malloc1 00:04:59.235 08:12:44 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@12 -- # local i 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.235 08:12:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:59.494 /dev/nbd0 00:04:59.494 08:12:45 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:59.494 08:12:45 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:59.494 08:12:45 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:59.494 08:12:45 -- common/autotest_common.sh@867 -- # local i 00:04:59.494 08:12:45 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.494 08:12:45 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.494 08:12:45 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:59.494 08:12:45 -- common/autotest_common.sh@871 -- # break 00:04:59.494 08:12:45 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.494 08:12:45 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.494 08:12:45 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.494 1+0 records in 00:04:59.494 1+0 records out 00:04:59.494 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000164173 s, 24.9 MB/s 00:04:59.494 08:12:45 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.494 08:12:45 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.494 08:12:45 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.494 08:12:45 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.494 08:12:45 -- common/autotest_common.sh@887 -- # return 0 00:04:59.494 08:12:45 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.494 08:12:45 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.494 08:12:45 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:59.751 /dev/nbd1 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:59.751 08:12:45 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:59.751 08:12:45 -- common/autotest_common.sh@867 -- # local i 00:04:59.751 08:12:45 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.751 08:12:45 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.751 08:12:45 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:59.751 08:12:45 -- common/autotest_common.sh@871 -- # break 00:04:59.751 08:12:45 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.751 08:12:45 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.751 08:12:45 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.751 1+0 records in 00:04:59.751 1+0 records out 00:04:59.751 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000189234 s, 21.6 MB/s 00:04:59.751 08:12:45 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.751 08:12:45 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.751 08:12:45 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.751 08:12:45 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.751 08:12:45 -- common/autotest_common.sh@887 -- # return 0 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:59.751 08:12:45 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.752 08:12:45 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:00.010 { 00:05:00.010 "nbd_device": "/dev/nbd0", 00:05:00.010 "bdev_name": "Malloc0" 00:05:00.010 }, 00:05:00.010 { 00:05:00.010 "nbd_device": "/dev/nbd1", 00:05:00.010 "bdev_name": "Malloc1" 00:05:00.010 } 00:05:00.010 ]' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:00.010 { 00:05:00.010 "nbd_device": "/dev/nbd0", 00:05:00.010 "bdev_name": "Malloc0" 00:05:00.010 }, 00:05:00.010 { 00:05:00.010 "nbd_device": "/dev/nbd1", 00:05:00.010 "bdev_name": "Malloc1" 00:05:00.010 } 00:05:00.010 ]' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:00.010 /dev/nbd1' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:00.010 /dev/nbd1' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@65 -- # count=2 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@95 -- # count=2 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:00.010 256+0 records in 00:05:00.010 256+0 records out 00:05:00.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00507996 s, 206 MB/s 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:00.010 256+0 records in 00:05:00.010 256+0 records out 00:05:00.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227425 s, 46.1 MB/s 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:00.010 256+0 records in 00:05:00.010 256+0 records out 00:05:00.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250021 s, 41.9 MB/s 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@51 -- # local i 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.010 08:12:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@41 -- # break 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.267 08:12:46 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@41 -- # break 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.525 08:12:46 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@65 -- # true 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@65 -- # count=0 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@104 -- # count=0 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:00.783 08:12:46 -- bdev/nbd_common.sh@109 -- # return 0 00:05:00.783 08:12:46 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:01.041 08:12:46 -- event/event.sh@35 -- # sleep 3 00:05:01.300 [2024-11-26 08:12:47.152794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:01.560 [2024-11-26 08:12:47.266715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:01.560 [2024-11-26 08:12:47.266718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.560 [2024-11-26 08:12:47.326782] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:01.560 [2024-11-26 08:12:47.326862] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:04.098 08:12:49 -- event/event.sh@23 -- # for i in {0..2} 00:05:04.098 08:12:49 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:04.098 spdk_app_start Round 2 00:05:04.098 08:12:49 -- event/event.sh@25 -- # waitforlisten 840481 /var/tmp/spdk-nbd.sock 00:05:04.098 08:12:49 -- common/autotest_common.sh@829 -- # '[' -z 840481 ']' 00:05:04.098 08:12:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:04.098 08:12:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.098 08:12:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:04.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:04.098 08:12:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.098 08:12:49 -- common/autotest_common.sh@10 -- # set +x 00:05:04.356 08:12:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.356 08:12:50 -- common/autotest_common.sh@862 -- # return 0 00:05:04.356 08:12:50 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.614 Malloc0 00:05:04.614 08:12:50 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.872 Malloc1 00:05:04.872 08:12:50 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@12 -- # local i 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:04.872 08:12:50 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:05.131 /dev/nbd0 00:05:05.131 08:12:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:05.131 08:12:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:05.131 08:12:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:05.131 08:12:50 -- common/autotest_common.sh@867 -- # local i 00:05:05.131 08:12:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.131 08:12:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.131 08:12:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:05.131 08:12:50 -- common/autotest_common.sh@871 -- # break 00:05:05.131 08:12:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.131 08:12:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.131 08:12:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:05.390 1+0 records in 00:05:05.390 1+0 records out 00:05:05.390 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000154731 s, 26.5 MB/s 00:05:05.390 08:12:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.390 08:12:51 -- common/autotest_common.sh@884 -- # size=4096 00:05:05.390 08:12:51 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.390 08:12:51 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:05.390 08:12:51 -- common/autotest_common.sh@887 -- # return 0 00:05:05.390 08:12:51 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:05.390 08:12:51 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.390 08:12:51 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:05.390 /dev/nbd1 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:05.647 08:12:51 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:05.647 08:12:51 -- common/autotest_common.sh@867 -- # local i 00:05:05.647 08:12:51 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.647 08:12:51 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.647 08:12:51 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:05.647 08:12:51 -- common/autotest_common.sh@871 -- # break 00:05:05.647 08:12:51 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.647 08:12:51 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.647 08:12:51 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:05.647 1+0 records in 00:05:05.647 1+0 records out 00:05:05.647 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206812 s, 19.8 MB/s 00:05:05.647 08:12:51 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.647 08:12:51 -- common/autotest_common.sh@884 -- # size=4096 00:05:05.647 08:12:51 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.647 08:12:51 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:05.647 08:12:51 -- common/autotest_common.sh@887 -- # return 0 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.647 08:12:51 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:05.904 { 00:05:05.904 "nbd_device": "/dev/nbd0", 00:05:05.904 "bdev_name": "Malloc0" 00:05:05.904 }, 00:05:05.904 { 00:05:05.904 "nbd_device": "/dev/nbd1", 00:05:05.904 "bdev_name": "Malloc1" 00:05:05.904 } 00:05:05.904 ]' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:05.904 { 00:05:05.904 "nbd_device": "/dev/nbd0", 00:05:05.904 "bdev_name": "Malloc0" 00:05:05.904 }, 00:05:05.904 { 00:05:05.904 "nbd_device": "/dev/nbd1", 00:05:05.904 "bdev_name": "Malloc1" 00:05:05.904 } 00:05:05.904 ]' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:05.904 /dev/nbd1' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:05.904 /dev/nbd1' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@65 -- # count=2 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@95 -- # count=2 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:05.904 256+0 records in 00:05:05.904 256+0 records out 00:05:05.904 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0050207 s, 209 MB/s 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:05.904 256+0 records in 00:05:05.904 256+0 records out 00:05:05.904 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228663 s, 45.9 MB/s 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:05.904 256+0 records in 00:05:05.904 256+0 records out 00:05:05.904 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246366 s, 42.6 MB/s 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:05.904 08:12:51 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@51 -- # local i 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:05.905 08:12:51 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@41 -- # break 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:06.163 08:12:51 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@41 -- # break 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.421 08:12:52 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@65 -- # true 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@65 -- # count=0 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@104 -- # count=0 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:06.680 08:12:52 -- bdev/nbd_common.sh@109 -- # return 0 00:05:06.680 08:12:52 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:06.939 08:12:52 -- event/event.sh@35 -- # sleep 3 00:05:07.198 [2024-11-26 08:12:53.050331] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:07.458 [2024-11-26 08:12:53.163212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:07.458 [2024-11-26 08:12:53.163216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.458 [2024-11-26 08:12:53.224659] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:07.458 [2024-11-26 08:12:53.224774] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:09.995 08:12:55 -- event/event.sh@38 -- # waitforlisten 840481 /var/tmp/spdk-nbd.sock 00:05:09.995 08:12:55 -- common/autotest_common.sh@829 -- # '[' -z 840481 ']' 00:05:09.995 08:12:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:09.995 08:12:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.995 08:12:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:09.995 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:09.995 08:12:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.995 08:12:55 -- common/autotest_common.sh@10 -- # set +x 00:05:10.253 08:12:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.253 08:12:56 -- common/autotest_common.sh@862 -- # return 0 00:05:10.253 08:12:56 -- event/event.sh@39 -- # killprocess 840481 00:05:10.253 08:12:56 -- common/autotest_common.sh@936 -- # '[' -z 840481 ']' 00:05:10.253 08:12:56 -- common/autotest_common.sh@940 -- # kill -0 840481 00:05:10.253 08:12:56 -- common/autotest_common.sh@941 -- # uname 00:05:10.253 08:12:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.253 08:12:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 840481 00:05:10.253 08:12:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.253 08:12:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.253 08:12:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 840481' 00:05:10.253 killing process with pid 840481 00:05:10.253 08:12:56 -- common/autotest_common.sh@955 -- # kill 840481 00:05:10.253 08:12:56 -- common/autotest_common.sh@960 -- # wait 840481 00:05:10.512 spdk_app_start is called in Round 0. 00:05:10.512 Shutdown signal received, stop current app iteration 00:05:10.512 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.512 spdk_app_start is called in Round 1. 00:05:10.512 Shutdown signal received, stop current app iteration 00:05:10.512 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.512 spdk_app_start is called in Round 2. 00:05:10.512 Shutdown signal received, stop current app iteration 00:05:10.512 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.512 spdk_app_start is called in Round 3. 00:05:10.512 Shutdown signal received, stop current app iteration 00:05:10.512 08:12:56 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:10.512 08:12:56 -- event/event.sh@42 -- # return 0 00:05:10.512 00:05:10.512 real 0m18.913s 00:05:10.512 user 0m41.298s 00:05:10.512 sys 0m3.094s 00:05:10.512 08:12:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.512 08:12:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.512 ************************************ 00:05:10.512 END TEST app_repeat 00:05:10.512 ************************************ 00:05:10.771 08:12:56 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:10.771 08:12:56 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.771 08:12:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.771 08:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.771 08:12:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.771 ************************************ 00:05:10.771 START TEST cpu_locks 00:05:10.771 ************************************ 00:05:10.771 08:12:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.771 * Looking for test storage... 00:05:10.771 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:10.771 08:12:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:10.771 08:12:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:10.771 08:12:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:10.771 08:12:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:10.771 08:12:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:10.771 08:12:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:10.771 08:12:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:10.771 08:12:56 -- scripts/common.sh@335 -- # IFS=.-: 00:05:10.771 08:12:56 -- scripts/common.sh@335 -- # read -ra ver1 00:05:10.771 08:12:56 -- scripts/common.sh@336 -- # IFS=.-: 00:05:10.771 08:12:56 -- scripts/common.sh@336 -- # read -ra ver2 00:05:10.771 08:12:56 -- scripts/common.sh@337 -- # local 'op=<' 00:05:10.771 08:12:56 -- scripts/common.sh@339 -- # ver1_l=2 00:05:10.772 08:12:56 -- scripts/common.sh@340 -- # ver2_l=1 00:05:10.772 08:12:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:10.772 08:12:56 -- scripts/common.sh@343 -- # case "$op" in 00:05:10.772 08:12:56 -- scripts/common.sh@344 -- # : 1 00:05:10.772 08:12:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:10.772 08:12:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:10.772 08:12:56 -- scripts/common.sh@364 -- # decimal 1 00:05:10.772 08:12:56 -- scripts/common.sh@352 -- # local d=1 00:05:10.772 08:12:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:10.772 08:12:56 -- scripts/common.sh@354 -- # echo 1 00:05:10.772 08:12:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:10.772 08:12:56 -- scripts/common.sh@365 -- # decimal 2 00:05:10.772 08:12:56 -- scripts/common.sh@352 -- # local d=2 00:05:10.772 08:12:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:10.772 08:12:56 -- scripts/common.sh@354 -- # echo 2 00:05:10.772 08:12:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:10.772 08:12:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:10.772 08:12:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:10.772 08:12:56 -- scripts/common.sh@367 -- # return 0 00:05:10.772 08:12:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:10.772 08:12:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:10.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.772 --rc genhtml_branch_coverage=1 00:05:10.772 --rc genhtml_function_coverage=1 00:05:10.772 --rc genhtml_legend=1 00:05:10.772 --rc geninfo_all_blocks=1 00:05:10.772 --rc geninfo_unexecuted_blocks=1 00:05:10.772 00:05:10.772 ' 00:05:10.772 08:12:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:10.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.772 --rc genhtml_branch_coverage=1 00:05:10.772 --rc genhtml_function_coverage=1 00:05:10.772 --rc genhtml_legend=1 00:05:10.772 --rc geninfo_all_blocks=1 00:05:10.772 --rc geninfo_unexecuted_blocks=1 00:05:10.772 00:05:10.772 ' 00:05:10.772 08:12:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:10.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.772 --rc genhtml_branch_coverage=1 00:05:10.772 --rc genhtml_function_coverage=1 00:05:10.772 --rc genhtml_legend=1 00:05:10.772 --rc geninfo_all_blocks=1 00:05:10.772 --rc geninfo_unexecuted_blocks=1 00:05:10.772 00:05:10.772 ' 00:05:10.772 08:12:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:10.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.772 --rc genhtml_branch_coverage=1 00:05:10.772 --rc genhtml_function_coverage=1 00:05:10.772 --rc genhtml_legend=1 00:05:10.772 --rc geninfo_all_blocks=1 00:05:10.772 --rc geninfo_unexecuted_blocks=1 00:05:10.772 00:05:10.772 ' 00:05:10.772 08:12:56 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:10.772 08:12:56 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:10.772 08:12:56 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:10.772 08:12:56 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:10.772 08:12:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.772 08:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.772 08:12:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.772 ************************************ 00:05:10.772 START TEST default_locks 00:05:10.772 ************************************ 00:05:10.772 08:12:56 -- common/autotest_common.sh@1114 -- # default_locks 00:05:10.772 08:12:56 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=843037 00:05:10.772 08:12:56 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:10.772 08:12:56 -- event/cpu_locks.sh@47 -- # waitforlisten 843037 00:05:10.772 08:12:56 -- common/autotest_common.sh@829 -- # '[' -z 843037 ']' 00:05:10.772 08:12:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.772 08:12:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.772 08:12:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.772 08:12:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.772 08:12:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.772 [2024-11-26 08:12:56.567506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.772 [2024-11-26 08:12:56.567585] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843037 ] 00:05:10.772 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.772 [2024-11-26 08:12:56.624640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.032 [2024-11-26 08:12:56.735452] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.032 [2024-11-26 08:12:56.735642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.968 08:12:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.968 08:12:57 -- common/autotest_common.sh@862 -- # return 0 00:05:11.968 08:12:57 -- event/cpu_locks.sh@49 -- # locks_exist 843037 00:05:11.968 08:12:57 -- event/cpu_locks.sh@22 -- # lslocks -p 843037 00:05:11.968 08:12:57 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:12.227 lslocks: write error 00:05:12.227 08:12:57 -- event/cpu_locks.sh@50 -- # killprocess 843037 00:05:12.227 08:12:57 -- common/autotest_common.sh@936 -- # '[' -z 843037 ']' 00:05:12.227 08:12:57 -- common/autotest_common.sh@940 -- # kill -0 843037 00:05:12.227 08:12:57 -- common/autotest_common.sh@941 -- # uname 00:05:12.227 08:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.227 08:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843037 00:05:12.227 08:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.227 08:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.227 08:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843037' 00:05:12.227 killing process with pid 843037 00:05:12.227 08:12:57 -- common/autotest_common.sh@955 -- # kill 843037 00:05:12.227 08:12:57 -- common/autotest_common.sh@960 -- # wait 843037 00:05:12.861 08:12:58 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 843037 00:05:12.861 08:12:58 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.861 08:12:58 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 843037 00:05:12.861 08:12:58 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.861 08:12:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.861 08:12:58 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.861 08:12:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.861 08:12:58 -- common/autotest_common.sh@653 -- # waitforlisten 843037 00:05:12.861 08:12:58 -- common/autotest_common.sh@829 -- # '[' -z 843037 ']' 00:05:12.861 08:12:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.861 08:12:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.861 08:12:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.861 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.861 08:12:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.861 08:12:58 -- common/autotest_common.sh@10 -- # set +x 00:05:12.861 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (843037) - No such process 00:05:12.861 ERROR: process (pid: 843037) is no longer running 00:05:12.861 08:12:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.861 08:12:58 -- common/autotest_common.sh@862 -- # return 1 00:05:12.861 08:12:58 -- common/autotest_common.sh@653 -- # es=1 00:05:12.861 08:12:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:12.861 08:12:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:12.861 08:12:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:12.861 08:12:58 -- event/cpu_locks.sh@54 -- # no_locks 00:05:12.861 08:12:58 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:12.861 08:12:58 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:12.861 08:12:58 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:12.861 00:05:12.861 real 0m1.891s 00:05:12.861 user 0m2.019s 00:05:12.861 sys 0m0.575s 00:05:12.861 08:12:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.861 08:12:58 -- common/autotest_common.sh@10 -- # set +x 00:05:12.861 ************************************ 00:05:12.861 END TEST default_locks 00:05:12.861 ************************************ 00:05:12.861 08:12:58 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:12.861 08:12:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.861 08:12:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.861 08:12:58 -- common/autotest_common.sh@10 -- # set +x 00:05:12.861 ************************************ 00:05:12.861 START TEST default_locks_via_rpc 00:05:12.861 ************************************ 00:05:12.861 08:12:58 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:12.861 08:12:58 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=843335 00:05:12.861 08:12:58 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:12.861 08:12:58 -- event/cpu_locks.sh@63 -- # waitforlisten 843335 00:05:12.861 08:12:58 -- common/autotest_common.sh@829 -- # '[' -z 843335 ']' 00:05:12.861 08:12:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.861 08:12:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.861 08:12:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.861 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.861 08:12:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.861 08:12:58 -- common/autotest_common.sh@10 -- # set +x 00:05:12.861 [2024-11-26 08:12:58.486924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.861 [2024-11-26 08:12:58.487001] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843335 ] 00:05:12.861 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.861 [2024-11-26 08:12:58.547725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.861 [2024-11-26 08:12:58.659933] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.861 [2024-11-26 08:12:58.660118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.799 08:12:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.799 08:12:59 -- common/autotest_common.sh@862 -- # return 0 00:05:13.799 08:12:59 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:13.799 08:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.799 08:12:59 -- common/autotest_common.sh@10 -- # set +x 00:05:13.799 08:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.799 08:12:59 -- event/cpu_locks.sh@67 -- # no_locks 00:05:13.799 08:12:59 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:13.799 08:12:59 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:13.799 08:12:59 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:13.799 08:12:59 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:13.799 08:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.799 08:12:59 -- common/autotest_common.sh@10 -- # set +x 00:05:13.799 08:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.799 08:12:59 -- event/cpu_locks.sh@71 -- # locks_exist 843335 00:05:13.799 08:12:59 -- event/cpu_locks.sh@22 -- # lslocks -p 843335 00:05:13.799 08:12:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:14.059 08:12:59 -- event/cpu_locks.sh@73 -- # killprocess 843335 00:05:14.059 08:12:59 -- common/autotest_common.sh@936 -- # '[' -z 843335 ']' 00:05:14.059 08:12:59 -- common/autotest_common.sh@940 -- # kill -0 843335 00:05:14.059 08:12:59 -- common/autotest_common.sh@941 -- # uname 00:05:14.059 08:12:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:14.059 08:12:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843335 00:05:14.059 08:12:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:14.059 08:12:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:14.059 08:12:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843335' 00:05:14.059 killing process with pid 843335 00:05:14.059 08:12:59 -- common/autotest_common.sh@955 -- # kill 843335 00:05:14.059 08:12:59 -- common/autotest_common.sh@960 -- # wait 843335 00:05:14.627 00:05:14.627 real 0m1.741s 00:05:14.627 user 0m1.877s 00:05:14.627 sys 0m0.560s 00:05:14.627 08:13:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.627 08:13:00 -- common/autotest_common.sh@10 -- # set +x 00:05:14.627 ************************************ 00:05:14.627 END TEST default_locks_via_rpc 00:05:14.627 ************************************ 00:05:14.627 08:13:00 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:14.627 08:13:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.627 08:13:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.627 08:13:00 -- common/autotest_common.sh@10 -- # set +x 00:05:14.627 ************************************ 00:05:14.627 START TEST non_locking_app_on_locked_coremask 00:05:14.627 ************************************ 00:05:14.627 08:13:00 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:14.627 08:13:00 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=843507 00:05:14.627 08:13:00 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.627 08:13:00 -- event/cpu_locks.sh@81 -- # waitforlisten 843507 /var/tmp/spdk.sock 00:05:14.627 08:13:00 -- common/autotest_common.sh@829 -- # '[' -z 843507 ']' 00:05:14.627 08:13:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.627 08:13:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.627 08:13:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.627 08:13:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.627 08:13:00 -- common/autotest_common.sh@10 -- # set +x 00:05:14.627 [2024-11-26 08:13:00.255232] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.627 [2024-11-26 08:13:00.255347] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843507 ] 00:05:14.627 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.627 [2024-11-26 08:13:00.329575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.627 [2024-11-26 08:13:00.473779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.627 [2024-11-26 08:13:00.474008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.565 08:13:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.565 08:13:01 -- common/autotest_common.sh@862 -- # return 0 00:05:15.565 08:13:01 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=843649 00:05:15.565 08:13:01 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:15.565 08:13:01 -- event/cpu_locks.sh@85 -- # waitforlisten 843649 /var/tmp/spdk2.sock 00:05:15.565 08:13:01 -- common/autotest_common.sh@829 -- # '[' -z 843649 ']' 00:05:15.565 08:13:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.565 08:13:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.565 08:13:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.565 08:13:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.565 08:13:01 -- common/autotest_common.sh@10 -- # set +x 00:05:15.565 [2024-11-26 08:13:01.407101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.565 [2024-11-26 08:13:01.407193] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843649 ] 00:05:15.824 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.824 [2024-11-26 08:13:01.488475] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.824 [2024-11-26 08:13:01.488501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.083 [2024-11-26 08:13:01.696000] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.083 [2024-11-26 08:13:01.696185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.650 08:13:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.650 08:13:02 -- common/autotest_common.sh@862 -- # return 0 00:05:16.650 08:13:02 -- event/cpu_locks.sh@87 -- # locks_exist 843507 00:05:16.650 08:13:02 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:16.650 08:13:02 -- event/cpu_locks.sh@22 -- # lslocks -p 843507 00:05:16.908 lslocks: write error 00:05:16.908 08:13:02 -- event/cpu_locks.sh@89 -- # killprocess 843507 00:05:16.908 08:13:02 -- common/autotest_common.sh@936 -- # '[' -z 843507 ']' 00:05:16.908 08:13:02 -- common/autotest_common.sh@940 -- # kill -0 843507 00:05:16.908 08:13:02 -- common/autotest_common.sh@941 -- # uname 00:05:16.908 08:13:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.908 08:13:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843507 00:05:17.168 08:13:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:17.168 08:13:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:17.168 08:13:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843507' 00:05:17.168 killing process with pid 843507 00:05:17.168 08:13:02 -- common/autotest_common.sh@955 -- # kill 843507 00:05:17.168 08:13:02 -- common/autotest_common.sh@960 -- # wait 843507 00:05:18.104 08:13:03 -- event/cpu_locks.sh@90 -- # killprocess 843649 00:05:18.104 08:13:03 -- common/autotest_common.sh@936 -- # '[' -z 843649 ']' 00:05:18.104 08:13:03 -- common/autotest_common.sh@940 -- # kill -0 843649 00:05:18.104 08:13:03 -- common/autotest_common.sh@941 -- # uname 00:05:18.104 08:13:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.104 08:13:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843649 00:05:18.104 08:13:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.104 08:13:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.104 08:13:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843649' 00:05:18.104 killing process with pid 843649 00:05:18.104 08:13:03 -- common/autotest_common.sh@955 -- # kill 843649 00:05:18.104 08:13:03 -- common/autotest_common.sh@960 -- # wait 843649 00:05:18.364 00:05:18.364 real 0m4.001s 00:05:18.364 user 0m4.505s 00:05:18.364 sys 0m1.098s 00:05:18.364 08:13:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.364 08:13:04 -- common/autotest_common.sh@10 -- # set +x 00:05:18.364 ************************************ 00:05:18.364 END TEST non_locking_app_on_locked_coremask 00:05:18.364 ************************************ 00:05:18.623 08:13:04 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:18.623 08:13:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.623 08:13:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.623 08:13:04 -- common/autotest_common.sh@10 -- # set +x 00:05:18.623 ************************************ 00:05:18.623 START TEST locking_app_on_unlocked_coremask 00:05:18.623 ************************************ 00:05:18.623 08:13:04 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:18.623 08:13:04 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=844083 00:05:18.623 08:13:04 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:18.623 08:13:04 -- event/cpu_locks.sh@99 -- # waitforlisten 844083 /var/tmp/spdk.sock 00:05:18.623 08:13:04 -- common/autotest_common.sh@829 -- # '[' -z 844083 ']' 00:05:18.623 08:13:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.623 08:13:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.623 08:13:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.623 08:13:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.623 08:13:04 -- common/autotest_common.sh@10 -- # set +x 00:05:18.623 [2024-11-26 08:13:04.285543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.623 [2024-11-26 08:13:04.285624] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844083 ] 00:05:18.623 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.623 [2024-11-26 08:13:04.346397] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.623 [2024-11-26 08:13:04.346443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.623 [2024-11-26 08:13:04.457263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.623 [2024-11-26 08:13:04.457451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.558 08:13:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.558 08:13:05 -- common/autotest_common.sh@862 -- # return 0 00:05:19.558 08:13:05 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=844225 00:05:19.558 08:13:05 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:19.558 08:13:05 -- event/cpu_locks.sh@103 -- # waitforlisten 844225 /var/tmp/spdk2.sock 00:05:19.558 08:13:05 -- common/autotest_common.sh@829 -- # '[' -z 844225 ']' 00:05:19.558 08:13:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:19.558 08:13:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.558 08:13:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:19.558 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:19.558 08:13:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.558 08:13:05 -- common/autotest_common.sh@10 -- # set +x 00:05:19.558 [2024-11-26 08:13:05.267882] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.558 [2024-11-26 08:13:05.267954] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844225 ] 00:05:19.558 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.558 [2024-11-26 08:13:05.362496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.817 [2024-11-26 08:13:05.594120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.817 [2024-11-26 08:13:05.594325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.384 08:13:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.384 08:13:06 -- common/autotest_common.sh@862 -- # return 0 00:05:20.384 08:13:06 -- event/cpu_locks.sh@105 -- # locks_exist 844225 00:05:20.384 08:13:06 -- event/cpu_locks.sh@22 -- # lslocks -p 844225 00:05:20.384 08:13:06 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:20.951 lslocks: write error 00:05:20.951 08:13:06 -- event/cpu_locks.sh@107 -- # killprocess 844083 00:05:20.951 08:13:06 -- common/autotest_common.sh@936 -- # '[' -z 844083 ']' 00:05:20.951 08:13:06 -- common/autotest_common.sh@940 -- # kill -0 844083 00:05:20.951 08:13:06 -- common/autotest_common.sh@941 -- # uname 00:05:20.951 08:13:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.951 08:13:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 844083 00:05:20.951 08:13:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.951 08:13:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.951 08:13:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 844083' 00:05:20.951 killing process with pid 844083 00:05:20.951 08:13:06 -- common/autotest_common.sh@955 -- # kill 844083 00:05:20.951 08:13:06 -- common/autotest_common.sh@960 -- # wait 844083 00:05:21.885 08:13:07 -- event/cpu_locks.sh@108 -- # killprocess 844225 00:05:21.885 08:13:07 -- common/autotest_common.sh@936 -- # '[' -z 844225 ']' 00:05:21.885 08:13:07 -- common/autotest_common.sh@940 -- # kill -0 844225 00:05:21.885 08:13:07 -- common/autotest_common.sh@941 -- # uname 00:05:21.886 08:13:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.886 08:13:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 844225 00:05:22.143 08:13:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:22.143 08:13:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:22.143 08:13:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 844225' 00:05:22.143 killing process with pid 844225 00:05:22.143 08:13:07 -- common/autotest_common.sh@955 -- # kill 844225 00:05:22.143 08:13:07 -- common/autotest_common.sh@960 -- # wait 844225 00:05:22.402 00:05:22.402 real 0m3.967s 00:05:22.402 user 0m4.320s 00:05:22.402 sys 0m1.092s 00:05:22.402 08:13:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.402 08:13:08 -- common/autotest_common.sh@10 -- # set +x 00:05:22.402 ************************************ 00:05:22.402 END TEST locking_app_on_unlocked_coremask 00:05:22.402 ************************************ 00:05:22.402 08:13:08 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:22.402 08:13:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.402 08:13:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.402 08:13:08 -- common/autotest_common.sh@10 -- # set +x 00:05:22.402 ************************************ 00:05:22.402 START TEST locking_app_on_locked_coremask 00:05:22.402 ************************************ 00:05:22.402 08:13:08 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:22.402 08:13:08 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=844630 00:05:22.402 08:13:08 -- event/cpu_locks.sh@116 -- # waitforlisten 844630 /var/tmp/spdk.sock 00:05:22.402 08:13:08 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:22.402 08:13:08 -- common/autotest_common.sh@829 -- # '[' -z 844630 ']' 00:05:22.402 08:13:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.402 08:13:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.402 08:13:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.402 08:13:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.402 08:13:08 -- common/autotest_common.sh@10 -- # set +x 00:05:22.661 [2024-11-26 08:13:08.279900] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.661 [2024-11-26 08:13:08.279992] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844630 ] 00:05:22.661 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.661 [2024-11-26 08:13:08.342156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.661 [2024-11-26 08:13:08.459502] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.661 [2024-11-26 08:13:08.459673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.594 08:13:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.594 08:13:09 -- common/autotest_common.sh@862 -- # return 0 00:05:23.594 08:13:09 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=844696 00:05:23.594 08:13:09 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:23.594 08:13:09 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 844696 /var/tmp/spdk2.sock 00:05:23.594 08:13:09 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.594 08:13:09 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 844696 /var/tmp/spdk2.sock 00:05:23.594 08:13:09 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:23.594 08:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.594 08:13:09 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:23.594 08:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.594 08:13:09 -- common/autotest_common.sh@653 -- # waitforlisten 844696 /var/tmp/spdk2.sock 00:05:23.594 08:13:09 -- common/autotest_common.sh@829 -- # '[' -z 844696 ']' 00:05:23.594 08:13:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:23.594 08:13:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.594 08:13:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:23.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:23.594 08:13:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.594 08:13:09 -- common/autotest_common.sh@10 -- # set +x 00:05:23.594 [2024-11-26 08:13:09.268120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.594 [2024-11-26 08:13:09.268190] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844696 ] 00:05:23.594 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.594 [2024-11-26 08:13:09.365009] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 844630 has claimed it. 00:05:23.594 [2024-11-26 08:13:09.365079] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:24.159 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (844696) - No such process 00:05:24.159 ERROR: process (pid: 844696) is no longer running 00:05:24.159 08:13:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:24.159 08:13:09 -- common/autotest_common.sh@862 -- # return 1 00:05:24.159 08:13:09 -- common/autotest_common.sh@653 -- # es=1 00:05:24.159 08:13:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:24.159 08:13:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:24.159 08:13:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:24.159 08:13:09 -- event/cpu_locks.sh@122 -- # locks_exist 844630 00:05:24.159 08:13:09 -- event/cpu_locks.sh@22 -- # lslocks -p 844630 00:05:24.159 08:13:09 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:24.417 lslocks: write error 00:05:24.417 08:13:10 -- event/cpu_locks.sh@124 -- # killprocess 844630 00:05:24.417 08:13:10 -- common/autotest_common.sh@936 -- # '[' -z 844630 ']' 00:05:24.417 08:13:10 -- common/autotest_common.sh@940 -- # kill -0 844630 00:05:24.417 08:13:10 -- common/autotest_common.sh@941 -- # uname 00:05:24.417 08:13:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.417 08:13:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 844630 00:05:24.675 08:13:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.675 08:13:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.675 08:13:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 844630' 00:05:24.675 killing process with pid 844630 00:05:24.675 08:13:10 -- common/autotest_common.sh@955 -- # kill 844630 00:05:24.675 08:13:10 -- common/autotest_common.sh@960 -- # wait 844630 00:05:24.934 00:05:24.934 real 0m2.503s 00:05:24.934 user 0m2.863s 00:05:24.934 sys 0m0.659s 00:05:24.934 08:13:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.934 08:13:10 -- common/autotest_common.sh@10 -- # set +x 00:05:24.934 ************************************ 00:05:24.934 END TEST locking_app_on_locked_coremask 00:05:24.934 ************************************ 00:05:24.934 08:13:10 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:24.934 08:13:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.934 08:13:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.934 08:13:10 -- common/autotest_common.sh@10 -- # set +x 00:05:24.934 ************************************ 00:05:24.934 START TEST locking_overlapped_coremask 00:05:24.934 ************************************ 00:05:24.934 08:13:10 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:24.934 08:13:10 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=844991 00:05:24.934 08:13:10 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:24.934 08:13:10 -- event/cpu_locks.sh@133 -- # waitforlisten 844991 /var/tmp/spdk.sock 00:05:24.934 08:13:10 -- common/autotest_common.sh@829 -- # '[' -z 844991 ']' 00:05:24.934 08:13:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.934 08:13:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.934 08:13:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.934 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.934 08:13:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.934 08:13:10 -- common/autotest_common.sh@10 -- # set +x 00:05:25.191 [2024-11-26 08:13:10.808484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.191 [2024-11-26 08:13:10.808590] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844991 ] 00:05:25.191 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.191 [2024-11-26 08:13:10.871368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:25.191 [2024-11-26 08:13:10.990328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.191 [2024-11-26 08:13:10.990572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:25.191 [2024-11-26 08:13:10.990643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:25.191 [2024-11-26 08:13:10.990646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.124 08:13:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.124 08:13:11 -- common/autotest_common.sh@862 -- # return 0 00:05:26.124 08:13:11 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=845133 00:05:26.124 08:13:11 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 845133 /var/tmp/spdk2.sock 00:05:26.124 08:13:11 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:26.124 08:13:11 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.124 08:13:11 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 845133 /var/tmp/spdk2.sock 00:05:26.124 08:13:11 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:26.124 08:13:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.124 08:13:11 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:26.124 08:13:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.124 08:13:11 -- common/autotest_common.sh@653 -- # waitforlisten 845133 /var/tmp/spdk2.sock 00:05:26.124 08:13:11 -- common/autotest_common.sh@829 -- # '[' -z 845133 ']' 00:05:26.124 08:13:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.124 08:13:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.124 08:13:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.124 08:13:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.124 08:13:11 -- common/autotest_common.sh@10 -- # set +x 00:05:26.124 [2024-11-26 08:13:11.852714] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.124 [2024-11-26 08:13:11.852788] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845133 ] 00:05:26.124 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.124 [2024-11-26 08:13:11.941491] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 844991 has claimed it. 00:05:26.124 [2024-11-26 08:13:11.941553] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:27.058 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (845133) - No such process 00:05:27.058 ERROR: process (pid: 845133) is no longer running 00:05:27.058 08:13:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.058 08:13:12 -- common/autotest_common.sh@862 -- # return 1 00:05:27.058 08:13:12 -- common/autotest_common.sh@653 -- # es=1 00:05:27.058 08:13:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.058 08:13:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:27.058 08:13:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.058 08:13:12 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:27.058 08:13:12 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:27.058 08:13:12 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:27.058 08:13:12 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:27.058 08:13:12 -- event/cpu_locks.sh@141 -- # killprocess 844991 00:05:27.058 08:13:12 -- common/autotest_common.sh@936 -- # '[' -z 844991 ']' 00:05:27.058 08:13:12 -- common/autotest_common.sh@940 -- # kill -0 844991 00:05:27.058 08:13:12 -- common/autotest_common.sh@941 -- # uname 00:05:27.058 08:13:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.058 08:13:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 844991 00:05:27.058 08:13:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.058 08:13:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.058 08:13:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 844991' 00:05:27.058 killing process with pid 844991 00:05:27.058 08:13:12 -- common/autotest_common.sh@955 -- # kill 844991 00:05:27.058 08:13:12 -- common/autotest_common.sh@960 -- # wait 844991 00:05:27.316 00:05:27.316 real 0m2.273s 00:05:27.316 user 0m6.454s 00:05:27.316 sys 0m0.493s 00:05:27.316 08:13:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.316 08:13:13 -- common/autotest_common.sh@10 -- # set +x 00:05:27.316 ************************************ 00:05:27.316 END TEST locking_overlapped_coremask 00:05:27.316 ************************************ 00:05:27.316 08:13:13 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:27.316 08:13:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.316 08:13:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.316 08:13:13 -- common/autotest_common.sh@10 -- # set +x 00:05:27.316 ************************************ 00:05:27.316 START TEST locking_overlapped_coremask_via_rpc 00:05:27.316 ************************************ 00:05:27.316 08:13:13 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:27.316 08:13:13 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=845298 00:05:27.316 08:13:13 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:27.316 08:13:13 -- event/cpu_locks.sh@149 -- # waitforlisten 845298 /var/tmp/spdk.sock 00:05:27.316 08:13:13 -- common/autotest_common.sh@829 -- # '[' -z 845298 ']' 00:05:27.316 08:13:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:27.316 08:13:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.316 08:13:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:27.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:27.316 08:13:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.316 08:13:13 -- common/autotest_common.sh@10 -- # set +x 00:05:27.316 [2024-11-26 08:13:13.112132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.316 [2024-11-26 08:13:13.112214] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845298 ] 00:05:27.316 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.574 [2024-11-26 08:13:13.173405] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:27.574 [2024-11-26 08:13:13.173451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:27.574 [2024-11-26 08:13:13.286052] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.574 [2024-11-26 08:13:13.286290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:27.574 [2024-11-26 08:13:13.286364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:27.574 [2024-11-26 08:13:13.286367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.504 08:13:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.504 08:13:14 -- common/autotest_common.sh@862 -- # return 0 00:05:28.504 08:13:14 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=845441 00:05:28.504 08:13:14 -- event/cpu_locks.sh@153 -- # waitforlisten 845441 /var/tmp/spdk2.sock 00:05:28.504 08:13:14 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:28.504 08:13:14 -- common/autotest_common.sh@829 -- # '[' -z 845441 ']' 00:05:28.504 08:13:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:28.504 08:13:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.504 08:13:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:28.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:28.504 08:13:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.504 08:13:14 -- common/autotest_common.sh@10 -- # set +x 00:05:28.504 [2024-11-26 08:13:14.104849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.504 [2024-11-26 08:13:14.104927] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845441 ] 00:05:28.504 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.504 [2024-11-26 08:13:14.191473] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:28.504 [2024-11-26 08:13:14.191516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:28.761 [2024-11-26 08:13:14.407283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.761 [2024-11-26 08:13:14.407522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:28.761 [2024-11-26 08:13:14.410748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:28.761 [2024-11-26 08:13:14.410751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:29.325 08:13:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.325 08:13:15 -- common/autotest_common.sh@862 -- # return 0 00:05:29.325 08:13:15 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:29.325 08:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:29.325 08:13:15 -- common/autotest_common.sh@10 -- # set +x 00:05:29.325 08:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:29.325 08:13:15 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.325 08:13:15 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.325 08:13:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.325 08:13:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:29.325 08:13:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.325 08:13:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:29.325 08:13:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.325 08:13:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.325 08:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:29.325 08:13:15 -- common/autotest_common.sh@10 -- # set +x 00:05:29.325 [2024-11-26 08:13:15.082788] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 845298 has claimed it. 00:05:29.325 request: 00:05:29.325 { 00:05:29.325 "method": "framework_enable_cpumask_locks", 00:05:29.325 "req_id": 1 00:05:29.325 } 00:05:29.325 Got JSON-RPC error response 00:05:29.325 response: 00:05:29.325 { 00:05:29.325 "code": -32603, 00:05:29.325 "message": "Failed to claim CPU core: 2" 00:05:29.325 } 00:05:29.325 08:13:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:29.325 08:13:15 -- common/autotest_common.sh@653 -- # es=1 00:05:29.325 08:13:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:29.325 08:13:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:29.325 08:13:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:29.325 08:13:15 -- event/cpu_locks.sh@158 -- # waitforlisten 845298 /var/tmp/spdk.sock 00:05:29.325 08:13:15 -- common/autotest_common.sh@829 -- # '[' -z 845298 ']' 00:05:29.325 08:13:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:29.325 08:13:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.325 08:13:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:29.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:29.325 08:13:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.325 08:13:15 -- common/autotest_common.sh@10 -- # set +x 00:05:29.583 08:13:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.583 08:13:15 -- common/autotest_common.sh@862 -- # return 0 00:05:29.583 08:13:15 -- event/cpu_locks.sh@159 -- # waitforlisten 845441 /var/tmp/spdk2.sock 00:05:29.583 08:13:15 -- common/autotest_common.sh@829 -- # '[' -z 845441 ']' 00:05:29.583 08:13:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.583 08:13:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.583 08:13:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.583 08:13:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.583 08:13:15 -- common/autotest_common.sh@10 -- # set +x 00:05:29.841 08:13:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.841 08:13:15 -- common/autotest_common.sh@862 -- # return 0 00:05:29.841 08:13:15 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:29.841 08:13:15 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:29.841 08:13:15 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:29.841 08:13:15 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:29.841 00:05:29.841 real 0m2.537s 00:05:29.841 user 0m1.256s 00:05:29.841 sys 0m0.206s 00:05:29.841 08:13:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.841 08:13:15 -- common/autotest_common.sh@10 -- # set +x 00:05:29.841 ************************************ 00:05:29.841 END TEST locking_overlapped_coremask_via_rpc 00:05:29.841 ************************************ 00:05:29.841 08:13:15 -- event/cpu_locks.sh@174 -- # cleanup 00:05:29.841 08:13:15 -- event/cpu_locks.sh@15 -- # [[ -z 845298 ]] 00:05:29.841 08:13:15 -- event/cpu_locks.sh@15 -- # killprocess 845298 00:05:29.841 08:13:15 -- common/autotest_common.sh@936 -- # '[' -z 845298 ']' 00:05:29.841 08:13:15 -- common/autotest_common.sh@940 -- # kill -0 845298 00:05:29.841 08:13:15 -- common/autotest_common.sh@941 -- # uname 00:05:29.841 08:13:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.841 08:13:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 845298 00:05:29.841 08:13:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.841 08:13:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.841 08:13:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 845298' 00:05:29.841 killing process with pid 845298 00:05:29.841 08:13:15 -- common/autotest_common.sh@955 -- # kill 845298 00:05:29.841 08:13:15 -- common/autotest_common.sh@960 -- # wait 845298 00:05:30.409 08:13:16 -- event/cpu_locks.sh@16 -- # [[ -z 845441 ]] 00:05:30.409 08:13:16 -- event/cpu_locks.sh@16 -- # killprocess 845441 00:05:30.409 08:13:16 -- common/autotest_common.sh@936 -- # '[' -z 845441 ']' 00:05:30.409 08:13:16 -- common/autotest_common.sh@940 -- # kill -0 845441 00:05:30.409 08:13:16 -- common/autotest_common.sh@941 -- # uname 00:05:30.409 08:13:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.409 08:13:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 845441 00:05:30.409 08:13:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:30.409 08:13:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:30.409 08:13:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 845441' 00:05:30.409 killing process with pid 845441 00:05:30.409 08:13:16 -- common/autotest_common.sh@955 -- # kill 845441 00:05:30.409 08:13:16 -- common/autotest_common.sh@960 -- # wait 845441 00:05:30.975 08:13:16 -- event/cpu_locks.sh@18 -- # rm -f 00:05:30.975 08:13:16 -- event/cpu_locks.sh@1 -- # cleanup 00:05:30.975 08:13:16 -- event/cpu_locks.sh@15 -- # [[ -z 845298 ]] 00:05:30.975 08:13:16 -- event/cpu_locks.sh@15 -- # killprocess 845298 00:05:30.975 08:13:16 -- common/autotest_common.sh@936 -- # '[' -z 845298 ']' 00:05:30.975 08:13:16 -- common/autotest_common.sh@940 -- # kill -0 845298 00:05:30.975 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (845298) - No such process 00:05:30.975 08:13:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 845298 is not found' 00:05:30.975 Process with pid 845298 is not found 00:05:30.975 08:13:16 -- event/cpu_locks.sh@16 -- # [[ -z 845441 ]] 00:05:30.975 08:13:16 -- event/cpu_locks.sh@16 -- # killprocess 845441 00:05:30.975 08:13:16 -- common/autotest_common.sh@936 -- # '[' -z 845441 ']' 00:05:30.975 08:13:16 -- common/autotest_common.sh@940 -- # kill -0 845441 00:05:30.975 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (845441) - No such process 00:05:30.975 08:13:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 845441 is not found' 00:05:30.975 Process with pid 845441 is not found 00:05:30.975 08:13:16 -- event/cpu_locks.sh@18 -- # rm -f 00:05:30.975 00:05:30.975 real 0m20.220s 00:05:30.975 user 0m36.054s 00:05:30.975 sys 0m5.535s 00:05:30.975 08:13:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.975 08:13:16 -- common/autotest_common.sh@10 -- # set +x 00:05:30.975 ************************************ 00:05:30.975 END TEST cpu_locks 00:05:30.975 ************************************ 00:05:30.975 00:05:30.975 real 0m48.583s 00:05:30.975 user 1m33.995s 00:05:30.975 sys 0m9.411s 00:05:30.975 08:13:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.975 08:13:16 -- common/autotest_common.sh@10 -- # set +x 00:05:30.975 ************************************ 00:05:30.975 END TEST event 00:05:30.975 ************************************ 00:05:30.975 08:13:16 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:30.975 08:13:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.975 08:13:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.975 08:13:16 -- common/autotest_common.sh@10 -- # set +x 00:05:30.975 ************************************ 00:05:30.975 START TEST thread 00:05:30.975 ************************************ 00:05:30.975 08:13:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:30.975 * Looking for test storage... 00:05:30.975 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:30.975 08:13:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:30.975 08:13:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:30.975 08:13:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:30.975 08:13:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:30.975 08:13:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:30.975 08:13:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:30.975 08:13:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:30.975 08:13:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:30.975 08:13:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:30.975 08:13:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:30.975 08:13:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:30.975 08:13:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:30.975 08:13:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:30.975 08:13:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:30.975 08:13:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:30.975 08:13:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:30.975 08:13:16 -- scripts/common.sh@344 -- # : 1 00:05:30.975 08:13:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:30.975 08:13:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:30.975 08:13:16 -- scripts/common.sh@364 -- # decimal 1 00:05:30.975 08:13:16 -- scripts/common.sh@352 -- # local d=1 00:05:30.975 08:13:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:30.975 08:13:16 -- scripts/common.sh@354 -- # echo 1 00:05:30.975 08:13:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:30.975 08:13:16 -- scripts/common.sh@365 -- # decimal 2 00:05:30.975 08:13:16 -- scripts/common.sh@352 -- # local d=2 00:05:30.976 08:13:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:30.976 08:13:16 -- scripts/common.sh@354 -- # echo 2 00:05:30.976 08:13:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:30.976 08:13:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:30.976 08:13:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:30.976 08:13:16 -- scripts/common.sh@367 -- # return 0 00:05:30.976 08:13:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:30.976 08:13:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:30.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.976 --rc genhtml_branch_coverage=1 00:05:30.976 --rc genhtml_function_coverage=1 00:05:30.976 --rc genhtml_legend=1 00:05:30.976 --rc geninfo_all_blocks=1 00:05:30.976 --rc geninfo_unexecuted_blocks=1 00:05:30.976 00:05:30.976 ' 00:05:30.976 08:13:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:30.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.976 --rc genhtml_branch_coverage=1 00:05:30.976 --rc genhtml_function_coverage=1 00:05:30.976 --rc genhtml_legend=1 00:05:30.976 --rc geninfo_all_blocks=1 00:05:30.976 --rc geninfo_unexecuted_blocks=1 00:05:30.976 00:05:30.976 ' 00:05:30.976 08:13:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:30.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.976 --rc genhtml_branch_coverage=1 00:05:30.976 --rc genhtml_function_coverage=1 00:05:30.976 --rc genhtml_legend=1 00:05:30.976 --rc geninfo_all_blocks=1 00:05:30.976 --rc geninfo_unexecuted_blocks=1 00:05:30.976 00:05:30.976 ' 00:05:30.976 08:13:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:30.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.976 --rc genhtml_branch_coverage=1 00:05:30.976 --rc genhtml_function_coverage=1 00:05:30.976 --rc genhtml_legend=1 00:05:30.976 --rc geninfo_all_blocks=1 00:05:30.976 --rc geninfo_unexecuted_blocks=1 00:05:30.976 00:05:30.976 ' 00:05:30.976 08:13:16 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:30.976 08:13:16 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:30.976 08:13:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.976 08:13:16 -- common/autotest_common.sh@10 -- # set +x 00:05:30.976 ************************************ 00:05:30.976 START TEST thread_poller_perf 00:05:30.976 ************************************ 00:05:30.976 08:13:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:30.976 [2024-11-26 08:13:16.800356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.976 [2024-11-26 08:13:16.800445] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845822 ] 00:05:30.976 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.234 [2024-11-26 08:13:16.864189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.234 [2024-11-26 08:13:16.978532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.234 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:32.611 [2024-11-26T07:13:18.471Z] ====================================== 00:05:32.611 [2024-11-26T07:13:18.471Z] busy:2713964291 (cyc) 00:05:32.612 [2024-11-26T07:13:18.472Z] total_run_count: 280000 00:05:32.612 [2024-11-26T07:13:18.472Z] tsc_hz: 2700000000 (cyc) 00:05:32.612 [2024-11-26T07:13:18.472Z] ====================================== 00:05:32.612 [2024-11-26T07:13:18.472Z] poller_cost: 9692 (cyc), 3589 (nsec) 00:05:32.612 00:05:32.612 real 0m1.325s 00:05:32.612 user 0m1.232s 00:05:32.612 sys 0m0.086s 00:05:32.612 08:13:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.612 08:13:18 -- common/autotest_common.sh@10 -- # set +x 00:05:32.612 ************************************ 00:05:32.612 END TEST thread_poller_perf 00:05:32.612 ************************************ 00:05:32.612 08:13:18 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:32.612 08:13:18 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:32.612 08:13:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.612 08:13:18 -- common/autotest_common.sh@10 -- # set +x 00:05:32.612 ************************************ 00:05:32.612 START TEST thread_poller_perf 00:05:32.612 ************************************ 00:05:32.612 08:13:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:32.612 [2024-11-26 08:13:18.154295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.612 [2024-11-26 08:13:18.154372] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845979 ] 00:05:32.612 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.612 [2024-11-26 08:13:18.218269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.612 [2024-11-26 08:13:18.334735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.612 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:33.986 [2024-11-26T07:13:19.846Z] ====================================== 00:05:33.986 [2024-11-26T07:13:19.846Z] busy:2703414426 (cyc) 00:05:33.986 [2024-11-26T07:13:19.846Z] total_run_count: 3835000 00:05:33.987 [2024-11-26T07:13:19.847Z] tsc_hz: 2700000000 (cyc) 00:05:33.987 [2024-11-26T07:13:19.847Z] ====================================== 00:05:33.987 [2024-11-26T07:13:19.847Z] poller_cost: 704 (cyc), 260 (nsec) 00:05:33.987 00:05:33.987 real 0m1.316s 00:05:33.987 user 0m1.220s 00:05:33.987 sys 0m0.089s 00:05:33.987 08:13:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.987 08:13:19 -- common/autotest_common.sh@10 -- # set +x 00:05:33.987 ************************************ 00:05:33.987 END TEST thread_poller_perf 00:05:33.987 ************************************ 00:05:33.987 08:13:19 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:33.987 00:05:33.987 real 0m2.835s 00:05:33.987 user 0m2.574s 00:05:33.987 sys 0m0.264s 00:05:33.987 08:13:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.987 08:13:19 -- common/autotest_common.sh@10 -- # set +x 00:05:33.987 ************************************ 00:05:33.987 END TEST thread 00:05:33.987 ************************************ 00:05:33.987 08:13:19 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:33.987 08:13:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.987 08:13:19 -- common/autotest_common.sh@10 -- # set +x 00:05:33.987 ************************************ 00:05:33.987 START TEST accel 00:05:33.987 ************************************ 00:05:33.987 08:13:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:33.987 * Looking for test storage... 00:05:33.987 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:33.987 08:13:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.987 08:13:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.987 08:13:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.987 08:13:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.987 08:13:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.987 08:13:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.987 08:13:19 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.987 08:13:19 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.987 08:13:19 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.987 08:13:19 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.987 08:13:19 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.987 08:13:19 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.987 08:13:19 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.987 08:13:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.987 08:13:19 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.987 08:13:19 -- scripts/common.sh@344 -- # : 1 00:05:33.987 08:13:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.987 08:13:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.987 08:13:19 -- scripts/common.sh@364 -- # decimal 1 00:05:33.987 08:13:19 -- scripts/common.sh@352 -- # local d=1 00:05:33.987 08:13:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.987 08:13:19 -- scripts/common.sh@354 -- # echo 1 00:05:33.987 08:13:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.987 08:13:19 -- scripts/common.sh@365 -- # decimal 2 00:05:33.987 08:13:19 -- scripts/common.sh@352 -- # local d=2 00:05:33.987 08:13:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.987 08:13:19 -- scripts/common.sh@354 -- # echo 2 00:05:33.987 08:13:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.987 08:13:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.987 08:13:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.987 08:13:19 -- scripts/common.sh@367 -- # return 0 00:05:33.987 08:13:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.987 --rc genhtml_branch_coverage=1 00:05:33.987 --rc genhtml_function_coverage=1 00:05:33.987 --rc genhtml_legend=1 00:05:33.987 --rc geninfo_all_blocks=1 00:05:33.987 --rc geninfo_unexecuted_blocks=1 00:05:33.987 00:05:33.987 ' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.987 --rc genhtml_branch_coverage=1 00:05:33.987 --rc genhtml_function_coverage=1 00:05:33.987 --rc genhtml_legend=1 00:05:33.987 --rc geninfo_all_blocks=1 00:05:33.987 --rc geninfo_unexecuted_blocks=1 00:05:33.987 00:05:33.987 ' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.987 --rc genhtml_branch_coverage=1 00:05:33.987 --rc genhtml_function_coverage=1 00:05:33.987 --rc genhtml_legend=1 00:05:33.987 --rc geninfo_all_blocks=1 00:05:33.987 --rc geninfo_unexecuted_blocks=1 00:05:33.987 00:05:33.987 ' 00:05:33.987 08:13:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.987 --rc genhtml_branch_coverage=1 00:05:33.987 --rc genhtml_function_coverage=1 00:05:33.987 --rc genhtml_legend=1 00:05:33.987 --rc geninfo_all_blocks=1 00:05:33.987 --rc geninfo_unexecuted_blocks=1 00:05:33.987 00:05:33.987 ' 00:05:33.987 08:13:19 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:33.987 08:13:19 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:33.987 08:13:19 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:33.987 08:13:19 -- accel/accel.sh@59 -- # spdk_tgt_pid=846303 00:05:33.987 08:13:19 -- accel/accel.sh@60 -- # waitforlisten 846303 00:05:33.987 08:13:19 -- common/autotest_common.sh@829 -- # '[' -z 846303 ']' 00:05:33.987 08:13:19 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:33.987 08:13:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.987 08:13:19 -- accel/accel.sh@58 -- # build_accel_config 00:05:33.987 08:13:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.987 08:13:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.987 08:13:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.987 08:13:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.987 08:13:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.987 08:13:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.987 08:13:19 -- common/autotest_common.sh@10 -- # set +x 00:05:33.987 08:13:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.987 08:13:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.987 08:13:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.987 08:13:19 -- accel/accel.sh@42 -- # jq -r . 00:05:33.987 [2024-11-26 08:13:19.680372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.987 [2024-11-26 08:13:19.680467] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846303 ] 00:05:33.987 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.987 [2024-11-26 08:13:19.742449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.246 [2024-11-26 08:13:19.856345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.246 [2024-11-26 08:13:19.856523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.809 08:13:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.809 08:13:20 -- common/autotest_common.sh@862 -- # return 0 00:05:34.809 08:13:20 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:34.809 08:13:20 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:34.809 08:13:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.809 08:13:20 -- common/autotest_common.sh@10 -- # set +x 00:05:34.809 08:13:20 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:34.809 08:13:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # IFS== 00:05:35.067 08:13:20 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.067 08:13:20 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.067 08:13:20 -- accel/accel.sh@67 -- # killprocess 846303 00:05:35.067 08:13:20 -- common/autotest_common.sh@936 -- # '[' -z 846303 ']' 00:05:35.067 08:13:20 -- common/autotest_common.sh@940 -- # kill -0 846303 00:05:35.067 08:13:20 -- common/autotest_common.sh@941 -- # uname 00:05:35.067 08:13:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.067 08:13:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 846303 00:05:35.067 08:13:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.067 08:13:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.067 08:13:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 846303' 00:05:35.067 killing process with pid 846303 00:05:35.067 08:13:20 -- common/autotest_common.sh@955 -- # kill 846303 00:05:35.067 08:13:20 -- common/autotest_common.sh@960 -- # wait 846303 00:05:35.632 08:13:21 -- accel/accel.sh@68 -- # trap - ERR 00:05:35.632 08:13:21 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:35.632 08:13:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:35.632 08:13:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.632 08:13:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.632 08:13:21 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:35.632 08:13:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:35.632 08:13:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.632 08:13:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.632 08:13:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.632 08:13:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.632 08:13:21 -- accel/accel.sh@42 -- # jq -r . 00:05:35.632 08:13:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.632 08:13:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.632 08:13:21 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:35.632 08:13:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.632 08:13:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.632 08:13:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.632 ************************************ 00:05:35.632 START TEST accel_missing_filename 00:05:35.632 ************************************ 00:05:35.632 08:13:21 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:35.632 08:13:21 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.632 08:13:21 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:35.632 08:13:21 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.632 08:13:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.632 08:13:21 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.632 08:13:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.632 08:13:21 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:35.632 08:13:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:35.632 08:13:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.632 08:13:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.632 08:13:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.632 08:13:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.632 08:13:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.632 08:13:21 -- accel/accel.sh@42 -- # jq -r . 00:05:35.632 [2024-11-26 08:13:21.251504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.632 [2024-11-26 08:13:21.251592] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846484 ] 00:05:35.632 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.632 [2024-11-26 08:13:21.316703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.632 [2024-11-26 08:13:21.432378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.890 [2024-11-26 08:13:21.494265] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.890 [2024-11-26 08:13:21.581864] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:35.890 A filename is required. 00:05:35.890 08:13:21 -- common/autotest_common.sh@653 -- # es=234 00:05:35.890 08:13:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.890 08:13:21 -- common/autotest_common.sh@662 -- # es=106 00:05:35.890 08:13:21 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:35.890 08:13:21 -- common/autotest_common.sh@670 -- # es=1 00:05:35.890 08:13:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.890 00:05:35.890 real 0m0.469s 00:05:35.890 user 0m0.349s 00:05:35.890 sys 0m0.156s 00:05:35.890 08:13:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.890 08:13:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.890 ************************************ 00:05:35.890 END TEST accel_missing_filename 00:05:35.890 ************************************ 00:05:35.890 08:13:21 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.890 08:13:21 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:35.890 08:13:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.890 08:13:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.890 ************************************ 00:05:35.890 START TEST accel_compress_verify 00:05:35.890 ************************************ 00:05:35.890 08:13:21 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.890 08:13:21 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.890 08:13:21 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.890 08:13:21 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.890 08:13:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.890 08:13:21 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.890 08:13:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.890 08:13:21 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.890 08:13:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.890 08:13:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.890 08:13:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.890 08:13:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.890 08:13:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.890 08:13:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.890 08:13:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.890 08:13:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.890 08:13:21 -- accel/accel.sh@42 -- # jq -r . 00:05:36.147 [2024-11-26 08:13:21.747724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.147 [2024-11-26 08:13:21.747811] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846570 ] 00:05:36.147 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.147 [2024-11-26 08:13:21.810300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.147 [2024-11-26 08:13:21.926698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.147 [2024-11-26 08:13:21.986136] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:36.404 [2024-11-26 08:13:22.060111] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.404 00:05:36.404 Compression does not support the verify option, aborting. 00:05:36.404 08:13:22 -- common/autotest_common.sh@653 -- # es=161 00:05:36.404 08:13:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.404 08:13:22 -- common/autotest_common.sh@662 -- # es=33 00:05:36.404 08:13:22 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:36.404 08:13:22 -- common/autotest_common.sh@670 -- # es=1 00:05:36.404 08:13:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.404 00:05:36.404 real 0m0.456s 00:05:36.404 user 0m0.345s 00:05:36.404 sys 0m0.143s 00:05:36.404 08:13:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.404 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.405 ************************************ 00:05:36.405 END TEST accel_compress_verify 00:05:36.405 ************************************ 00:05:36.405 08:13:22 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:36.405 08:13:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:36.405 08:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.405 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.405 ************************************ 00:05:36.405 START TEST accel_wrong_workload 00:05:36.405 ************************************ 00:05:36.405 08:13:22 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:36.405 08:13:22 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.405 08:13:22 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:36.405 08:13:22 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.405 08:13:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.405 08:13:22 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.405 08:13:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.405 08:13:22 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:36.405 08:13:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:36.405 08:13:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.405 08:13:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.405 08:13:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.405 08:13:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.405 08:13:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.405 08:13:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.405 08:13:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.405 08:13:22 -- accel/accel.sh@42 -- # jq -r . 00:05:36.405 Unsupported workload type: foobar 00:05:36.405 [2024-11-26 08:13:22.232108] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:36.405 accel_perf options: 00:05:36.405 [-h help message] 00:05:36.405 [-q queue depth per core] 00:05:36.405 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.405 [-T number of threads per core 00:05:36.405 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.405 [-t time in seconds] 00:05:36.405 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.405 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.405 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.405 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.405 [-S for crc32c workload, use this seed value (default 0) 00:05:36.405 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.405 [-f for fill workload, use this BYTE value (default 255) 00:05:36.405 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.405 [-y verify result if this switch is on] 00:05:36.405 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.405 Can be used to spread operations across a wider range of memory. 00:05:36.405 08:13:22 -- common/autotest_common.sh@653 -- # es=1 00:05:36.405 08:13:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.405 08:13:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.405 08:13:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.405 00:05:36.405 real 0m0.024s 00:05:36.405 user 0m0.017s 00:05:36.405 sys 0m0.007s 00:05:36.405 08:13:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.405 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.405 ************************************ 00:05:36.405 END TEST accel_wrong_workload 00:05:36.405 ************************************ 00:05:36.405 Error: writing output failed: Broken pipe 00:05:36.405 08:13:22 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.405 08:13:22 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:36.405 08:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.405 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.662 ************************************ 00:05:36.662 START TEST accel_negative_buffers 00:05:36.662 ************************************ 00:05:36.662 08:13:22 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.662 08:13:22 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.663 08:13:22 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:36.663 08:13:22 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.663 08:13:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.663 08:13:22 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.663 08:13:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.663 08:13:22 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:36.663 08:13:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:36.663 08:13:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.663 08:13:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.663 08:13:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.663 08:13:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.663 08:13:22 -- accel/accel.sh@42 -- # jq -r . 00:05:36.663 -x option must be non-negative. 00:05:36.663 [2024-11-26 08:13:22.282826] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:36.663 accel_perf options: 00:05:36.663 [-h help message] 00:05:36.663 [-q queue depth per core] 00:05:36.663 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.663 [-T number of threads per core 00:05:36.663 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.663 [-t time in seconds] 00:05:36.663 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.663 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.663 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.663 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.663 [-S for crc32c workload, use this seed value (default 0) 00:05:36.663 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.663 [-f for fill workload, use this BYTE value (default 255) 00:05:36.663 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.663 [-y verify result if this switch is on] 00:05:36.663 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.663 Can be used to spread operations across a wider range of memory. 00:05:36.663 08:13:22 -- common/autotest_common.sh@653 -- # es=1 00:05:36.663 08:13:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.663 08:13:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.663 08:13:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.663 00:05:36.663 real 0m0.025s 00:05:36.663 user 0m0.014s 00:05:36.663 sys 0m0.011s 00:05:36.663 08:13:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.663 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.663 ************************************ 00:05:36.663 END TEST accel_negative_buffers 00:05:36.663 ************************************ 00:05:36.663 Error: writing output failed: Broken pipe 00:05:36.663 08:13:22 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:36.663 08:13:22 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:36.663 08:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.663 08:13:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.663 ************************************ 00:05:36.663 START TEST accel_crc32c 00:05:36.663 ************************************ 00:05:36.663 08:13:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:36.663 08:13:22 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.663 08:13:22 -- accel/accel.sh@17 -- # local accel_module 00:05:36.663 08:13:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:36.663 08:13:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:36.663 08:13:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.663 08:13:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.663 08:13:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.663 08:13:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.663 08:13:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.663 08:13:22 -- accel/accel.sh@42 -- # jq -r . 00:05:36.663 [2024-11-26 08:13:22.326936] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.663 [2024-11-26 08:13:22.327003] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846691 ] 00:05:36.663 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.663 [2024-11-26 08:13:22.388885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.663 [2024-11-26 08:13:22.504896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.063 08:13:23 -- accel/accel.sh@18 -- # out=' 00:05:38.063 SPDK Configuration: 00:05:38.063 Core mask: 0x1 00:05:38.064 00:05:38.064 Accel Perf Configuration: 00:05:38.064 Workload Type: crc32c 00:05:38.064 CRC-32C seed: 32 00:05:38.064 Transfer size: 4096 bytes 00:05:38.064 Vector count 1 00:05:38.064 Module: software 00:05:38.064 Queue depth: 32 00:05:38.064 Allocate depth: 32 00:05:38.064 # threads/core: 1 00:05:38.064 Run time: 1 seconds 00:05:38.064 Verify: Yes 00:05:38.064 00:05:38.064 Running for 1 seconds... 00:05:38.064 00:05:38.064 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.064 ------------------------------------------------------------------------------------ 00:05:38.064 0,0 404736/s 1581 MiB/s 0 0 00:05:38.064 ==================================================================================== 00:05:38.064 Total 404736/s 1581 MiB/s 0 0' 00:05:38.064 08:13:23 -- accel/accel.sh@20 -- # IFS=: 00:05:38.064 08:13:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:38.064 08:13:23 -- accel/accel.sh@20 -- # read -r var val 00:05:38.064 08:13:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:38.064 08:13:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.064 08:13:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.064 08:13:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.064 08:13:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.064 08:13:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.064 08:13:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.064 08:13:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.064 08:13:23 -- accel/accel.sh@42 -- # jq -r . 00:05:38.064 [2024-11-26 08:13:23.799333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.064 [2024-11-26 08:13:23.799427] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846839 ] 00:05:38.064 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.064 [2024-11-26 08:13:23.862146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.322 [2024-11-26 08:13:23.976413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=0x1 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=crc32c 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=32 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=software 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=32 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=32 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=1 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val=Yes 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:38.322 08:13:24 -- accel/accel.sh@21 -- # val= 00:05:38.322 08:13:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # IFS=: 00:05:38.322 08:13:24 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@21 -- # val= 00:05:39.695 08:13:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # IFS=: 00:05:39.695 08:13:25 -- accel/accel.sh@20 -- # read -r var val 00:05:39.695 08:13:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.695 08:13:25 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:39.695 08:13:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.695 00:05:39.695 real 0m2.935s 00:05:39.695 user 0m2.648s 00:05:39.695 sys 0m0.280s 00:05:39.695 08:13:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.695 08:13:25 -- common/autotest_common.sh@10 -- # set +x 00:05:39.695 ************************************ 00:05:39.695 END TEST accel_crc32c 00:05:39.695 ************************************ 00:05:39.695 08:13:25 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:39.695 08:13:25 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.695 08:13:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.695 08:13:25 -- common/autotest_common.sh@10 -- # set +x 00:05:39.695 ************************************ 00:05:39.695 START TEST accel_crc32c_C2 00:05:39.695 ************************************ 00:05:39.695 08:13:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:39.695 08:13:25 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.695 08:13:25 -- accel/accel.sh@17 -- # local accel_module 00:05:39.695 08:13:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.695 08:13:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.695 08:13:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.695 08:13:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.695 08:13:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.695 08:13:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.695 08:13:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.695 08:13:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.695 08:13:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.695 08:13:25 -- accel/accel.sh@42 -- # jq -r . 00:05:39.695 [2024-11-26 08:13:25.286957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.695 [2024-11-26 08:13:25.287069] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847119 ] 00:05:39.695 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.695 [2024-11-26 08:13:25.347719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.695 [2024-11-26 08:13:25.462155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.072 08:13:26 -- accel/accel.sh@18 -- # out=' 00:05:41.072 SPDK Configuration: 00:05:41.072 Core mask: 0x1 00:05:41.072 00:05:41.072 Accel Perf Configuration: 00:05:41.072 Workload Type: crc32c 00:05:41.072 CRC-32C seed: 0 00:05:41.072 Transfer size: 4096 bytes 00:05:41.072 Vector count 2 00:05:41.072 Module: software 00:05:41.072 Queue depth: 32 00:05:41.072 Allocate depth: 32 00:05:41.072 # threads/core: 1 00:05:41.072 Run time: 1 seconds 00:05:41.072 Verify: Yes 00:05:41.072 00:05:41.072 Running for 1 seconds... 00:05:41.072 00:05:41.072 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.072 ------------------------------------------------------------------------------------ 00:05:41.072 0,0 315776/s 2467 MiB/s 0 0 00:05:41.072 ==================================================================================== 00:05:41.072 Total 315776/s 1233 MiB/s 0 0' 00:05:41.072 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.072 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.072 08:13:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:41.072 08:13:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:41.072 08:13:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.072 08:13:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.072 08:13:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.072 08:13:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.072 08:13:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.072 08:13:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.072 08:13:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.072 08:13:26 -- accel/accel.sh@42 -- # jq -r . 00:05:41.072 [2024-11-26 08:13:26.740178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.073 [2024-11-26 08:13:26.740259] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847264 ] 00:05:41.073 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.073 [2024-11-26 08:13:26.802874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.073 [2024-11-26 08:13:26.915499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=0x1 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=crc32c 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=0 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=software 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=32 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=32 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val=1 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.331 08:13:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.331 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.331 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.332 08:13:26 -- accel/accel.sh@21 -- # val=Yes 00:05:41.332 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.332 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.332 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:41.332 08:13:26 -- accel/accel.sh@21 -- # val= 00:05:41.332 08:13:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # IFS=: 00:05:41.332 08:13:26 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@21 -- # val= 00:05:42.706 08:13:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # IFS=: 00:05:42.706 08:13:28 -- accel/accel.sh@20 -- # read -r var val 00:05:42.706 08:13:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.706 08:13:28 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:42.706 08:13:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.706 00:05:42.706 real 0m2.929s 00:05:42.706 user 0m2.645s 00:05:42.706 sys 0m0.275s 00:05:42.706 08:13:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.706 08:13:28 -- common/autotest_common.sh@10 -- # set +x 00:05:42.706 ************************************ 00:05:42.706 END TEST accel_crc32c_C2 00:05:42.706 ************************************ 00:05:42.706 08:13:28 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:42.706 08:13:28 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:42.706 08:13:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.706 08:13:28 -- common/autotest_common.sh@10 -- # set +x 00:05:42.706 ************************************ 00:05:42.706 START TEST accel_copy 00:05:42.706 ************************************ 00:05:42.706 08:13:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:42.706 08:13:28 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.706 08:13:28 -- accel/accel.sh@17 -- # local accel_module 00:05:42.706 08:13:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:42.706 08:13:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:42.706 08:13:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.706 08:13:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.706 08:13:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.706 08:13:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.706 08:13:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.706 08:13:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.706 08:13:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.706 08:13:28 -- accel/accel.sh@42 -- # jq -r . 00:05:42.706 [2024-11-26 08:13:28.235709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.706 [2024-11-26 08:13:28.235809] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847423 ] 00:05:42.706 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.706 [2024-11-26 08:13:28.295722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.706 [2024-11-26 08:13:28.412942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.078 08:13:29 -- accel/accel.sh@18 -- # out=' 00:05:44.078 SPDK Configuration: 00:05:44.078 Core mask: 0x1 00:05:44.078 00:05:44.078 Accel Perf Configuration: 00:05:44.078 Workload Type: copy 00:05:44.078 Transfer size: 4096 bytes 00:05:44.078 Vector count 1 00:05:44.078 Module: software 00:05:44.078 Queue depth: 32 00:05:44.078 Allocate depth: 32 00:05:44.078 # threads/core: 1 00:05:44.078 Run time: 1 seconds 00:05:44.078 Verify: Yes 00:05:44.078 00:05:44.078 Running for 1 seconds... 00:05:44.078 00:05:44.078 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.078 ------------------------------------------------------------------------------------ 00:05:44.078 0,0 278048/s 1086 MiB/s 0 0 00:05:44.078 ==================================================================================== 00:05:44.078 Total 278048/s 1086 MiB/s 0 0' 00:05:44.078 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.078 08:13:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:44.078 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.078 08:13:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:44.078 08:13:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.078 08:13:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.078 08:13:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.078 08:13:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.078 08:13:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.079 08:13:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.079 08:13:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.079 08:13:29 -- accel/accel.sh@42 -- # jq -r . 00:05:44.079 [2024-11-26 08:13:29.700826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.079 [2024-11-26 08:13:29.700917] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847687 ] 00:05:44.079 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.079 [2024-11-26 08:13:29.763571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.079 [2024-11-26 08:13:29.880896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=0x1 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=copy 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=software 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=32 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=32 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=1 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val=Yes 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:44.337 08:13:29 -- accel/accel.sh@21 -- # val= 00:05:44.337 08:13:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # IFS=: 00:05:44.337 08:13:29 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@21 -- # val= 00:05:45.712 08:13:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # IFS=: 00:05:45.712 08:13:31 -- accel/accel.sh@20 -- # read -r var val 00:05:45.712 08:13:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.712 08:13:31 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:45.712 08:13:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.712 00:05:45.712 real 0m2.933s 00:05:45.712 user 0m2.631s 00:05:45.712 sys 0m0.291s 00:05:45.712 08:13:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.712 08:13:31 -- common/autotest_common.sh@10 -- # set +x 00:05:45.712 ************************************ 00:05:45.712 END TEST accel_copy 00:05:45.712 ************************************ 00:05:45.712 08:13:31 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.712 08:13:31 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:45.712 08:13:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.712 08:13:31 -- common/autotest_common.sh@10 -- # set +x 00:05:45.712 ************************************ 00:05:45.712 START TEST accel_fill 00:05:45.712 ************************************ 00:05:45.712 08:13:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.712 08:13:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.712 08:13:31 -- accel/accel.sh@17 -- # local accel_module 00:05:45.712 08:13:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.712 08:13:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.712 08:13:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.712 08:13:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.712 08:13:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.712 08:13:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.712 08:13:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.712 08:13:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.712 08:13:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.712 08:13:31 -- accel/accel.sh@42 -- # jq -r . 00:05:45.712 [2024-11-26 08:13:31.195012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.712 [2024-11-26 08:13:31.195111] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847851 ] 00:05:45.712 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.712 [2024-11-26 08:13:31.256621] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.712 [2024-11-26 08:13:31.372351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.088 08:13:32 -- accel/accel.sh@18 -- # out=' 00:05:47.088 SPDK Configuration: 00:05:47.088 Core mask: 0x1 00:05:47.088 00:05:47.088 Accel Perf Configuration: 00:05:47.088 Workload Type: fill 00:05:47.088 Fill pattern: 0x80 00:05:47.088 Transfer size: 4096 bytes 00:05:47.088 Vector count 1 00:05:47.088 Module: software 00:05:47.088 Queue depth: 64 00:05:47.088 Allocate depth: 64 00:05:47.088 # threads/core: 1 00:05:47.088 Run time: 1 seconds 00:05:47.088 Verify: Yes 00:05:47.088 00:05:47.088 Running for 1 seconds... 00:05:47.088 00:05:47.088 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.088 ------------------------------------------------------------------------------------ 00:05:47.088 0,0 402112/s 1570 MiB/s 0 0 00:05:47.088 ==================================================================================== 00:05:47.088 Total 402112/s 1570 MiB/s 0 0' 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:47.088 08:13:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.088 08:13:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.088 08:13:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.088 08:13:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.088 08:13:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.088 08:13:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.088 08:13:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.088 08:13:32 -- accel/accel.sh@42 -- # jq -r . 00:05:47.088 [2024-11-26 08:13:32.669494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.088 [2024-11-26 08:13:32.669585] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847991 ] 00:05:47.088 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.088 [2024-11-26 08:13:32.731230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.088 [2024-11-26 08:13:32.846573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=0x1 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=fill 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=0x80 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=software 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=64 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=64 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=1 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val=Yes 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:47.088 08:13:32 -- accel/accel.sh@21 -- # val= 00:05:47.088 08:13:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # IFS=: 00:05:47.088 08:13:32 -- accel/accel.sh@20 -- # read -r var val 00:05:48.463 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@21 -- # val= 00:05:48.464 08:13:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # IFS=: 00:05:48.464 08:13:34 -- accel/accel.sh@20 -- # read -r var val 00:05:48.464 08:13:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.464 08:13:34 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:48.464 08:13:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.464 00:05:48.464 real 0m2.945s 00:05:48.464 user 0m2.660s 00:05:48.464 sys 0m0.276s 00:05:48.464 08:13:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.464 08:13:34 -- common/autotest_common.sh@10 -- # set +x 00:05:48.464 ************************************ 00:05:48.464 END TEST accel_fill 00:05:48.464 ************************************ 00:05:48.464 08:13:34 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:48.464 08:13:34 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.464 08:13:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.464 08:13:34 -- common/autotest_common.sh@10 -- # set +x 00:05:48.464 ************************************ 00:05:48.464 START TEST accel_copy_crc32c 00:05:48.464 ************************************ 00:05:48.464 08:13:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:48.464 08:13:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.464 08:13:34 -- accel/accel.sh@17 -- # local accel_module 00:05:48.464 08:13:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:48.464 08:13:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:48.464 08:13:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.464 08:13:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.464 08:13:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.464 08:13:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.464 08:13:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.464 08:13:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.464 08:13:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.464 08:13:34 -- accel/accel.sh@42 -- # jq -r . 00:05:48.464 [2024-11-26 08:13:34.161485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.464 [2024-11-26 08:13:34.161566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid848262 ] 00:05:48.464 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.464 [2024-11-26 08:13:34.223396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.723 [2024-11-26 08:13:34.339732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.097 08:13:35 -- accel/accel.sh@18 -- # out=' 00:05:50.097 SPDK Configuration: 00:05:50.097 Core mask: 0x1 00:05:50.097 00:05:50.097 Accel Perf Configuration: 00:05:50.097 Workload Type: copy_crc32c 00:05:50.097 CRC-32C seed: 0 00:05:50.097 Vector size: 4096 bytes 00:05:50.097 Transfer size: 4096 bytes 00:05:50.097 Vector count 1 00:05:50.097 Module: software 00:05:50.097 Queue depth: 32 00:05:50.097 Allocate depth: 32 00:05:50.097 # threads/core: 1 00:05:50.097 Run time: 1 seconds 00:05:50.097 Verify: Yes 00:05:50.097 00:05:50.097 Running for 1 seconds... 00:05:50.097 00:05:50.097 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.097 ------------------------------------------------------------------------------------ 00:05:50.097 0,0 219968/s 859 MiB/s 0 0 00:05:50.097 ==================================================================================== 00:05:50.097 Total 219968/s 859 MiB/s 0 0' 00:05:50.097 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.097 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.097 08:13:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:50.097 08:13:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:50.097 08:13:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.097 08:13:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.097 08:13:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.097 08:13:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.097 08:13:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.097 08:13:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.097 08:13:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.097 08:13:35 -- accel/accel.sh@42 -- # jq -r . 00:05:50.098 [2024-11-26 08:13:35.631792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.098 [2024-11-26 08:13:35.631886] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid848418 ] 00:05:50.098 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.098 [2024-11-26 08:13:35.692362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.098 [2024-11-26 08:13:35.807763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=0x1 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=0 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=software 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=32 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=32 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=1 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val=Yes 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:50.098 08:13:35 -- accel/accel.sh@21 -- # val= 00:05:50.098 08:13:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # IFS=: 00:05:50.098 08:13:35 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@21 -- # val= 00:05:51.473 08:13:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # IFS=: 00:05:51.473 08:13:37 -- accel/accel.sh@20 -- # read -r var val 00:05:51.473 08:13:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.473 08:13:37 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:51.473 08:13:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.473 00:05:51.473 real 0m2.939s 00:05:51.473 user 0m2.639s 00:05:51.473 sys 0m0.290s 00:05:51.473 08:13:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.473 08:13:37 -- common/autotest_common.sh@10 -- # set +x 00:05:51.473 ************************************ 00:05:51.473 END TEST accel_copy_crc32c 00:05:51.473 ************************************ 00:05:51.473 08:13:37 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:51.473 08:13:37 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:51.473 08:13:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.473 08:13:37 -- common/autotest_common.sh@10 -- # set +x 00:05:51.473 ************************************ 00:05:51.473 START TEST accel_copy_crc32c_C2 00:05:51.473 ************************************ 00:05:51.473 08:13:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:51.473 08:13:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.473 08:13:37 -- accel/accel.sh@17 -- # local accel_module 00:05:51.473 08:13:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:51.473 08:13:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:51.473 08:13:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.473 08:13:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.473 08:13:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.473 08:13:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.473 08:13:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.473 08:13:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.473 08:13:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.473 08:13:37 -- accel/accel.sh@42 -- # jq -r . 00:05:51.473 [2024-11-26 08:13:37.124218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.473 [2024-11-26 08:13:37.124309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid848578 ] 00:05:51.473 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.473 [2024-11-26 08:13:37.188388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.473 [2024-11-26 08:13:37.304449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.901 08:13:38 -- accel/accel.sh@18 -- # out=' 00:05:52.901 SPDK Configuration: 00:05:52.901 Core mask: 0x1 00:05:52.901 00:05:52.901 Accel Perf Configuration: 00:05:52.901 Workload Type: copy_crc32c 00:05:52.901 CRC-32C seed: 0 00:05:52.901 Vector size: 4096 bytes 00:05:52.901 Transfer size: 8192 bytes 00:05:52.901 Vector count 2 00:05:52.901 Module: software 00:05:52.901 Queue depth: 32 00:05:52.901 Allocate depth: 32 00:05:52.901 # threads/core: 1 00:05:52.901 Run time: 1 seconds 00:05:52.901 Verify: Yes 00:05:52.901 00:05:52.901 Running for 1 seconds... 00:05:52.901 00:05:52.901 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:52.901 ------------------------------------------------------------------------------------ 00:05:52.901 0,0 153152/s 1196 MiB/s 0 0 00:05:52.901 ==================================================================================== 00:05:52.901 Total 153152/s 598 MiB/s 0 0' 00:05:52.901 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:52.901 08:13:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:52.901 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:52.901 08:13:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:52.901 08:13:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.901 08:13:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.901 08:13:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.901 08:13:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.901 08:13:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.901 08:13:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.901 08:13:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.901 08:13:38 -- accel/accel.sh@42 -- # jq -r . 00:05:52.901 [2024-11-26 08:13:38.606928] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.901 [2024-11-26 08:13:38.607026] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid848729 ] 00:05:52.901 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.901 [2024-11-26 08:13:38.668268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.160 [2024-11-26 08:13:38.789892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=0x1 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=0 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=software 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=32 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=32 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=1 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val=Yes 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:53.160 08:13:38 -- accel/accel.sh@21 -- # val= 00:05:53.160 08:13:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # IFS=: 00:05:53.160 08:13:38 -- accel/accel.sh@20 -- # read -r var val 00:05:54.534 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@21 -- # val= 00:05:54.535 08:13:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # IFS=: 00:05:54.535 08:13:40 -- accel/accel.sh@20 -- # read -r var val 00:05:54.535 08:13:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.535 08:13:40 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:54.535 08:13:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.535 00:05:54.535 real 0m2.961s 00:05:54.535 user 0m2.653s 00:05:54.535 sys 0m0.299s 00:05:54.535 08:13:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.535 08:13:40 -- common/autotest_common.sh@10 -- # set +x 00:05:54.535 ************************************ 00:05:54.535 END TEST accel_copy_crc32c_C2 00:05:54.535 ************************************ 00:05:54.535 08:13:40 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:54.535 08:13:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:54.535 08:13:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.535 08:13:40 -- common/autotest_common.sh@10 -- # set +x 00:05:54.535 ************************************ 00:05:54.535 START TEST accel_dualcast 00:05:54.535 ************************************ 00:05:54.535 08:13:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:54.535 08:13:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.535 08:13:40 -- accel/accel.sh@17 -- # local accel_module 00:05:54.535 08:13:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:54.535 08:13:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:54.535 08:13:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.535 08:13:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.535 08:13:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.535 08:13:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.535 08:13:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.535 08:13:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.535 08:13:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.535 08:13:40 -- accel/accel.sh@42 -- # jq -r . 00:05:54.535 [2024-11-26 08:13:40.107926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.535 [2024-11-26 08:13:40.108012] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849002 ] 00:05:54.535 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.535 [2024-11-26 08:13:40.174092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.535 [2024-11-26 08:13:40.298727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.908 08:13:41 -- accel/accel.sh@18 -- # out=' 00:05:55.908 SPDK Configuration: 00:05:55.908 Core mask: 0x1 00:05:55.908 00:05:55.908 Accel Perf Configuration: 00:05:55.908 Workload Type: dualcast 00:05:55.908 Transfer size: 4096 bytes 00:05:55.909 Vector count 1 00:05:55.909 Module: software 00:05:55.909 Queue depth: 32 00:05:55.909 Allocate depth: 32 00:05:55.909 # threads/core: 1 00:05:55.909 Run time: 1 seconds 00:05:55.909 Verify: Yes 00:05:55.909 00:05:55.909 Running for 1 seconds... 00:05:55.909 00:05:55.909 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.909 ------------------------------------------------------------------------------------ 00:05:55.909 0,0 298080/s 1164 MiB/s 0 0 00:05:55.909 ==================================================================================== 00:05:55.909 Total 298080/s 1164 MiB/s 0 0' 00:05:55.909 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:55.909 08:13:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:55.909 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:55.909 08:13:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:55.909 08:13:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.909 08:13:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.909 08:13:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.909 08:13:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.909 08:13:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.909 08:13:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.909 08:13:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.909 08:13:41 -- accel/accel.sh@42 -- # jq -r . 00:05:55.909 [2024-11-26 08:13:41.591588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.909 [2024-11-26 08:13:41.591683] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849146 ] 00:05:55.909 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.909 [2024-11-26 08:13:41.657483] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.167 [2024-11-26 08:13:41.777652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=0x1 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=dualcast 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=software 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=32 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=32 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=1 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val=Yes 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:56.167 08:13:41 -- accel/accel.sh@21 -- # val= 00:05:56.167 08:13:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # IFS=: 00:05:56.167 08:13:41 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@21 -- # val= 00:05:57.542 08:13:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # IFS=: 00:05:57.542 08:13:43 -- accel/accel.sh@20 -- # read -r var val 00:05:57.542 08:13:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.542 08:13:43 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:57.542 08:13:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.542 00:05:57.542 real 0m2.973s 00:05:57.542 user 0m2.661s 00:05:57.542 sys 0m0.303s 00:05:57.542 08:13:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.542 08:13:43 -- common/autotest_common.sh@10 -- # set +x 00:05:57.542 ************************************ 00:05:57.542 END TEST accel_dualcast 00:05:57.542 ************************************ 00:05:57.542 08:13:43 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:57.542 08:13:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:57.542 08:13:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.542 08:13:43 -- common/autotest_common.sh@10 -- # set +x 00:05:57.542 ************************************ 00:05:57.542 START TEST accel_compare 00:05:57.542 ************************************ 00:05:57.542 08:13:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:57.542 08:13:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.542 08:13:43 -- accel/accel.sh@17 -- # local accel_module 00:05:57.542 08:13:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:57.542 08:13:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:57.542 08:13:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.542 08:13:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.542 08:13:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.542 08:13:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.542 08:13:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.542 08:13:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.542 08:13:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.542 08:13:43 -- accel/accel.sh@42 -- # jq -r . 00:05:57.542 [2024-11-26 08:13:43.104942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.542 [2024-11-26 08:13:43.105044] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849305 ] 00:05:57.542 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.542 [2024-11-26 08:13:43.169795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.542 [2024-11-26 08:13:43.289619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.917 08:13:44 -- accel/accel.sh@18 -- # out=' 00:05:58.917 SPDK Configuration: 00:05:58.917 Core mask: 0x1 00:05:58.917 00:05:58.917 Accel Perf Configuration: 00:05:58.917 Workload Type: compare 00:05:58.917 Transfer size: 4096 bytes 00:05:58.917 Vector count 1 00:05:58.917 Module: software 00:05:58.917 Queue depth: 32 00:05:58.917 Allocate depth: 32 00:05:58.917 # threads/core: 1 00:05:58.917 Run time: 1 seconds 00:05:58.917 Verify: Yes 00:05:58.917 00:05:58.917 Running for 1 seconds... 00:05:58.917 00:05:58.917 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.917 ------------------------------------------------------------------------------------ 00:05:58.917 0,0 398016/s 1554 MiB/s 0 0 00:05:58.917 ==================================================================================== 00:05:58.917 Total 398016/s 1554 MiB/s 0 0' 00:05:58.917 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:58.917 08:13:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:58.917 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:58.917 08:13:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:58.917 08:13:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.917 08:13:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.917 08:13:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.917 08:13:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.917 08:13:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.917 08:13:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.917 08:13:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.917 08:13:44 -- accel/accel.sh@42 -- # jq -r . 00:05:58.917 [2024-11-26 08:13:44.583636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.917 [2024-11-26 08:13:44.583753] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849568 ] 00:05:58.917 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.917 [2024-11-26 08:13:44.647369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.917 [2024-11-26 08:13:44.765730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=0x1 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=compare 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=software 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=32 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=32 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=1 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val=Yes 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:05:59.176 08:13:44 -- accel/accel.sh@21 -- # val= 00:05:59.176 08:13:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # IFS=: 00:05:59.176 08:13:44 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@21 -- # val= 00:06:00.550 08:13:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # IFS=: 00:06:00.550 08:13:46 -- accel/accel.sh@20 -- # read -r var val 00:06:00.550 08:13:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.550 08:13:46 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:00.550 08:13:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.550 00:06:00.550 real 0m2.947s 00:06:00.550 user 0m2.650s 00:06:00.550 sys 0m0.289s 00:06:00.550 08:13:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.550 08:13:46 -- common/autotest_common.sh@10 -- # set +x 00:06:00.550 ************************************ 00:06:00.550 END TEST accel_compare 00:06:00.550 ************************************ 00:06:00.550 08:13:46 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:00.550 08:13:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:00.550 08:13:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.550 08:13:46 -- common/autotest_common.sh@10 -- # set +x 00:06:00.550 ************************************ 00:06:00.550 START TEST accel_xor 00:06:00.550 ************************************ 00:06:00.550 08:13:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:00.550 08:13:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.550 08:13:46 -- accel/accel.sh@17 -- # local accel_module 00:06:00.550 08:13:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:00.550 08:13:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:00.550 08:13:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.550 08:13:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.550 08:13:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.550 08:13:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.550 08:13:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.550 08:13:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.550 08:13:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.550 08:13:46 -- accel/accel.sh@42 -- # jq -r . 00:06:00.550 [2024-11-26 08:13:46.078170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.550 [2024-11-26 08:13:46.078264] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849727 ] 00:06:00.550 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.550 [2024-11-26 08:13:46.144654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.550 [2024-11-26 08:13:46.265038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.925 08:13:47 -- accel/accel.sh@18 -- # out=' 00:06:01.925 SPDK Configuration: 00:06:01.925 Core mask: 0x1 00:06:01.925 00:06:01.925 Accel Perf Configuration: 00:06:01.925 Workload Type: xor 00:06:01.925 Source buffers: 2 00:06:01.925 Transfer size: 4096 bytes 00:06:01.925 Vector count 1 00:06:01.925 Module: software 00:06:01.925 Queue depth: 32 00:06:01.925 Allocate depth: 32 00:06:01.925 # threads/core: 1 00:06:01.925 Run time: 1 seconds 00:06:01.925 Verify: Yes 00:06:01.925 00:06:01.925 Running for 1 seconds... 00:06:01.925 00:06:01.925 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:01.925 ------------------------------------------------------------------------------------ 00:06:01.925 0,0 189856/s 741 MiB/s 0 0 00:06:01.925 ==================================================================================== 00:06:01.925 Total 189856/s 741 MiB/s 0 0' 00:06:01.925 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:01.925 08:13:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:01.925 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:01.925 08:13:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:01.925 08:13:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.925 08:13:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.925 08:13:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.925 08:13:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.925 08:13:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.925 08:13:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.925 08:13:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.925 08:13:47 -- accel/accel.sh@42 -- # jq -r . 00:06:01.925 [2024-11-26 08:13:47.568181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.925 [2024-11-26 08:13:47.568276] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid849873 ] 00:06:01.925 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.925 [2024-11-26 08:13:47.630583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.925 [2024-11-26 08:13:47.749774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=0x1 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=xor 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=2 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=software 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=32 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=32 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=1 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val=Yes 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:02.184 08:13:47 -- accel/accel.sh@21 -- # val= 00:06:02.184 08:13:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # IFS=: 00:06:02.184 08:13:47 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@21 -- # val= 00:06:03.558 08:13:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # IFS=: 00:06:03.558 08:13:49 -- accel/accel.sh@20 -- # read -r var val 00:06:03.558 08:13:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.558 08:13:49 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:03.558 08:13:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.558 00:06:03.558 real 0m2.964s 00:06:03.558 user 0m2.659s 00:06:03.558 sys 0m0.296s 00:06:03.558 08:13:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.558 08:13:49 -- common/autotest_common.sh@10 -- # set +x 00:06:03.558 ************************************ 00:06:03.558 END TEST accel_xor 00:06:03.558 ************************************ 00:06:03.558 08:13:49 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:03.558 08:13:49 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:03.558 08:13:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.558 08:13:49 -- common/autotest_common.sh@10 -- # set +x 00:06:03.558 ************************************ 00:06:03.558 START TEST accel_xor 00:06:03.558 ************************************ 00:06:03.558 08:13:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:03.558 08:13:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.558 08:13:49 -- accel/accel.sh@17 -- # local accel_module 00:06:03.558 08:13:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:03.558 08:13:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:03.558 08:13:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.558 08:13:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.558 08:13:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.558 08:13:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.558 08:13:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.558 08:13:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.558 08:13:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.558 08:13:49 -- accel/accel.sh@42 -- # jq -r . 00:06:03.558 [2024-11-26 08:13:49.072891] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.558 [2024-11-26 08:13:49.072976] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850147 ] 00:06:03.558 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.558 [2024-11-26 08:13:49.137312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.558 [2024-11-26 08:13:49.254621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.932 08:13:50 -- accel/accel.sh@18 -- # out=' 00:06:04.932 SPDK Configuration: 00:06:04.932 Core mask: 0x1 00:06:04.932 00:06:04.932 Accel Perf Configuration: 00:06:04.932 Workload Type: xor 00:06:04.932 Source buffers: 3 00:06:04.932 Transfer size: 4096 bytes 00:06:04.932 Vector count 1 00:06:04.932 Module: software 00:06:04.932 Queue depth: 32 00:06:04.932 Allocate depth: 32 00:06:04.932 # threads/core: 1 00:06:04.932 Run time: 1 seconds 00:06:04.932 Verify: Yes 00:06:04.932 00:06:04.932 Running for 1 seconds... 00:06:04.932 00:06:04.932 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.932 ------------------------------------------------------------------------------------ 00:06:04.932 0,0 182496/s 712 MiB/s 0 0 00:06:04.932 ==================================================================================== 00:06:04.932 Total 182496/s 712 MiB/s 0 0' 00:06:04.932 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:04.932 08:13:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:04.932 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:04.932 08:13:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:04.932 08:13:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.932 08:13:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.932 08:13:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.932 08:13:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.932 08:13:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.932 08:13:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.932 08:13:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.932 08:13:50 -- accel/accel.sh@42 -- # jq -r . 00:06:04.932 [2024-11-26 08:13:50.558108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.932 [2024-11-26 08:13:50.558199] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850296 ] 00:06:04.932 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.932 [2024-11-26 08:13:50.620072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.932 [2024-11-26 08:13:50.737349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val=0x1 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val=xor 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val=3 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.190 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.190 08:13:50 -- accel/accel.sh@21 -- # val=software 00:06:05.190 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val=32 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val=32 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val=1 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val=Yes 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:05.191 08:13:50 -- accel/accel.sh@21 -- # val= 00:06:05.191 08:13:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # IFS=: 00:06:05.191 08:13:50 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@21 -- # val= 00:06:06.566 08:13:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # IFS=: 00:06:06.566 08:13:52 -- accel/accel.sh@20 -- # read -r var val 00:06:06.566 08:13:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.566 08:13:52 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:06.566 08:13:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.566 00:06:06.566 real 0m2.969s 00:06:06.566 user 0m2.672s 00:06:06.566 sys 0m0.288s 00:06:06.566 08:13:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.566 08:13:52 -- common/autotest_common.sh@10 -- # set +x 00:06:06.566 ************************************ 00:06:06.566 END TEST accel_xor 00:06:06.566 ************************************ 00:06:06.566 08:13:52 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:06.566 08:13:52 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:06.566 08:13:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.566 08:13:52 -- common/autotest_common.sh@10 -- # set +x 00:06:06.566 ************************************ 00:06:06.566 START TEST accel_dif_verify 00:06:06.566 ************************************ 00:06:06.566 08:13:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:06.566 08:13:52 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.566 08:13:52 -- accel/accel.sh@17 -- # local accel_module 00:06:06.566 08:13:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:06.566 08:13:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:06.566 08:13:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.566 08:13:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.566 08:13:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.566 08:13:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.566 08:13:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.566 08:13:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.566 08:13:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.566 08:13:52 -- accel/accel.sh@42 -- # jq -r . 00:06:06.566 [2024-11-26 08:13:52.066150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.566 [2024-11-26 08:13:52.066244] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850454 ] 00:06:06.566 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.566 [2024-11-26 08:13:52.127250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.566 [2024-11-26 08:13:52.250097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.994 08:13:53 -- accel/accel.sh@18 -- # out=' 00:06:07.994 SPDK Configuration: 00:06:07.994 Core mask: 0x1 00:06:07.994 00:06:07.994 Accel Perf Configuration: 00:06:07.994 Workload Type: dif_verify 00:06:07.994 Vector size: 4096 bytes 00:06:07.994 Transfer size: 4096 bytes 00:06:07.994 Block size: 512 bytes 00:06:07.994 Metadata size: 8 bytes 00:06:07.994 Vector count 1 00:06:07.994 Module: software 00:06:07.994 Queue depth: 32 00:06:07.994 Allocate depth: 32 00:06:07.994 # threads/core: 1 00:06:07.994 Run time: 1 seconds 00:06:07.994 Verify: No 00:06:07.994 00:06:07.994 Running for 1 seconds... 00:06:07.994 00:06:07.994 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.994 ------------------------------------------------------------------------------------ 00:06:07.994 0,0 81344/s 322 MiB/s 0 0 00:06:07.994 ==================================================================================== 00:06:07.994 Total 81344/s 317 MiB/s 0 0' 00:06:07.994 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.994 08:13:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:07.994 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.994 08:13:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:07.994 08:13:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.994 08:13:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.995 08:13:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.995 08:13:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.995 08:13:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.995 08:13:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.995 08:13:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.995 08:13:53 -- accel/accel.sh@42 -- # jq -r . 00:06:07.995 [2024-11-26 08:13:53.552144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.995 [2024-11-26 08:13:53.552239] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850722 ] 00:06:07.995 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.995 [2024-11-26 08:13:53.607748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.995 [2024-11-26 08:13:53.726064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=0x1 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=dif_verify 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=software 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=32 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=32 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=1 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val=No 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:07.995 08:13:53 -- accel/accel.sh@21 -- # val= 00:06:07.995 08:13:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # IFS=: 00:06:07.995 08:13:53 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@21 -- # val= 00:06:09.369 08:13:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # IFS=: 00:06:09.369 08:13:54 -- accel/accel.sh@20 -- # read -r var val 00:06:09.369 08:13:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.369 08:13:54 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:09.369 08:13:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.369 00:06:09.369 real 0m2.953s 00:06:09.369 user 0m2.671s 00:06:09.369 sys 0m0.274s 00:06:09.369 08:13:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.369 08:13:54 -- common/autotest_common.sh@10 -- # set +x 00:06:09.369 ************************************ 00:06:09.369 END TEST accel_dif_verify 00:06:09.369 ************************************ 00:06:09.369 08:13:55 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:09.369 08:13:55 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:09.369 08:13:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.369 08:13:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.369 ************************************ 00:06:09.369 START TEST accel_dif_generate 00:06:09.369 ************************************ 00:06:09.369 08:13:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:09.369 08:13:55 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.369 08:13:55 -- accel/accel.sh@17 -- # local accel_module 00:06:09.369 08:13:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:09.369 08:13:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:09.369 08:13:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.369 08:13:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.369 08:13:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.369 08:13:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.369 08:13:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.369 08:13:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.369 08:13:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.369 08:13:55 -- accel/accel.sh@42 -- # jq -r . 00:06:09.369 [2024-11-26 08:13:55.042759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.369 [2024-11-26 08:13:55.042853] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850880 ] 00:06:09.369 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.369 [2024-11-26 08:13:55.107833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.628 [2024-11-26 08:13:55.230375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.001 08:13:56 -- accel/accel.sh@18 -- # out=' 00:06:11.001 SPDK Configuration: 00:06:11.001 Core mask: 0x1 00:06:11.001 00:06:11.001 Accel Perf Configuration: 00:06:11.001 Workload Type: dif_generate 00:06:11.001 Vector size: 4096 bytes 00:06:11.001 Transfer size: 4096 bytes 00:06:11.001 Block size: 512 bytes 00:06:11.001 Metadata size: 8 bytes 00:06:11.001 Vector count 1 00:06:11.001 Module: software 00:06:11.001 Queue depth: 32 00:06:11.001 Allocate depth: 32 00:06:11.001 # threads/core: 1 00:06:11.001 Run time: 1 seconds 00:06:11.001 Verify: No 00:06:11.001 00:06:11.001 Running for 1 seconds... 00:06:11.001 00:06:11.001 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.001 ------------------------------------------------------------------------------------ 00:06:11.001 0,0 96352/s 382 MiB/s 0 0 00:06:11.001 ==================================================================================== 00:06:11.001 Total 96352/s 376 MiB/s 0 0' 00:06:11.001 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.001 08:13:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:11.001 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.001 08:13:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:11.001 08:13:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.001 08:13:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.001 08:13:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.001 08:13:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.001 08:13:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.001 08:13:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.001 08:13:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.001 08:13:56 -- accel/accel.sh@42 -- # jq -r . 00:06:11.001 [2024-11-26 08:13:56.526577] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.001 [2024-11-26 08:13:56.526669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid851030 ] 00:06:11.001 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.001 [2024-11-26 08:13:56.587569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.002 [2024-11-26 08:13:56.706285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=0x1 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=dif_generate 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=software 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=32 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=32 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=1 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val=No 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:11.002 08:13:56 -- accel/accel.sh@21 -- # val= 00:06:11.002 08:13:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # IFS=: 00:06:11.002 08:13:56 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@21 -- # val= 00:06:12.373 08:13:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # IFS=: 00:06:12.373 08:13:57 -- accel/accel.sh@20 -- # read -r var val 00:06:12.373 08:13:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.373 08:13:57 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:12.373 08:13:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.373 00:06:12.373 real 0m2.962s 00:06:12.373 user 0m2.658s 00:06:12.373 sys 0m0.298s 00:06:12.373 08:13:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.373 08:13:57 -- common/autotest_common.sh@10 -- # set +x 00:06:12.373 ************************************ 00:06:12.373 END TEST accel_dif_generate 00:06:12.373 ************************************ 00:06:12.373 08:13:58 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:12.373 08:13:58 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:12.373 08:13:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.373 08:13:58 -- common/autotest_common.sh@10 -- # set +x 00:06:12.373 ************************************ 00:06:12.373 START TEST accel_dif_generate_copy 00:06:12.373 ************************************ 00:06:12.373 08:13:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:12.373 08:13:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.373 08:13:58 -- accel/accel.sh@17 -- # local accel_module 00:06:12.373 08:13:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:12.373 08:13:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:12.373 08:13:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.373 08:13:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.373 08:13:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.373 08:13:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.373 08:13:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.373 08:13:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.373 08:13:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.373 08:13:58 -- accel/accel.sh@42 -- # jq -r . 00:06:12.373 [2024-11-26 08:13:58.030540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.373 [2024-11-26 08:13:58.030637] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid851289 ] 00:06:12.373 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.373 [2024-11-26 08:13:58.097534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.373 [2024-11-26 08:13:58.218105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.745 08:13:59 -- accel/accel.sh@18 -- # out=' 00:06:13.745 SPDK Configuration: 00:06:13.745 Core mask: 0x1 00:06:13.745 00:06:13.745 Accel Perf Configuration: 00:06:13.745 Workload Type: dif_generate_copy 00:06:13.745 Vector size: 4096 bytes 00:06:13.745 Transfer size: 4096 bytes 00:06:13.745 Vector count 1 00:06:13.745 Module: software 00:06:13.745 Queue depth: 32 00:06:13.745 Allocate depth: 32 00:06:13.745 # threads/core: 1 00:06:13.745 Run time: 1 seconds 00:06:13.745 Verify: No 00:06:13.745 00:06:13.745 Running for 1 seconds... 00:06:13.745 00:06:13.745 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:13.745 ------------------------------------------------------------------------------------ 00:06:13.745 0,0 75840/s 300 MiB/s 0 0 00:06:13.745 ==================================================================================== 00:06:13.745 Total 75840/s 296 MiB/s 0 0' 00:06:13.745 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:13.745 08:13:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:13.745 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:13.745 08:13:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:13.745 08:13:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.745 08:13:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.745 08:13:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.745 08:13:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.745 08:13:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.746 08:13:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.746 08:13:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.746 08:13:59 -- accel/accel.sh@42 -- # jq -r . 00:06:13.746 [2024-11-26 08:13:59.513046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.746 [2024-11-26 08:13:59.513145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid851453 ] 00:06:13.746 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.746 [2024-11-26 08:13:59.575112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.003 [2024-11-26 08:13:59.695172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=0x1 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=software 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=32 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=32 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=1 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val=No 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:14.003 08:13:59 -- accel/accel.sh@21 -- # val= 00:06:14.003 08:13:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.003 08:13:59 -- accel/accel.sh@20 -- # IFS=: 00:06:14.004 08:13:59 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@21 -- # val= 00:06:15.376 08:14:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # IFS=: 00:06:15.376 08:14:00 -- accel/accel.sh@20 -- # read -r var val 00:06:15.376 08:14:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.376 08:14:00 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:15.376 08:14:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.376 00:06:15.376 real 0m2.969s 00:06:15.376 user 0m2.664s 00:06:15.376 sys 0m0.296s 00:06:15.376 08:14:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.376 08:14:00 -- common/autotest_common.sh@10 -- # set +x 00:06:15.376 ************************************ 00:06:15.376 END TEST accel_dif_generate_copy 00:06:15.376 ************************************ 00:06:15.376 08:14:01 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:15.376 08:14:01 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.377 08:14:01 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:15.377 08:14:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.377 08:14:01 -- common/autotest_common.sh@10 -- # set +x 00:06:15.377 ************************************ 00:06:15.377 START TEST accel_comp 00:06:15.377 ************************************ 00:06:15.377 08:14:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.377 08:14:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.377 08:14:01 -- accel/accel.sh@17 -- # local accel_module 00:06:15.377 08:14:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.377 08:14:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.377 08:14:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.377 08:14:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.377 08:14:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.377 08:14:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.377 08:14:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.377 08:14:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.377 08:14:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.377 08:14:01 -- accel/accel.sh@42 -- # jq -r . 00:06:15.377 [2024-11-26 08:14:01.023731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.377 [2024-11-26 08:14:01.023826] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid851607 ] 00:06:15.377 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.377 [2024-11-26 08:14:01.089634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.377 [2024-11-26 08:14:01.208387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.749 08:14:02 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:16.749 00:06:16.749 SPDK Configuration: 00:06:16.749 Core mask: 0x1 00:06:16.749 00:06:16.749 Accel Perf Configuration: 00:06:16.749 Workload Type: compress 00:06:16.749 Transfer size: 4096 bytes 00:06:16.749 Vector count 1 00:06:16.749 Module: software 00:06:16.749 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.749 Queue depth: 32 00:06:16.749 Allocate depth: 32 00:06:16.749 # threads/core: 1 00:06:16.749 Run time: 1 seconds 00:06:16.749 Verify: No 00:06:16.749 00:06:16.749 Running for 1 seconds... 00:06:16.749 00:06:16.749 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:16.749 ------------------------------------------------------------------------------------ 00:06:16.749 0,0 31488/s 131 MiB/s 0 0 00:06:16.749 ==================================================================================== 00:06:16.749 Total 31488/s 123 MiB/s 0 0' 00:06:16.749 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:16.749 08:14:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.749 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:16.749 08:14:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.749 08:14:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.749 08:14:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.749 08:14:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.749 08:14:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.749 08:14:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.749 08:14:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.749 08:14:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.749 08:14:02 -- accel/accel.sh@42 -- # jq -r . 00:06:16.749 [2024-11-26 08:14:02.497989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.749 [2024-11-26 08:14:02.498082] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid851806 ] 00:06:16.749 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.749 [2024-11-26 08:14:02.560300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.008 [2024-11-26 08:14:02.681135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=0x1 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=compress 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=software 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=32 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=32 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=1 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val=No 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:17.008 08:14:02 -- accel/accel.sh@21 -- # val= 00:06:17.008 08:14:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # IFS=: 00:06:17.008 08:14:02 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@21 -- # val= 00:06:18.383 08:14:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # IFS=: 00:06:18.383 08:14:03 -- accel/accel.sh@20 -- # read -r var val 00:06:18.383 08:14:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.383 08:14:03 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:18.383 08:14:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.383 00:06:18.383 real 0m2.964s 00:06:18.383 user 0m2.656s 00:06:18.383 sys 0m0.301s 00:06:18.383 08:14:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.383 08:14:03 -- common/autotest_common.sh@10 -- # set +x 00:06:18.383 ************************************ 00:06:18.383 END TEST accel_comp 00:06:18.383 ************************************ 00:06:18.383 08:14:03 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.383 08:14:03 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:18.383 08:14:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.383 08:14:03 -- common/autotest_common.sh@10 -- # set +x 00:06:18.383 ************************************ 00:06:18.383 START TEST accel_decomp 00:06:18.383 ************************************ 00:06:18.383 08:14:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.383 08:14:03 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.383 08:14:03 -- accel/accel.sh@17 -- # local accel_module 00:06:18.383 08:14:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.383 08:14:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.383 08:14:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.383 08:14:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.383 08:14:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.383 08:14:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.383 08:14:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.383 08:14:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.383 08:14:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.383 08:14:03 -- accel/accel.sh@42 -- # jq -r . 00:06:18.383 [2024-11-26 08:14:04.013949] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.383 [2024-11-26 08:14:04.014038] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852031 ] 00:06:18.383 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.383 [2024-11-26 08:14:04.076019] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.383 [2024-11-26 08:14:04.195562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.759 08:14:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.759 00:06:19.759 SPDK Configuration: 00:06:19.759 Core mask: 0x1 00:06:19.759 00:06:19.759 Accel Perf Configuration: 00:06:19.759 Workload Type: decompress 00:06:19.759 Transfer size: 4096 bytes 00:06:19.759 Vector count 1 00:06:19.759 Module: software 00:06:19.759 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.759 Queue depth: 32 00:06:19.759 Allocate depth: 32 00:06:19.759 # threads/core: 1 00:06:19.759 Run time: 1 seconds 00:06:19.759 Verify: Yes 00:06:19.759 00:06:19.759 Running for 1 seconds... 00:06:19.759 00:06:19.759 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.759 ------------------------------------------------------------------------------------ 00:06:19.759 0,0 55456/s 102 MiB/s 0 0 00:06:19.759 ==================================================================================== 00:06:19.759 Total 55456/s 216 MiB/s 0 0' 00:06:19.759 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:19.759 08:14:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.759 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:19.759 08:14:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.759 08:14:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.759 08:14:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.759 08:14:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.759 08:14:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.759 08:14:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.759 08:14:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.759 08:14:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.759 08:14:05 -- accel/accel.sh@42 -- # jq -r . 00:06:19.759 [2024-11-26 08:14:05.501842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.759 [2024-11-26 08:14:05.501940] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852182 ] 00:06:19.759 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.759 [2024-11-26 08:14:05.564444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.019 [2024-11-26 08:14:05.684674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=0x1 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=decompress 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=software 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=32 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=32 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=1 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val=Yes 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:20.019 08:14:05 -- accel/accel.sh@21 -- # val= 00:06:20.019 08:14:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # IFS=: 00:06:20.019 08:14:05 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@21 -- # val= 00:06:21.394 08:14:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # IFS=: 00:06:21.394 08:14:06 -- accel/accel.sh@20 -- # read -r var val 00:06:21.394 08:14:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.394 08:14:06 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.394 08:14:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.394 00:06:21.394 real 0m2.977s 00:06:21.394 user 0m2.680s 00:06:21.394 sys 0m0.290s 00:06:21.394 08:14:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.394 08:14:06 -- common/autotest_common.sh@10 -- # set +x 00:06:21.394 ************************************ 00:06:21.394 END TEST accel_decomp 00:06:21.394 ************************************ 00:06:21.394 08:14:06 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.394 08:14:06 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:21.394 08:14:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.394 08:14:06 -- common/autotest_common.sh@10 -- # set +x 00:06:21.394 ************************************ 00:06:21.394 START TEST accel_decmop_full 00:06:21.394 ************************************ 00:06:21.394 08:14:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.394 08:14:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.394 08:14:06 -- accel/accel.sh@17 -- # local accel_module 00:06:21.394 08:14:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.394 08:14:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.394 08:14:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.394 08:14:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.394 08:14:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.394 08:14:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.394 08:14:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.394 08:14:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.394 08:14:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.394 08:14:07 -- accel/accel.sh@42 -- # jq -r . 00:06:21.394 [2024-11-26 08:14:07.016861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.394 [2024-11-26 08:14:07.016960] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852408 ] 00:06:21.394 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.394 [2024-11-26 08:14:07.079315] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.394 [2024-11-26 08:14:07.191565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.769 08:14:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.769 00:06:22.769 SPDK Configuration: 00:06:22.769 Core mask: 0x1 00:06:22.769 00:06:22.769 Accel Perf Configuration: 00:06:22.769 Workload Type: decompress 00:06:22.769 Transfer size: 111250 bytes 00:06:22.769 Vector count 1 00:06:22.769 Module: software 00:06:22.769 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.769 Queue depth: 32 00:06:22.769 Allocate depth: 32 00:06:22.769 # threads/core: 1 00:06:22.769 Run time: 1 seconds 00:06:22.769 Verify: Yes 00:06:22.769 00:06:22.769 Running for 1 seconds... 00:06:22.769 00:06:22.769 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.769 ------------------------------------------------------------------------------------ 00:06:22.769 0,0 3808/s 157 MiB/s 0 0 00:06:22.769 ==================================================================================== 00:06:22.769 Total 3808/s 404 MiB/s 0 0' 00:06:22.769 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:22.769 08:14:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.769 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:22.769 08:14:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.769 08:14:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.769 08:14:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.769 08:14:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.769 08:14:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.769 08:14:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.769 08:14:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.769 08:14:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.769 08:14:08 -- accel/accel.sh@42 -- # jq -r . 00:06:22.769 [2024-11-26 08:14:08.504118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.769 [2024-11-26 08:14:08.504215] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852605 ] 00:06:22.769 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.769 [2024-11-26 08:14:08.566379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.028 [2024-11-26 08:14:08.685206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.028 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.028 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.028 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.028 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.028 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.028 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.028 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.028 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.028 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.028 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=0x1 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=decompress 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=software 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=32 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=32 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=1 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val=Yes 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:23.029 08:14:08 -- accel/accel.sh@21 -- # val= 00:06:23.029 08:14:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # IFS=: 00:06:23.029 08:14:08 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@21 -- # val= 00:06:24.402 08:14:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # IFS=: 00:06:24.402 08:14:09 -- accel/accel.sh@20 -- # read -r var val 00:06:24.402 08:14:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.402 08:14:09 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.402 08:14:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.402 00:06:24.402 real 0m2.982s 00:06:24.402 user 0m2.679s 00:06:24.402 sys 0m0.295s 00:06:24.402 08:14:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.402 08:14:09 -- common/autotest_common.sh@10 -- # set +x 00:06:24.402 ************************************ 00:06:24.402 END TEST accel_decmop_full 00:06:24.402 ************************************ 00:06:24.402 08:14:09 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.402 08:14:09 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:24.402 08:14:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.402 08:14:09 -- common/autotest_common.sh@10 -- # set +x 00:06:24.402 ************************************ 00:06:24.402 START TEST accel_decomp_mcore 00:06:24.402 ************************************ 00:06:24.402 08:14:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.402 08:14:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.402 08:14:10 -- accel/accel.sh@17 -- # local accel_module 00:06:24.402 08:14:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.402 08:14:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.402 08:14:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.402 08:14:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.402 08:14:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.402 08:14:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.402 08:14:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.402 08:14:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.402 08:14:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.402 08:14:10 -- accel/accel.sh@42 -- # jq -r . 00:06:24.402 [2024-11-26 08:14:10.025732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.402 [2024-11-26 08:14:10.025813] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852763 ] 00:06:24.402 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.402 [2024-11-26 08:14:10.091348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:24.402 [2024-11-26 08:14:10.216051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.402 [2024-11-26 08:14:10.216108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.402 [2024-11-26 08:14:10.216164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.402 [2024-11-26 08:14:10.216167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.780 08:14:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.780 00:06:25.780 SPDK Configuration: 00:06:25.780 Core mask: 0xf 00:06:25.780 00:06:25.780 Accel Perf Configuration: 00:06:25.780 Workload Type: decompress 00:06:25.780 Transfer size: 4096 bytes 00:06:25.780 Vector count 1 00:06:25.780 Module: software 00:06:25.780 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.780 Queue depth: 32 00:06:25.780 Allocate depth: 32 00:06:25.780 # threads/core: 1 00:06:25.780 Run time: 1 seconds 00:06:25.780 Verify: Yes 00:06:25.780 00:06:25.780 Running for 1 seconds... 00:06:25.780 00:06:25.780 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.780 ------------------------------------------------------------------------------------ 00:06:25.780 0,0 50144/s 92 MiB/s 0 0 00:06:25.780 3,0 50368/s 92 MiB/s 0 0 00:06:25.780 2,0 50368/s 92 MiB/s 0 0 00:06:25.780 1,0 50304/s 92 MiB/s 0 0 00:06:25.780 ==================================================================================== 00:06:25.780 Total 201184/s 785 MiB/s 0 0' 00:06:25.780 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:25.780 08:14:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.780 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:25.780 08:14:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.780 08:14:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.780 08:14:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.780 08:14:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.780 08:14:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.780 08:14:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.780 08:14:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.780 08:14:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.780 08:14:11 -- accel/accel.sh@42 -- # jq -r . 00:06:25.780 [2024-11-26 08:14:11.529996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.780 [2024-11-26 08:14:11.530088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852949 ] 00:06:25.780 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.780 [2024-11-26 08:14:11.594052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.039 [2024-11-26 08:14:11.717439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.039 [2024-11-26 08:14:11.717497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.039 [2024-11-26 08:14:11.717552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.039 [2024-11-26 08:14:11.717556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=0xf 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=decompress 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=software 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=32 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=32 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=1 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val=Yes 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:26.039 08:14:11 -- accel/accel.sh@21 -- # val= 00:06:26.039 08:14:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # IFS=: 00:06:26.039 08:14:11 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:12 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:12 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:13 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:13 -- accel/accel.sh@21 -- # val= 00:06:27.413 08:14:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # IFS=: 00:06:27.413 08:14:13 -- accel/accel.sh@20 -- # read -r var val 00:06:27.413 08:14:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.413 08:14:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.413 08:14:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.413 00:06:27.413 real 0m2.998s 00:06:27.413 user 0m9.616s 00:06:27.413 sys 0m0.313s 00:06:27.413 08:14:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.413 08:14:13 -- common/autotest_common.sh@10 -- # set +x 00:06:27.413 ************************************ 00:06:27.413 END TEST accel_decomp_mcore 00:06:27.413 ************************************ 00:06:27.413 08:14:13 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.413 08:14:13 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:27.413 08:14:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.413 08:14:13 -- common/autotest_common.sh@10 -- # set +x 00:06:27.413 ************************************ 00:06:27.413 START TEST accel_decomp_full_mcore 00:06:27.413 ************************************ 00:06:27.413 08:14:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.413 08:14:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.413 08:14:13 -- accel/accel.sh@17 -- # local accel_module 00:06:27.413 08:14:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.413 08:14:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.413 08:14:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.413 08:14:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.413 08:14:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.413 08:14:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.413 08:14:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.413 08:14:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.413 08:14:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.413 08:14:13 -- accel/accel.sh@42 -- # jq -r . 00:06:27.413 [2024-11-26 08:14:13.050802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.413 [2024-11-26 08:14:13.050889] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid853191 ] 00:06:27.413 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.413 [2024-11-26 08:14:13.113282] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.413 [2024-11-26 08:14:13.236762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.413 [2024-11-26 08:14:13.236818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.413 [2024-11-26 08:14:13.236871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.413 [2024-11-26 08:14:13.236874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.787 08:14:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:28.787 00:06:28.787 SPDK Configuration: 00:06:28.787 Core mask: 0xf 00:06:28.787 00:06:28.787 Accel Perf Configuration: 00:06:28.787 Workload Type: decompress 00:06:28.787 Transfer size: 111250 bytes 00:06:28.787 Vector count 1 00:06:28.787 Module: software 00:06:28.787 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:28.787 Queue depth: 32 00:06:28.787 Allocate depth: 32 00:06:28.787 # threads/core: 1 00:06:28.787 Run time: 1 seconds 00:06:28.787 Verify: Yes 00:06:28.787 00:06:28.787 Running for 1 seconds... 00:06:28.787 00:06:28.787 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:28.787 ------------------------------------------------------------------------------------ 00:06:28.787 0,0 3776/s 155 MiB/s 0 0 00:06:28.787 3,0 3776/s 155 MiB/s 0 0 00:06:28.787 2,0 3776/s 155 MiB/s 0 0 00:06:28.787 1,0 3776/s 155 MiB/s 0 0 00:06:28.787 ==================================================================================== 00:06:28.787 Total 15104/s 1602 MiB/s 0 0' 00:06:28.787 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:28.787 08:14:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.787 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:28.787 08:14:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.787 08:14:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.787 08:14:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.787 08:14:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.788 08:14:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.788 08:14:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.788 08:14:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.788 08:14:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.788 08:14:14 -- accel/accel.sh@42 -- # jq -r . 00:06:28.788 [2024-11-26 08:14:14.557046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.788 [2024-11-26 08:14:14.557145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid853345 ] 00:06:28.788 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.788 [2024-11-26 08:14:14.619723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:29.045 [2024-11-26 08:14:14.743155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:29.045 [2024-11-26 08:14:14.743214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:29.045 [2024-11-26 08:14:14.743266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:29.045 [2024-11-26 08:14:14.743270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val=0xf 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.045 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.045 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.045 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=decompress 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=software 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=32 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=32 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=1 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val=Yes 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:29.046 08:14:14 -- accel/accel.sh@21 -- # val= 00:06:29.046 08:14:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # IFS=: 00:06:29.046 08:14:14 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.415 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.415 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.415 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.416 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.416 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.416 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.416 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.416 08:14:16 -- accel/accel.sh@21 -- # val= 00:06:30.416 08:14:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # IFS=: 00:06:30.416 08:14:16 -- accel/accel.sh@20 -- # read -r var val 00:06:30.416 08:14:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.416 08:14:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.416 08:14:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.416 00:06:30.416 real 0m3.018s 00:06:30.416 user 0m9.704s 00:06:30.416 sys 0m0.305s 00:06:30.416 08:14:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.416 08:14:16 -- common/autotest_common.sh@10 -- # set +x 00:06:30.416 ************************************ 00:06:30.416 END TEST accel_decomp_full_mcore 00:06:30.416 ************************************ 00:06:30.416 08:14:16 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.416 08:14:16 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:30.416 08:14:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.416 08:14:16 -- common/autotest_common.sh@10 -- # set +x 00:06:30.416 ************************************ 00:06:30.416 START TEST accel_decomp_mthread 00:06:30.416 ************************************ 00:06:30.416 08:14:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.416 08:14:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.416 08:14:16 -- accel/accel.sh@17 -- # local accel_module 00:06:30.416 08:14:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.416 08:14:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.416 08:14:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.416 08:14:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.416 08:14:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.416 08:14:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.416 08:14:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.416 08:14:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.416 08:14:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.416 08:14:16 -- accel/accel.sh@42 -- # jq -r . 00:06:30.416 [2024-11-26 08:14:16.096261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.416 [2024-11-26 08:14:16.096357] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid853541 ] 00:06:30.416 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.416 [2024-11-26 08:14:16.159485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.674 [2024-11-26 08:14:16.280302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.044 08:14:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:32.044 00:06:32.044 SPDK Configuration: 00:06:32.044 Core mask: 0x1 00:06:32.044 00:06:32.044 Accel Perf Configuration: 00:06:32.044 Workload Type: decompress 00:06:32.044 Transfer size: 4096 bytes 00:06:32.044 Vector count 1 00:06:32.044 Module: software 00:06:32.044 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.044 Queue depth: 32 00:06:32.044 Allocate depth: 32 00:06:32.044 # threads/core: 2 00:06:32.044 Run time: 1 seconds 00:06:32.044 Verify: Yes 00:06:32.044 00:06:32.044 Running for 1 seconds... 00:06:32.044 00:06:32.044 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:32.044 ------------------------------------------------------------------------------------ 00:06:32.044 0,1 28064/s 51 MiB/s 0 0 00:06:32.044 0,0 27968/s 51 MiB/s 0 0 00:06:32.044 ==================================================================================== 00:06:32.044 Total 56032/s 218 MiB/s 0 0' 00:06:32.044 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.044 08:14:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:32.044 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.044 08:14:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:32.044 08:14:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.044 08:14:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.044 08:14:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.044 08:14:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.044 08:14:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.045 08:14:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.045 08:14:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.045 08:14:17 -- accel/accel.sh@42 -- # jq -r . 00:06:32.045 [2024-11-26 08:14:17.591188] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.045 [2024-11-26 08:14:17.591285] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid853767 ] 00:06:32.045 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.045 [2024-11-26 08:14:17.653000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.045 [2024-11-26 08:14:17.769800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=0x1 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=decompress 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=software 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@23 -- # accel_module=software 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=32 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=32 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=2 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val=Yes 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:32.045 08:14:17 -- accel/accel.sh@21 -- # val= 00:06:32.045 08:14:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # IFS=: 00:06:32.045 08:14:17 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@21 -- # val= 00:06:33.418 08:14:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # IFS=: 00:06:33.418 08:14:19 -- accel/accel.sh@20 -- # read -r var val 00:06:33.418 08:14:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.418 08:14:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.418 08:14:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.418 00:06:33.418 real 0m2.971s 00:06:33.418 user 0m2.666s 00:06:33.418 sys 0m0.297s 00:06:33.418 08:14:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.418 08:14:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.418 ************************************ 00:06:33.418 END TEST accel_decomp_mthread 00:06:33.418 ************************************ 00:06:33.418 08:14:19 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.418 08:14:19 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:33.418 08:14:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.418 08:14:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.418 ************************************ 00:06:33.418 START TEST accel_deomp_full_mthread 00:06:33.418 ************************************ 00:06:33.418 08:14:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.418 08:14:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.418 08:14:19 -- accel/accel.sh@17 -- # local accel_module 00:06:33.418 08:14:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.418 08:14:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.418 08:14:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.418 08:14:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.418 08:14:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.418 08:14:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.418 08:14:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.418 08:14:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.418 08:14:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.418 08:14:19 -- accel/accel.sh@42 -- # jq -r . 00:06:33.418 [2024-11-26 08:14:19.091221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.418 [2024-11-26 08:14:19.091309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid853928 ] 00:06:33.418 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.418 [2024-11-26 08:14:19.156599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.675 [2024-11-26 08:14:19.277139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.047 08:14:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:35.047 00:06:35.047 SPDK Configuration: 00:06:35.047 Core mask: 0x1 00:06:35.047 00:06:35.047 Accel Perf Configuration: 00:06:35.047 Workload Type: decompress 00:06:35.047 Transfer size: 111250 bytes 00:06:35.047 Vector count 1 00:06:35.047 Module: software 00:06:35.047 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.047 Queue depth: 32 00:06:35.047 Allocate depth: 32 00:06:35.047 # threads/core: 2 00:06:35.047 Run time: 1 seconds 00:06:35.047 Verify: Yes 00:06:35.047 00:06:35.047 Running for 1 seconds... 00:06:35.047 00:06:35.047 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:35.047 ------------------------------------------------------------------------------------ 00:06:35.047 0,1 1952/s 80 MiB/s 0 0 00:06:35.047 0,0 1920/s 79 MiB/s 0 0 00:06:35.047 ==================================================================================== 00:06:35.047 Total 3872/s 410 MiB/s 0 0' 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:35.047 08:14:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.047 08:14:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.047 08:14:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.047 08:14:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.047 08:14:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.047 08:14:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.047 08:14:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.047 08:14:20 -- accel/accel.sh@42 -- # jq -r . 00:06:35.047 [2024-11-26 08:14:20.617917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.047 [2024-11-26 08:14:20.618006] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid854094 ] 00:06:35.047 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.047 [2024-11-26 08:14:20.679872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.047 [2024-11-26 08:14:20.799260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val=0x1 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.047 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.047 08:14:20 -- accel/accel.sh@21 -- # val=decompress 00:06:35.047 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=software 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@23 -- # accel_module=software 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=32 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=32 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=2 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val=Yes 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:35.048 08:14:20 -- accel/accel.sh@21 -- # val= 00:06:35.048 08:14:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # IFS=: 00:06:35.048 08:14:20 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@21 -- # val= 00:06:36.421 08:14:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # IFS=: 00:06:36.421 08:14:22 -- accel/accel.sh@20 -- # read -r var val 00:06:36.421 08:14:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:36.421 08:14:22 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:36.421 08:14:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:36.421 00:06:36.421 real 0m3.052s 00:06:36.421 user 0m2.750s 00:06:36.421 sys 0m0.293s 00:06:36.421 08:14:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.421 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:36.421 ************************************ 00:06:36.421 END TEST accel_deomp_full_mthread 00:06:36.421 ************************************ 00:06:36.421 08:14:22 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:36.421 08:14:22 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:36.421 08:14:22 -- accel/accel.sh@129 -- # build_accel_config 00:06:36.421 08:14:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:36.421 08:14:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.421 08:14:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.421 08:14:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.421 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:36.421 08:14:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.421 08:14:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.421 08:14:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.421 08:14:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.421 08:14:22 -- accel/accel.sh@42 -- # jq -r . 00:06:36.421 ************************************ 00:06:36.421 START TEST accel_dif_functional_tests 00:06:36.421 ************************************ 00:06:36.421 08:14:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:36.421 [2024-11-26 08:14:22.191908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.421 [2024-11-26 08:14:22.191995] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid854350 ] 00:06:36.421 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.421 [2024-11-26 08:14:22.254002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:36.715 [2024-11-26 08:14:22.374337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:36.715 [2024-11-26 08:14:22.374393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:36.715 [2024-11-26 08:14:22.374397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.715 00:06:36.715 00:06:36.715 CUnit - A unit testing framework for C - Version 2.1-3 00:06:36.715 http://cunit.sourceforge.net/ 00:06:36.715 00:06:36.715 00:06:36.715 Suite: accel_dif 00:06:36.715 Test: verify: DIF generated, GUARD check ...passed 00:06:36.715 Test: verify: DIF generated, APPTAG check ...passed 00:06:36.715 Test: verify: DIF generated, REFTAG check ...passed 00:06:36.715 Test: verify: DIF not generated, GUARD check ...[2024-11-26 08:14:22.469457] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.715 [2024-11-26 08:14:22.469526] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.715 passed 00:06:36.715 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 08:14:22.469575] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.715 [2024-11-26 08:14:22.469605] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.715 passed 00:06:36.715 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 08:14:22.469640] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.715 [2024-11-26 08:14:22.469667] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.715 passed 00:06:36.715 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:36.715 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 08:14:22.469747] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:36.715 passed 00:06:36.715 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:36.715 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:36.715 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:36.715 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 08:14:22.469903] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:36.715 passed 00:06:36.715 Test: generate copy: DIF generated, GUARD check ...passed 00:06:36.715 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:36.715 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:36.715 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:36.715 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:36.715 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:36.715 Test: generate copy: iovecs-len validate ...[2024-11-26 08:14:22.470157] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:36.715 passed 00:06:36.715 Test: generate copy: buffer alignment validate ...passed 00:06:36.715 00:06:36.715 Run Summary: Type Total Ran Passed Failed Inactive 00:06:36.715 suites 1 1 n/a 0 0 00:06:36.715 tests 20 20 20 0 0 00:06:36.715 asserts 204 204 204 0 n/a 00:06:36.715 00:06:36.715 Elapsed time = 0.003 seconds 00:06:36.996 00:06:36.996 real 0m0.573s 00:06:36.996 user 0m0.845s 00:06:36.996 sys 0m0.182s 00:06:36.996 08:14:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.996 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:36.996 ************************************ 00:06:36.996 END TEST accel_dif_functional_tests 00:06:36.996 ************************************ 00:06:36.996 00:06:36.996 real 1m3.249s 00:06:36.996 user 1m10.995s 00:06:36.996 sys 0m7.329s 00:06:36.996 08:14:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.996 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:36.996 ************************************ 00:06:36.996 END TEST accel 00:06:36.996 ************************************ 00:06:36.996 08:14:22 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.996 08:14:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.996 08:14:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.996 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:36.996 ************************************ 00:06:36.996 START TEST accel_rpc 00:06:36.996 ************************************ 00:06:36.996 08:14:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.996 * Looking for test storage... 00:06:36.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:36.996 08:14:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:36.996 08:14:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:36.996 08:14:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:37.255 08:14:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:37.255 08:14:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:37.255 08:14:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:37.255 08:14:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:37.255 08:14:22 -- scripts/common.sh@335 -- # IFS=.-: 00:06:37.255 08:14:22 -- scripts/common.sh@335 -- # read -ra ver1 00:06:37.255 08:14:22 -- scripts/common.sh@336 -- # IFS=.-: 00:06:37.255 08:14:22 -- scripts/common.sh@336 -- # read -ra ver2 00:06:37.255 08:14:22 -- scripts/common.sh@337 -- # local 'op=<' 00:06:37.255 08:14:22 -- scripts/common.sh@339 -- # ver1_l=2 00:06:37.255 08:14:22 -- scripts/common.sh@340 -- # ver2_l=1 00:06:37.255 08:14:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:37.255 08:14:22 -- scripts/common.sh@343 -- # case "$op" in 00:06:37.255 08:14:22 -- scripts/common.sh@344 -- # : 1 00:06:37.255 08:14:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:37.255 08:14:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:37.255 08:14:22 -- scripts/common.sh@364 -- # decimal 1 00:06:37.255 08:14:22 -- scripts/common.sh@352 -- # local d=1 00:06:37.255 08:14:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:37.255 08:14:22 -- scripts/common.sh@354 -- # echo 1 00:06:37.255 08:14:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:37.255 08:14:22 -- scripts/common.sh@365 -- # decimal 2 00:06:37.255 08:14:22 -- scripts/common.sh@352 -- # local d=2 00:06:37.255 08:14:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:37.255 08:14:22 -- scripts/common.sh@354 -- # echo 2 00:06:37.255 08:14:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:37.255 08:14:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:37.255 08:14:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:37.255 08:14:22 -- scripts/common.sh@367 -- # return 0 00:06:37.255 08:14:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:37.255 08:14:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:37.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.255 --rc genhtml_branch_coverage=1 00:06:37.255 --rc genhtml_function_coverage=1 00:06:37.255 --rc genhtml_legend=1 00:06:37.255 --rc geninfo_all_blocks=1 00:06:37.255 --rc geninfo_unexecuted_blocks=1 00:06:37.255 00:06:37.255 ' 00:06:37.255 08:14:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:37.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.255 --rc genhtml_branch_coverage=1 00:06:37.255 --rc genhtml_function_coverage=1 00:06:37.255 --rc genhtml_legend=1 00:06:37.255 --rc geninfo_all_blocks=1 00:06:37.255 --rc geninfo_unexecuted_blocks=1 00:06:37.255 00:06:37.255 ' 00:06:37.255 08:14:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:37.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.255 --rc genhtml_branch_coverage=1 00:06:37.255 --rc genhtml_function_coverage=1 00:06:37.255 --rc genhtml_legend=1 00:06:37.255 --rc geninfo_all_blocks=1 00:06:37.255 --rc geninfo_unexecuted_blocks=1 00:06:37.255 00:06:37.255 ' 00:06:37.255 08:14:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:37.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.255 --rc genhtml_branch_coverage=1 00:06:37.255 --rc genhtml_function_coverage=1 00:06:37.255 --rc genhtml_legend=1 00:06:37.255 --rc geninfo_all_blocks=1 00:06:37.255 --rc geninfo_unexecuted_blocks=1 00:06:37.255 00:06:37.255 ' 00:06:37.255 08:14:22 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:37.255 08:14:22 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=854514 00:06:37.255 08:14:22 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:37.255 08:14:22 -- accel/accel_rpc.sh@15 -- # waitforlisten 854514 00:06:37.255 08:14:22 -- common/autotest_common.sh@829 -- # '[' -z 854514 ']' 00:06:37.255 08:14:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.255 08:14:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.255 08:14:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.255 08:14:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.255 08:14:22 -- common/autotest_common.sh@10 -- # set +x 00:06:37.255 [2024-11-26 08:14:22.983099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.255 [2024-11-26 08:14:22.983192] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid854514 ] 00:06:37.255 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.255 [2024-11-26 08:14:23.039357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.514 [2024-11-26 08:14:23.152406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.514 [2024-11-26 08:14:23.152597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.514 08:14:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.514 08:14:23 -- common/autotest_common.sh@862 -- # return 0 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:37.514 08:14:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.514 08:14:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.514 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.514 ************************************ 00:06:37.514 START TEST accel_assign_opcode 00:06:37.514 ************************************ 00:06:37.514 08:14:23 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:37.514 08:14:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.514 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.514 [2024-11-26 08:14:23.201153] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:37.514 08:14:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:37.514 08:14:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.514 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.514 [2024-11-26 08:14:23.209165] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:37.514 08:14:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.514 08:14:23 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:37.514 08:14:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.514 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.772 08:14:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.772 08:14:23 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:37.772 08:14:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.772 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.772 08:14:23 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:37.772 08:14:23 -- accel/accel_rpc.sh@42 -- # grep software 00:06:37.772 08:14:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.772 software 00:06:37.772 00:06:37.772 real 0m0.308s 00:06:37.772 user 0m0.043s 00:06:37.772 sys 0m0.007s 00:06:37.772 08:14:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.772 08:14:23 -- common/autotest_common.sh@10 -- # set +x 00:06:37.772 ************************************ 00:06:37.772 END TEST accel_assign_opcode 00:06:37.772 ************************************ 00:06:37.772 08:14:23 -- accel/accel_rpc.sh@55 -- # killprocess 854514 00:06:37.772 08:14:23 -- common/autotest_common.sh@936 -- # '[' -z 854514 ']' 00:06:37.772 08:14:23 -- common/autotest_common.sh@940 -- # kill -0 854514 00:06:37.772 08:14:23 -- common/autotest_common.sh@941 -- # uname 00:06:37.772 08:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.772 08:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 854514 00:06:37.772 08:14:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.772 08:14:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.772 08:14:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 854514' 00:06:37.772 killing process with pid 854514 00:06:37.772 08:14:23 -- common/autotest_common.sh@955 -- # kill 854514 00:06:37.772 08:14:23 -- common/autotest_common.sh@960 -- # wait 854514 00:06:38.337 00:06:38.337 real 0m1.259s 00:06:38.337 user 0m1.155s 00:06:38.337 sys 0m0.467s 00:06:38.337 08:14:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.337 08:14:24 -- common/autotest_common.sh@10 -- # set +x 00:06:38.337 ************************************ 00:06:38.337 END TEST accel_rpc 00:06:38.337 ************************************ 00:06:38.337 08:14:24 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:38.337 08:14:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.337 08:14:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.337 08:14:24 -- common/autotest_common.sh@10 -- # set +x 00:06:38.337 ************************************ 00:06:38.337 START TEST app_cmdline 00:06:38.337 ************************************ 00:06:38.337 08:14:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:38.337 * Looking for test storage... 00:06:38.337 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:38.337 08:14:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:38.337 08:14:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:38.337 08:14:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.596 08:14:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.596 08:14:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.596 08:14:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.596 08:14:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.596 08:14:24 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.596 08:14:24 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.596 08:14:24 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.596 08:14:24 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.596 08:14:24 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.596 08:14:24 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.596 08:14:24 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.596 08:14:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.596 08:14:24 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.596 08:14:24 -- scripts/common.sh@344 -- # : 1 00:06:38.596 08:14:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.596 08:14:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.596 08:14:24 -- scripts/common.sh@364 -- # decimal 1 00:06:38.596 08:14:24 -- scripts/common.sh@352 -- # local d=1 00:06:38.596 08:14:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.596 08:14:24 -- scripts/common.sh@354 -- # echo 1 00:06:38.596 08:14:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.596 08:14:24 -- scripts/common.sh@365 -- # decimal 2 00:06:38.596 08:14:24 -- scripts/common.sh@352 -- # local d=2 00:06:38.596 08:14:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.596 08:14:24 -- scripts/common.sh@354 -- # echo 2 00:06:38.596 08:14:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.596 08:14:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.596 08:14:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.596 08:14:24 -- scripts/common.sh@367 -- # return 0 00:06:38.596 08:14:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.596 08:14:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.596 --rc genhtml_branch_coverage=1 00:06:38.596 --rc genhtml_function_coverage=1 00:06:38.596 --rc genhtml_legend=1 00:06:38.596 --rc geninfo_all_blocks=1 00:06:38.596 --rc geninfo_unexecuted_blocks=1 00:06:38.596 00:06:38.596 ' 00:06:38.596 08:14:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.596 --rc genhtml_branch_coverage=1 00:06:38.596 --rc genhtml_function_coverage=1 00:06:38.596 --rc genhtml_legend=1 00:06:38.596 --rc geninfo_all_blocks=1 00:06:38.596 --rc geninfo_unexecuted_blocks=1 00:06:38.596 00:06:38.596 ' 00:06:38.596 08:14:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.596 --rc genhtml_branch_coverage=1 00:06:38.596 --rc genhtml_function_coverage=1 00:06:38.596 --rc genhtml_legend=1 00:06:38.596 --rc geninfo_all_blocks=1 00:06:38.596 --rc geninfo_unexecuted_blocks=1 00:06:38.596 00:06:38.596 ' 00:06:38.596 08:14:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.596 --rc genhtml_branch_coverage=1 00:06:38.596 --rc genhtml_function_coverage=1 00:06:38.596 --rc genhtml_legend=1 00:06:38.596 --rc geninfo_all_blocks=1 00:06:38.596 --rc geninfo_unexecuted_blocks=1 00:06:38.596 00:06:38.596 ' 00:06:38.596 08:14:24 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:38.596 08:14:24 -- app/cmdline.sh@17 -- # spdk_tgt_pid=854768 00:06:38.596 08:14:24 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:38.596 08:14:24 -- app/cmdline.sh@18 -- # waitforlisten 854768 00:06:38.596 08:14:24 -- common/autotest_common.sh@829 -- # '[' -z 854768 ']' 00:06:38.596 08:14:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.596 08:14:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.596 08:14:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.596 08:14:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.596 08:14:24 -- common/autotest_common.sh@10 -- # set +x 00:06:38.596 [2024-11-26 08:14:24.252143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.596 [2024-11-26 08:14:24.252234] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid854768 ] 00:06:38.596 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.596 [2024-11-26 08:14:24.308349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.596 [2024-11-26 08:14:24.421557] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.596 [2024-11-26 08:14:24.421760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.530 08:14:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:39.530 08:14:25 -- common/autotest_common.sh@862 -- # return 0 00:06:39.530 08:14:25 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:39.788 { 00:06:39.788 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:39.788 "fields": { 00:06:39.788 "major": 24, 00:06:39.788 "minor": 1, 00:06:39.788 "patch": 1, 00:06:39.788 "suffix": "-pre", 00:06:39.788 "commit": "c13c99a5e" 00:06:39.788 } 00:06:39.788 } 00:06:39.788 08:14:25 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:39.788 08:14:25 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:39.788 08:14:25 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:39.788 08:14:25 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:39.788 08:14:25 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:39.788 08:14:25 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:39.788 08:14:25 -- app/cmdline.sh@26 -- # sort 00:06:39.789 08:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.789 08:14:25 -- common/autotest_common.sh@10 -- # set +x 00:06:39.789 08:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.789 08:14:25 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:39.789 08:14:25 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:39.789 08:14:25 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.789 08:14:25 -- common/autotest_common.sh@650 -- # local es=0 00:06:39.789 08:14:25 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.789 08:14:25 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.789 08:14:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.789 08:14:25 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.789 08:14:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.789 08:14:25 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.789 08:14:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.789 08:14:25 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.789 08:14:25 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:39.789 08:14:25 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:40.047 request: 00:06:40.047 { 00:06:40.047 "method": "env_dpdk_get_mem_stats", 00:06:40.047 "req_id": 1 00:06:40.047 } 00:06:40.047 Got JSON-RPC error response 00:06:40.047 response: 00:06:40.047 { 00:06:40.047 "code": -32601, 00:06:40.047 "message": "Method not found" 00:06:40.047 } 00:06:40.047 08:14:25 -- common/autotest_common.sh@653 -- # es=1 00:06:40.047 08:14:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:40.047 08:14:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:40.047 08:14:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:40.047 08:14:25 -- app/cmdline.sh@1 -- # killprocess 854768 00:06:40.047 08:14:25 -- common/autotest_common.sh@936 -- # '[' -z 854768 ']' 00:06:40.047 08:14:25 -- common/autotest_common.sh@940 -- # kill -0 854768 00:06:40.047 08:14:25 -- common/autotest_common.sh@941 -- # uname 00:06:40.047 08:14:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:40.047 08:14:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 854768 00:06:40.047 08:14:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:40.047 08:14:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:40.047 08:14:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 854768' 00:06:40.047 killing process with pid 854768 00:06:40.047 08:14:25 -- common/autotest_common.sh@955 -- # kill 854768 00:06:40.047 08:14:25 -- common/autotest_common.sh@960 -- # wait 854768 00:06:40.614 00:06:40.614 real 0m2.291s 00:06:40.614 user 0m2.917s 00:06:40.614 sys 0m0.520s 00:06:40.614 08:14:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.614 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:40.614 ************************************ 00:06:40.614 END TEST app_cmdline 00:06:40.614 ************************************ 00:06:40.614 08:14:26 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:40.614 08:14:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:40.614 08:14:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.614 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:40.614 ************************************ 00:06:40.614 START TEST version 00:06:40.614 ************************************ 00:06:40.614 08:14:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:40.614 * Looking for test storage... 00:06:40.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:40.614 08:14:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.614 08:14:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.614 08:14:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.872 08:14:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.872 08:14:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.872 08:14:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.872 08:14:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.872 08:14:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.872 08:14:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.872 08:14:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.872 08:14:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.872 08:14:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.872 08:14:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.872 08:14:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.873 08:14:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.873 08:14:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.873 08:14:26 -- scripts/common.sh@344 -- # : 1 00:06:40.873 08:14:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.873 08:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.873 08:14:26 -- scripts/common.sh@364 -- # decimal 1 00:06:40.873 08:14:26 -- scripts/common.sh@352 -- # local d=1 00:06:40.873 08:14:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.873 08:14:26 -- scripts/common.sh@354 -- # echo 1 00:06:40.873 08:14:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.873 08:14:26 -- scripts/common.sh@365 -- # decimal 2 00:06:40.873 08:14:26 -- scripts/common.sh@352 -- # local d=2 00:06:40.873 08:14:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.873 08:14:26 -- scripts/common.sh@354 -- # echo 2 00:06:40.873 08:14:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.873 08:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.873 08:14:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.873 08:14:26 -- scripts/common.sh@367 -- # return 0 00:06:40.873 08:14:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.873 08:14:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.873 --rc genhtml_branch_coverage=1 00:06:40.873 --rc genhtml_function_coverage=1 00:06:40.873 --rc genhtml_legend=1 00:06:40.873 --rc geninfo_all_blocks=1 00:06:40.873 --rc geninfo_unexecuted_blocks=1 00:06:40.873 00:06:40.873 ' 00:06:40.873 08:14:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.873 --rc genhtml_branch_coverage=1 00:06:40.873 --rc genhtml_function_coverage=1 00:06:40.873 --rc genhtml_legend=1 00:06:40.873 --rc geninfo_all_blocks=1 00:06:40.873 --rc geninfo_unexecuted_blocks=1 00:06:40.873 00:06:40.873 ' 00:06:40.873 08:14:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.873 --rc genhtml_branch_coverage=1 00:06:40.873 --rc genhtml_function_coverage=1 00:06:40.873 --rc genhtml_legend=1 00:06:40.873 --rc geninfo_all_blocks=1 00:06:40.873 --rc geninfo_unexecuted_blocks=1 00:06:40.873 00:06:40.873 ' 00:06:40.873 08:14:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.873 --rc genhtml_branch_coverage=1 00:06:40.873 --rc genhtml_function_coverage=1 00:06:40.873 --rc genhtml_legend=1 00:06:40.873 --rc geninfo_all_blocks=1 00:06:40.873 --rc geninfo_unexecuted_blocks=1 00:06:40.873 00:06:40.873 ' 00:06:40.873 08:14:26 -- app/version.sh@17 -- # get_header_version major 00:06:40.873 08:14:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:40.873 08:14:26 -- app/version.sh@14 -- # cut -f2 00:06:40.873 08:14:26 -- app/version.sh@14 -- # tr -d '"' 00:06:40.873 08:14:26 -- app/version.sh@17 -- # major=24 00:06:40.873 08:14:26 -- app/version.sh@18 -- # get_header_version minor 00:06:40.873 08:14:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:40.873 08:14:26 -- app/version.sh@14 -- # cut -f2 00:06:40.873 08:14:26 -- app/version.sh@14 -- # tr -d '"' 00:06:40.873 08:14:26 -- app/version.sh@18 -- # minor=1 00:06:40.873 08:14:26 -- app/version.sh@19 -- # get_header_version patch 00:06:40.873 08:14:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:40.873 08:14:26 -- app/version.sh@14 -- # cut -f2 00:06:40.873 08:14:26 -- app/version.sh@14 -- # tr -d '"' 00:06:40.873 08:14:26 -- app/version.sh@19 -- # patch=1 00:06:40.873 08:14:26 -- app/version.sh@20 -- # get_header_version suffix 00:06:40.873 08:14:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:40.873 08:14:26 -- app/version.sh@14 -- # cut -f2 00:06:40.873 08:14:26 -- app/version.sh@14 -- # tr -d '"' 00:06:40.873 08:14:26 -- app/version.sh@20 -- # suffix=-pre 00:06:40.873 08:14:26 -- app/version.sh@22 -- # version=24.1 00:06:40.873 08:14:26 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:40.873 08:14:26 -- app/version.sh@25 -- # version=24.1.1 00:06:40.873 08:14:26 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:40.873 08:14:26 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:40.873 08:14:26 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:40.873 08:14:26 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:40.873 08:14:26 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:40.873 00:06:40.873 real 0m0.208s 00:06:40.873 user 0m0.138s 00:06:40.873 sys 0m0.096s 00:06:40.873 08:14:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.873 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:40.873 ************************************ 00:06:40.873 END TEST version 00:06:40.873 ************************************ 00:06:40.873 08:14:26 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@191 -- # uname -s 00:06:40.873 08:14:26 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:40.873 08:14:26 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:40.873 08:14:26 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:40.873 08:14:26 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:40.873 08:14:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:40.873 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:40.873 08:14:26 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:40.873 08:14:26 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:40.873 08:14:26 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:40.873 08:14:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:40.873 08:14:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.873 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:40.873 ************************************ 00:06:40.873 START TEST nvmf_tcp 00:06:40.873 ************************************ 00:06:40.873 08:14:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:40.873 * Looking for test storage... 00:06:40.873 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:40.873 08:14:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.873 08:14:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.873 08:14:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:41.133 08:14:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:41.133 08:14:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:41.133 08:14:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:41.133 08:14:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:41.133 08:14:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:41.133 08:14:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:41.133 08:14:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:41.133 08:14:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:41.133 08:14:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:41.133 08:14:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:41.133 08:14:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:41.133 08:14:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:41.133 08:14:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:41.133 08:14:26 -- scripts/common.sh@344 -- # : 1 00:06:41.133 08:14:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:41.133 08:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:41.133 08:14:26 -- scripts/common.sh@364 -- # decimal 1 00:06:41.133 08:14:26 -- scripts/common.sh@352 -- # local d=1 00:06:41.133 08:14:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:41.133 08:14:26 -- scripts/common.sh@354 -- # echo 1 00:06:41.133 08:14:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:41.133 08:14:26 -- scripts/common.sh@365 -- # decimal 2 00:06:41.133 08:14:26 -- scripts/common.sh@352 -- # local d=2 00:06:41.133 08:14:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:41.133 08:14:26 -- scripts/common.sh@354 -- # echo 2 00:06:41.133 08:14:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:41.133 08:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:41.133 08:14:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:41.133 08:14:26 -- scripts/common.sh@367 -- # return 0 00:06:41.133 08:14:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:41.133 08:14:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:41.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.133 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:41.134 08:14:26 -- nvmf/common.sh@7 -- # uname -s 00:06:41.134 08:14:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:41.134 08:14:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:41.134 08:14:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:41.134 08:14:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:41.134 08:14:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:41.134 08:14:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:41.134 08:14:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:41.134 08:14:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:41.134 08:14:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:41.134 08:14:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:41.134 08:14:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.134 08:14:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.134 08:14:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:41.134 08:14:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:41.134 08:14:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:41.134 08:14:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:41.134 08:14:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:41.134 08:14:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:41.134 08:14:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:41.134 08:14:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.134 08:14:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.134 08:14:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.134 08:14:26 -- paths/export.sh@5 -- # export PATH 00:06:41.134 08:14:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.134 08:14:26 -- nvmf/common.sh@46 -- # : 0 00:06:41.134 08:14:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:41.134 08:14:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:41.134 08:14:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:41.134 08:14:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:41.134 08:14:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:41.134 08:14:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:41.134 08:14:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:41.134 08:14:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:41.134 08:14:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:41.134 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:41.134 08:14:26 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:41.134 08:14:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.134 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:41.134 ************************************ 00:06:41.134 START TEST nvmf_example 00:06:41.134 ************************************ 00:06:41.134 08:14:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:41.134 * Looking for test storage... 00:06:41.134 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:41.134 08:14:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:41.134 08:14:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:41.134 08:14:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:41.134 08:14:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:41.134 08:14:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:41.134 08:14:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:41.134 08:14:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:41.134 08:14:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:41.134 08:14:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:41.134 08:14:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:41.134 08:14:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:41.134 08:14:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:41.134 08:14:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:41.134 08:14:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:41.134 08:14:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:41.134 08:14:26 -- scripts/common.sh@344 -- # : 1 00:06:41.134 08:14:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:41.134 08:14:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:41.134 08:14:26 -- scripts/common.sh@364 -- # decimal 1 00:06:41.134 08:14:26 -- scripts/common.sh@352 -- # local d=1 00:06:41.134 08:14:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:41.134 08:14:26 -- scripts/common.sh@354 -- # echo 1 00:06:41.134 08:14:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:41.134 08:14:26 -- scripts/common.sh@365 -- # decimal 2 00:06:41.134 08:14:26 -- scripts/common.sh@352 -- # local d=2 00:06:41.134 08:14:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:41.134 08:14:26 -- scripts/common.sh@354 -- # echo 2 00:06:41.134 08:14:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:41.134 08:14:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:41.134 08:14:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:41.134 08:14:26 -- scripts/common.sh@367 -- # return 0 00:06:41.134 08:14:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:41.134 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:41.134 --rc genhtml_branch_coverage=1 00:06:41.134 --rc genhtml_function_coverage=1 00:06:41.134 --rc genhtml_legend=1 00:06:41.134 --rc geninfo_all_blocks=1 00:06:41.134 --rc geninfo_unexecuted_blocks=1 00:06:41.134 00:06:41.134 ' 00:06:41.134 08:14:26 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:41.134 08:14:26 -- nvmf/common.sh@7 -- # uname -s 00:06:41.134 08:14:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:41.134 08:14:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:41.135 08:14:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:41.135 08:14:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:41.135 08:14:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:41.135 08:14:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:41.135 08:14:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:41.135 08:14:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:41.135 08:14:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:41.135 08:14:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:41.135 08:14:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.135 08:14:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:41.135 08:14:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:41.135 08:14:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:41.135 08:14:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:41.135 08:14:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:41.135 08:14:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:41.135 08:14:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:41.135 08:14:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:41.135 08:14:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.135 08:14:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.135 08:14:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.135 08:14:26 -- paths/export.sh@5 -- # export PATH 00:06:41.135 08:14:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:41.135 08:14:26 -- nvmf/common.sh@46 -- # : 0 00:06:41.135 08:14:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:41.135 08:14:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:41.135 08:14:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:41.135 08:14:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:41.135 08:14:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:41.135 08:14:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:41.135 08:14:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:41.135 08:14:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:41.135 08:14:26 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:41.135 08:14:26 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:41.135 08:14:26 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:41.135 08:14:26 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:41.135 08:14:26 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:41.135 08:14:26 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:41.135 08:14:26 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:41.135 08:14:26 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:41.135 08:14:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:41.135 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:41.135 08:14:26 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:41.135 08:14:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:41.135 08:14:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:41.135 08:14:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:41.135 08:14:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:41.135 08:14:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:41.135 08:14:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:41.135 08:14:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:41.135 08:14:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:41.135 08:14:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:41.135 08:14:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:41.135 08:14:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:41.135 08:14:26 -- common/autotest_common.sh@10 -- # set +x 00:06:43.671 08:14:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:43.671 08:14:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:43.671 08:14:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:43.671 08:14:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:43.671 08:14:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:43.671 08:14:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:43.671 08:14:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:43.671 08:14:29 -- nvmf/common.sh@294 -- # net_devs=() 00:06:43.671 08:14:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:43.671 08:14:29 -- nvmf/common.sh@295 -- # e810=() 00:06:43.671 08:14:29 -- nvmf/common.sh@295 -- # local -ga e810 00:06:43.671 08:14:29 -- nvmf/common.sh@296 -- # x722=() 00:06:43.671 08:14:29 -- nvmf/common.sh@296 -- # local -ga x722 00:06:43.671 08:14:29 -- nvmf/common.sh@297 -- # mlx=() 00:06:43.671 08:14:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:43.671 08:14:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:43.671 08:14:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:43.671 08:14:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:43.671 08:14:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:43.671 08:14:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:43.671 08:14:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:43.671 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:43.671 08:14:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:43.671 08:14:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:43.671 08:14:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:43.671 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:43.672 08:14:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:43.672 08:14:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:43.672 08:14:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:43.672 08:14:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:43.672 08:14:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:43.672 08:14:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:43.672 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:43.672 08:14:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:43.672 08:14:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:43.672 08:14:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:43.672 08:14:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:43.672 08:14:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:43.672 08:14:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:43.672 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:43.672 08:14:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:43.672 08:14:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:43.672 08:14:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:43.672 08:14:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:43.672 08:14:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:43.672 08:14:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:43.672 08:14:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:43.672 08:14:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:43.672 08:14:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:43.672 08:14:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:43.672 08:14:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:43.672 08:14:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:43.672 08:14:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:43.672 08:14:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:43.672 08:14:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:43.672 08:14:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:43.672 08:14:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:43.672 08:14:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:43.672 08:14:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:43.672 08:14:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:43.672 08:14:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:43.672 08:14:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:43.672 08:14:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:43.672 08:14:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:43.672 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:43.672 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:06:43.672 00:06:43.672 --- 10.0.0.2 ping statistics --- 00:06:43.672 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:43.672 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:06:43.672 08:14:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:43.672 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:43.672 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.189 ms 00:06:43.672 00:06:43.672 --- 10.0.0.1 ping statistics --- 00:06:43.672 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:43.672 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:06:43.672 08:14:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:43.672 08:14:29 -- nvmf/common.sh@410 -- # return 0 00:06:43.672 08:14:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:43.672 08:14:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:43.672 08:14:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:43.672 08:14:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:43.672 08:14:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:43.672 08:14:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:43.672 08:14:29 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:43.672 08:14:29 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:43.672 08:14:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:43.672 08:14:29 -- common/autotest_common.sh@10 -- # set +x 00:06:43.672 08:14:29 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:43.672 08:14:29 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:43.672 08:14:29 -- target/nvmf_example.sh@34 -- # nvmfpid=856829 00:06:43.672 08:14:29 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:43.672 08:14:29 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:43.672 08:14:29 -- target/nvmf_example.sh@36 -- # waitforlisten 856829 00:06:43.672 08:14:29 -- common/autotest_common.sh@829 -- # '[' -z 856829 ']' 00:06:43.672 08:14:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.672 08:14:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.672 08:14:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.672 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.672 08:14:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.672 08:14:29 -- common/autotest_common.sh@10 -- # set +x 00:06:43.672 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.605 08:14:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.605 08:14:30 -- common/autotest_common.sh@862 -- # return 0 00:06:44.605 08:14:30 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:44.605 08:14:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:44.605 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:44.863 08:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.863 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.863 08:14:30 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:44.863 08:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.863 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.863 08:14:30 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:44.863 08:14:30 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:44.863 08:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.863 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.863 08:14:30 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:44.863 08:14:30 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:44.863 08:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.863 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.863 08:14:30 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:44.863 08:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.863 08:14:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.863 08:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.863 08:14:30 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:44.863 08:14:30 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:44.863 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.065 Initializing NVMe Controllers 00:06:57.065 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:57.065 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:57.065 Initialization complete. Launching workers. 00:06:57.065 ======================================================== 00:06:57.065 Latency(us) 00:06:57.065 Device Information : IOPS MiB/s Average min max 00:06:57.065 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14636.43 57.17 4372.27 835.18 20187.97 00:06:57.065 ======================================================== 00:06:57.065 Total : 14636.43 57.17 4372.27 835.18 20187.97 00:06:57.065 00:06:57.065 08:14:40 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:57.065 08:14:40 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:57.065 08:14:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:57.065 08:14:40 -- nvmf/common.sh@116 -- # sync 00:06:57.065 08:14:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:57.065 08:14:40 -- nvmf/common.sh@119 -- # set +e 00:06:57.065 08:14:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:57.065 08:14:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:57.065 rmmod nvme_tcp 00:06:57.065 rmmod nvme_fabrics 00:06:57.065 rmmod nvme_keyring 00:06:57.065 08:14:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:57.065 08:14:40 -- nvmf/common.sh@123 -- # set -e 00:06:57.065 08:14:40 -- nvmf/common.sh@124 -- # return 0 00:06:57.065 08:14:40 -- nvmf/common.sh@477 -- # '[' -n 856829 ']' 00:06:57.065 08:14:40 -- nvmf/common.sh@478 -- # killprocess 856829 00:06:57.065 08:14:40 -- common/autotest_common.sh@936 -- # '[' -z 856829 ']' 00:06:57.065 08:14:40 -- common/autotest_common.sh@940 -- # kill -0 856829 00:06:57.065 08:14:40 -- common/autotest_common.sh@941 -- # uname 00:06:57.065 08:14:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:57.065 08:14:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 856829 00:06:57.065 08:14:40 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:57.065 08:14:40 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:57.065 08:14:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 856829' 00:06:57.065 killing process with pid 856829 00:06:57.065 08:14:40 -- common/autotest_common.sh@955 -- # kill 856829 00:06:57.065 08:14:40 -- common/autotest_common.sh@960 -- # wait 856829 00:06:57.065 nvmf threads initialize successfully 00:06:57.065 bdev subsystem init successfully 00:06:57.065 created a nvmf target service 00:06:57.065 create targets's poll groups done 00:06:57.065 all subsystems of target started 00:06:57.065 nvmf target is running 00:06:57.065 all subsystems of target stopped 00:06:57.065 destroy targets's poll groups done 00:06:57.065 destroyed the nvmf target service 00:06:57.065 bdev subsystem finish successfully 00:06:57.065 nvmf threads destroy successfully 00:06:57.065 08:14:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:57.065 08:14:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:57.065 08:14:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:57.065 08:14:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:57.065 08:14:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:57.065 08:14:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.065 08:14:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.065 08:14:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:57.635 08:14:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:57.635 08:14:43 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:57.635 08:14:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:57.635 08:14:43 -- common/autotest_common.sh@10 -- # set +x 00:06:57.635 00:06:57.635 real 0m16.471s 00:06:57.635 user 0m43.855s 00:06:57.635 sys 0m4.392s 00:06:57.635 08:14:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.635 08:14:43 -- common/autotest_common.sh@10 -- # set +x 00:06:57.635 ************************************ 00:06:57.635 END TEST nvmf_example 00:06:57.635 ************************************ 00:06:57.635 08:14:43 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:57.635 08:14:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.635 08:14:43 -- common/autotest_common.sh@10 -- # set +x 00:06:57.635 ************************************ 00:06:57.635 START TEST nvmf_filesystem 00:06:57.635 ************************************ 00:06:57.635 08:14:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:57.635 * Looking for test storage... 00:06:57.635 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.635 08:14:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:57.635 08:14:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:57.635 08:14:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:57.635 08:14:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:57.635 08:14:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:57.635 08:14:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:57.635 08:14:43 -- scripts/common.sh@335 -- # IFS=.-: 00:06:57.635 08:14:43 -- scripts/common.sh@335 -- # read -ra ver1 00:06:57.635 08:14:43 -- scripts/common.sh@336 -- # IFS=.-: 00:06:57.635 08:14:43 -- scripts/common.sh@336 -- # read -ra ver2 00:06:57.635 08:14:43 -- scripts/common.sh@337 -- # local 'op=<' 00:06:57.635 08:14:43 -- scripts/common.sh@339 -- # ver1_l=2 00:06:57.635 08:14:43 -- scripts/common.sh@340 -- # ver2_l=1 00:06:57.635 08:14:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:57.635 08:14:43 -- scripts/common.sh@343 -- # case "$op" in 00:06:57.635 08:14:43 -- scripts/common.sh@344 -- # : 1 00:06:57.635 08:14:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:57.635 08:14:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:57.635 08:14:43 -- scripts/common.sh@364 -- # decimal 1 00:06:57.635 08:14:43 -- scripts/common.sh@352 -- # local d=1 00:06:57.635 08:14:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:57.635 08:14:43 -- scripts/common.sh@354 -- # echo 1 00:06:57.635 08:14:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:57.635 08:14:43 -- scripts/common.sh@365 -- # decimal 2 00:06:57.635 08:14:43 -- scripts/common.sh@352 -- # local d=2 00:06:57.635 08:14:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:57.635 08:14:43 -- scripts/common.sh@354 -- # echo 2 00:06:57.635 08:14:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:57.635 08:14:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:57.635 08:14:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:57.635 08:14:43 -- scripts/common.sh@367 -- # return 0 00:06:57.635 08:14:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:57.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.635 --rc genhtml_branch_coverage=1 00:06:57.635 --rc genhtml_function_coverage=1 00:06:57.635 --rc genhtml_legend=1 00:06:57.635 --rc geninfo_all_blocks=1 00:06:57.635 --rc geninfo_unexecuted_blocks=1 00:06:57.635 00:06:57.635 ' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:57.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.635 --rc genhtml_branch_coverage=1 00:06:57.635 --rc genhtml_function_coverage=1 00:06:57.635 --rc genhtml_legend=1 00:06:57.635 --rc geninfo_all_blocks=1 00:06:57.635 --rc geninfo_unexecuted_blocks=1 00:06:57.635 00:06:57.635 ' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:57.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.635 --rc genhtml_branch_coverage=1 00:06:57.635 --rc genhtml_function_coverage=1 00:06:57.635 --rc genhtml_legend=1 00:06:57.635 --rc geninfo_all_blocks=1 00:06:57.635 --rc geninfo_unexecuted_blocks=1 00:06:57.635 00:06:57.635 ' 00:06:57.635 08:14:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:57.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.635 --rc genhtml_branch_coverage=1 00:06:57.635 --rc genhtml_function_coverage=1 00:06:57.635 --rc genhtml_legend=1 00:06:57.635 --rc geninfo_all_blocks=1 00:06:57.635 --rc geninfo_unexecuted_blocks=1 00:06:57.635 00:06:57.635 ' 00:06:57.635 08:14:43 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:57.635 08:14:43 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:57.635 08:14:43 -- common/autotest_common.sh@34 -- # set -e 00:06:57.635 08:14:43 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:57.635 08:14:43 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:57.635 08:14:43 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:57.636 08:14:43 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:57.636 08:14:43 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:57.636 08:14:43 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:57.636 08:14:43 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:57.636 08:14:43 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:57.636 08:14:43 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:57.636 08:14:43 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:57.636 08:14:43 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:57.636 08:14:43 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:57.636 08:14:43 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:57.636 08:14:43 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:57.636 08:14:43 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:57.636 08:14:43 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:57.636 08:14:43 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:57.636 08:14:43 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:57.636 08:14:43 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:57.636 08:14:43 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:57.636 08:14:43 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:57.636 08:14:43 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:57.636 08:14:43 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:57.636 08:14:43 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:57.636 08:14:43 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:57.636 08:14:43 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:57.636 08:14:43 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:57.636 08:14:43 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:57.636 08:14:43 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:57.636 08:14:43 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:57.636 08:14:43 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:57.636 08:14:43 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:57.636 08:14:43 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:57.636 08:14:43 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:57.636 08:14:43 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:57.636 08:14:43 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:57.636 08:14:43 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:57.636 08:14:43 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:57.636 08:14:43 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:57.636 08:14:43 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:57.636 08:14:43 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:57.636 08:14:43 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:57.636 08:14:43 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:57.636 08:14:43 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:57.636 08:14:43 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:57.636 08:14:43 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:57.636 08:14:43 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:57.636 08:14:43 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:57.636 08:14:43 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:57.636 08:14:43 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:57.636 08:14:43 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:57.636 08:14:43 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:57.636 08:14:43 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:57.636 08:14:43 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:57.636 08:14:43 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:57.636 08:14:43 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:57.636 08:14:43 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:57.636 08:14:43 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:57.636 08:14:43 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:57.636 08:14:43 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:57.636 08:14:43 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:57.636 08:14:43 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:57.636 08:14:43 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:57.636 08:14:43 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:57.636 08:14:43 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:57.636 08:14:43 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:57.636 08:14:43 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:57.636 08:14:43 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:57.636 08:14:43 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:57.636 08:14:43 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:57.636 08:14:43 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:57.636 08:14:43 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:57.636 08:14:43 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:57.636 08:14:43 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:57.636 08:14:43 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:57.636 08:14:43 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:57.636 08:14:43 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:57.636 08:14:43 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:57.636 08:14:43 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:57.636 08:14:43 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:57.636 08:14:43 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:57.636 08:14:43 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:57.636 08:14:43 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:57.636 08:14:43 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:57.636 08:14:43 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:57.636 08:14:43 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:57.636 08:14:43 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:57.636 08:14:43 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:57.636 08:14:43 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:57.636 08:14:43 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:57.636 08:14:43 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:57.636 08:14:43 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:57.636 08:14:43 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:57.636 #define SPDK_CONFIG_H 00:06:57.636 #define SPDK_CONFIG_APPS 1 00:06:57.636 #define SPDK_CONFIG_ARCH native 00:06:57.636 #undef SPDK_CONFIG_ASAN 00:06:57.636 #undef SPDK_CONFIG_AVAHI 00:06:57.636 #undef SPDK_CONFIG_CET 00:06:57.636 #define SPDK_CONFIG_COVERAGE 1 00:06:57.636 #define SPDK_CONFIG_CROSS_PREFIX 00:06:57.636 #undef SPDK_CONFIG_CRYPTO 00:06:57.636 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:57.636 #undef SPDK_CONFIG_CUSTOMOCF 00:06:57.636 #undef SPDK_CONFIG_DAOS 00:06:57.636 #define SPDK_CONFIG_DAOS_DIR 00:06:57.636 #define SPDK_CONFIG_DEBUG 1 00:06:57.636 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:57.636 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:57.636 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:57.636 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:57.636 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:57.636 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:57.636 #define SPDK_CONFIG_EXAMPLES 1 00:06:57.636 #undef SPDK_CONFIG_FC 00:06:57.636 #define SPDK_CONFIG_FC_PATH 00:06:57.636 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:57.636 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:57.636 #undef SPDK_CONFIG_FUSE 00:06:57.636 #undef SPDK_CONFIG_FUZZER 00:06:57.636 #define SPDK_CONFIG_FUZZER_LIB 00:06:57.636 #undef SPDK_CONFIG_GOLANG 00:06:57.636 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:57.636 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:57.636 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:57.636 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:57.636 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:57.636 #define SPDK_CONFIG_IDXD 1 00:06:57.636 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:57.636 #undef SPDK_CONFIG_IPSEC_MB 00:06:57.636 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:57.636 #define SPDK_CONFIG_ISAL 1 00:06:57.636 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:57.636 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:57.636 #define SPDK_CONFIG_LIBDIR 00:06:57.636 #undef SPDK_CONFIG_LTO 00:06:57.636 #define SPDK_CONFIG_MAX_LCORES 00:06:57.636 #define SPDK_CONFIG_NVME_CUSE 1 00:06:57.636 #undef SPDK_CONFIG_OCF 00:06:57.636 #define SPDK_CONFIG_OCF_PATH 00:06:57.636 #define SPDK_CONFIG_OPENSSL_PATH 00:06:57.636 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:57.636 #undef SPDK_CONFIG_PGO_USE 00:06:57.636 #define SPDK_CONFIG_PREFIX /usr/local 00:06:57.636 #undef SPDK_CONFIG_RAID5F 00:06:57.636 #undef SPDK_CONFIG_RBD 00:06:57.636 #define SPDK_CONFIG_RDMA 1 00:06:57.636 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:57.636 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:57.636 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:57.636 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:57.636 #define SPDK_CONFIG_SHARED 1 00:06:57.636 #undef SPDK_CONFIG_SMA 00:06:57.636 #define SPDK_CONFIG_TESTS 1 00:06:57.636 #undef SPDK_CONFIG_TSAN 00:06:57.636 #define SPDK_CONFIG_UBLK 1 00:06:57.636 #define SPDK_CONFIG_UBSAN 1 00:06:57.636 #undef SPDK_CONFIG_UNIT_TESTS 00:06:57.636 #undef SPDK_CONFIG_URING 00:06:57.636 #define SPDK_CONFIG_URING_PATH 00:06:57.636 #undef SPDK_CONFIG_URING_ZNS 00:06:57.636 #undef SPDK_CONFIG_USDT 00:06:57.636 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:57.636 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:57.636 #undef SPDK_CONFIG_VFIO_USER 00:06:57.636 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:57.636 #define SPDK_CONFIG_VHOST 1 00:06:57.637 #define SPDK_CONFIG_VIRTIO 1 00:06:57.637 #undef SPDK_CONFIG_VTUNE 00:06:57.637 #define SPDK_CONFIG_VTUNE_DIR 00:06:57.637 #define SPDK_CONFIG_WERROR 1 00:06:57.637 #define SPDK_CONFIG_WPDK_DIR 00:06:57.637 #undef SPDK_CONFIG_XNVME 00:06:57.637 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:57.637 08:14:43 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:57.637 08:14:43 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:57.637 08:14:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:57.637 08:14:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:57.637 08:14:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:57.637 08:14:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.637 08:14:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.637 08:14:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.637 08:14:43 -- paths/export.sh@5 -- # export PATH 00:06:57.637 08:14:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.637 08:14:43 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:57.637 08:14:43 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:57.637 08:14:43 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:57.637 08:14:43 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:57.637 08:14:43 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:57.637 08:14:43 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:57.637 08:14:43 -- pm/common@16 -- # TEST_TAG=N/A 00:06:57.637 08:14:43 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:57.637 08:14:43 -- common/autotest_common.sh@52 -- # : 1 00:06:57.637 08:14:43 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:57.637 08:14:43 -- common/autotest_common.sh@56 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:57.637 08:14:43 -- common/autotest_common.sh@58 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:57.637 08:14:43 -- common/autotest_common.sh@60 -- # : 1 00:06:57.637 08:14:43 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:57.637 08:14:43 -- common/autotest_common.sh@62 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:57.637 08:14:43 -- common/autotest_common.sh@64 -- # : 00:06:57.637 08:14:43 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:57.637 08:14:43 -- common/autotest_common.sh@66 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:57.637 08:14:43 -- common/autotest_common.sh@68 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:57.637 08:14:43 -- common/autotest_common.sh@70 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:57.637 08:14:43 -- common/autotest_common.sh@72 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:57.637 08:14:43 -- common/autotest_common.sh@74 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:57.637 08:14:43 -- common/autotest_common.sh@76 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:57.637 08:14:43 -- common/autotest_common.sh@78 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:57.637 08:14:43 -- common/autotest_common.sh@80 -- # : 1 00:06:57.637 08:14:43 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:57.637 08:14:43 -- common/autotest_common.sh@82 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:57.637 08:14:43 -- common/autotest_common.sh@84 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:57.637 08:14:43 -- common/autotest_common.sh@86 -- # : 1 00:06:57.637 08:14:43 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:57.637 08:14:43 -- common/autotest_common.sh@88 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:57.637 08:14:43 -- common/autotest_common.sh@90 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:57.637 08:14:43 -- common/autotest_common.sh@92 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:57.637 08:14:43 -- common/autotest_common.sh@94 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:57.637 08:14:43 -- common/autotest_common.sh@96 -- # : tcp 00:06:57.637 08:14:43 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:57.637 08:14:43 -- common/autotest_common.sh@98 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:57.637 08:14:43 -- common/autotest_common.sh@100 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:57.637 08:14:43 -- common/autotest_common.sh@102 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:57.637 08:14:43 -- common/autotest_common.sh@104 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:57.637 08:14:43 -- common/autotest_common.sh@106 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:57.637 08:14:43 -- common/autotest_common.sh@108 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:57.637 08:14:43 -- common/autotest_common.sh@110 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:57.637 08:14:43 -- common/autotest_common.sh@112 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:57.637 08:14:43 -- common/autotest_common.sh@114 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:57.637 08:14:43 -- common/autotest_common.sh@116 -- # : 1 00:06:57.637 08:14:43 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:57.637 08:14:43 -- common/autotest_common.sh@118 -- # : 00:06:57.637 08:14:43 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:57.637 08:14:43 -- common/autotest_common.sh@120 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:57.637 08:14:43 -- common/autotest_common.sh@122 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:57.637 08:14:43 -- common/autotest_common.sh@124 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:57.637 08:14:43 -- common/autotest_common.sh@126 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:57.637 08:14:43 -- common/autotest_common.sh@128 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:57.637 08:14:43 -- common/autotest_common.sh@130 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:57.637 08:14:43 -- common/autotest_common.sh@132 -- # : 00:06:57.637 08:14:43 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:57.637 08:14:43 -- common/autotest_common.sh@134 -- # : true 00:06:57.637 08:14:43 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:57.637 08:14:43 -- common/autotest_common.sh@136 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:57.637 08:14:43 -- common/autotest_common.sh@138 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:57.637 08:14:43 -- common/autotest_common.sh@140 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:57.637 08:14:43 -- common/autotest_common.sh@142 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:57.637 08:14:43 -- common/autotest_common.sh@144 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:57.637 08:14:43 -- common/autotest_common.sh@146 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:57.637 08:14:43 -- common/autotest_common.sh@148 -- # : e810 00:06:57.637 08:14:43 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:57.637 08:14:43 -- common/autotest_common.sh@150 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:57.637 08:14:43 -- common/autotest_common.sh@152 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:57.637 08:14:43 -- common/autotest_common.sh@154 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:57.637 08:14:43 -- common/autotest_common.sh@156 -- # : 0 00:06:57.637 08:14:43 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:57.637 08:14:43 -- common/autotest_common.sh@158 -- # : 0 00:06:57.898 08:14:43 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:57.898 08:14:43 -- common/autotest_common.sh@160 -- # : 0 00:06:57.898 08:14:43 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:57.898 08:14:43 -- common/autotest_common.sh@163 -- # : 00:06:57.898 08:14:43 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:57.898 08:14:43 -- common/autotest_common.sh@165 -- # : 0 00:06:57.898 08:14:43 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:57.898 08:14:43 -- common/autotest_common.sh@167 -- # : 0 00:06:57.898 08:14:43 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:57.898 08:14:43 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:57.898 08:14:43 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:57.898 08:14:43 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:57.898 08:14:43 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:57.898 08:14:43 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:57.898 08:14:43 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:57.898 08:14:43 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:57.898 08:14:43 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:57.898 08:14:43 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:57.898 08:14:43 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:57.898 08:14:43 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:57.898 08:14:43 -- common/autotest_common.sh@196 -- # cat 00:06:57.898 08:14:43 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:57.898 08:14:43 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:57.898 08:14:43 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:57.898 08:14:43 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:57.898 08:14:43 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:57.898 08:14:43 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:57.898 08:14:43 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:57.898 08:14:43 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:57.898 08:14:43 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:57.898 08:14:43 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:57.898 08:14:43 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:57.898 08:14:43 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:57.898 08:14:43 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:57.898 08:14:43 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:57.898 08:14:43 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:57.898 08:14:43 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:57.898 08:14:43 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:57.898 08:14:43 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:57.898 08:14:43 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:57.898 08:14:43 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:57.898 08:14:43 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:57.898 08:14:43 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:57.898 08:14:43 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:57.898 08:14:43 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:57.898 08:14:43 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:57.898 08:14:43 -- common/autotest_common.sh@259 -- # valgrind= 00:06:57.898 08:14:43 -- common/autotest_common.sh@265 -- # uname -s 00:06:57.898 08:14:43 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:57.898 08:14:43 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:57.898 08:14:43 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:57.898 08:14:43 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:57.898 08:14:43 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:57.898 08:14:43 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:57.898 08:14:43 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:57.898 08:14:43 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:57.898 08:14:43 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:57.898 08:14:43 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:57.898 08:14:43 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:57.898 08:14:43 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:57.898 08:14:43 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:57.898 08:14:43 -- common/autotest_common.sh@319 -- # [[ -z 858705 ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@319 -- # kill -0 858705 00:06:57.898 08:14:43 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:57.898 08:14:43 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:57.898 08:14:43 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:57.898 08:14:43 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:57.898 08:14:43 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:57.898 08:14:43 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:57.898 08:14:43 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:57.898 08:14:43 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.InafHn 00:06:57.898 08:14:43 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:57.898 08:14:43 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:57.898 08:14:43 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.InafHn/tests/target /tmp/spdk.InafHn 00:06:57.898 08:14:43 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:57.898 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.898 08:14:43 -- common/autotest_common.sh@328 -- # df -T 00:06:57.898 08:14:43 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:57.898 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:57.898 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:57.898 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:57.898 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:57.898 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:57.898 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.898 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:57.898 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=55270604800 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988515840 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=6717911040 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993207296 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=1052672 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:57.899 08:14:43 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:57.899 08:14:43 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:57.899 08:14:43 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:57.899 08:14:43 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:57.899 * Looking for test storage... 00:06:57.899 08:14:43 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:57.899 08:14:43 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:57.899 08:14:43 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.899 08:14:43 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:57.899 08:14:43 -- common/autotest_common.sh@373 -- # mount=/ 00:06:57.899 08:14:43 -- common/autotest_common.sh@375 -- # target_space=55270604800 00:06:57.899 08:14:43 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:57.899 08:14:43 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:57.899 08:14:43 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@382 -- # new_size=8932503552 00:06:57.899 08:14:43 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:57.899 08:14:43 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.899 08:14:43 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.899 08:14:43 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.899 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:57.899 08:14:43 -- common/autotest_common.sh@390 -- # return 0 00:06:57.899 08:14:43 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:57.899 08:14:43 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:57.899 08:14:43 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:57.899 08:14:43 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1682 -- # true 00:06:57.899 08:14:43 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:57.899 08:14:43 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@27 -- # exec 00:06:57.899 08:14:43 -- common/autotest_common.sh@29 -- # exec 00:06:57.899 08:14:43 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:57.899 08:14:43 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:57.899 08:14:43 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:57.899 08:14:43 -- common/autotest_common.sh@18 -- # set -x 00:06:57.899 08:14:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:57.899 08:14:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:57.899 08:14:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:57.899 08:14:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:57.899 08:14:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:57.899 08:14:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:57.899 08:14:43 -- scripts/common.sh@335 -- # IFS=.-: 00:06:57.899 08:14:43 -- scripts/common.sh@335 -- # read -ra ver1 00:06:57.899 08:14:43 -- scripts/common.sh@336 -- # IFS=.-: 00:06:57.899 08:14:43 -- scripts/common.sh@336 -- # read -ra ver2 00:06:57.899 08:14:43 -- scripts/common.sh@337 -- # local 'op=<' 00:06:57.899 08:14:43 -- scripts/common.sh@339 -- # ver1_l=2 00:06:57.899 08:14:43 -- scripts/common.sh@340 -- # ver2_l=1 00:06:57.899 08:14:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:57.899 08:14:43 -- scripts/common.sh@343 -- # case "$op" in 00:06:57.899 08:14:43 -- scripts/common.sh@344 -- # : 1 00:06:57.899 08:14:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:57.899 08:14:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:57.899 08:14:43 -- scripts/common.sh@364 -- # decimal 1 00:06:57.899 08:14:43 -- scripts/common.sh@352 -- # local d=1 00:06:57.899 08:14:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:57.899 08:14:43 -- scripts/common.sh@354 -- # echo 1 00:06:57.899 08:14:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:57.899 08:14:43 -- scripts/common.sh@365 -- # decimal 2 00:06:57.899 08:14:43 -- scripts/common.sh@352 -- # local d=2 00:06:57.899 08:14:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:57.899 08:14:43 -- scripts/common.sh@354 -- # echo 2 00:06:57.899 08:14:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:57.899 08:14:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:57.899 08:14:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:57.899 08:14:43 -- scripts/common.sh@367 -- # return 0 00:06:57.899 08:14:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:57.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.899 --rc genhtml_branch_coverage=1 00:06:57.899 --rc genhtml_function_coverage=1 00:06:57.899 --rc genhtml_legend=1 00:06:57.899 --rc geninfo_all_blocks=1 00:06:57.899 --rc geninfo_unexecuted_blocks=1 00:06:57.899 00:06:57.899 ' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:57.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.899 --rc genhtml_branch_coverage=1 00:06:57.899 --rc genhtml_function_coverage=1 00:06:57.899 --rc genhtml_legend=1 00:06:57.899 --rc geninfo_all_blocks=1 00:06:57.899 --rc geninfo_unexecuted_blocks=1 00:06:57.899 00:06:57.899 ' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:57.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.899 --rc genhtml_branch_coverage=1 00:06:57.899 --rc genhtml_function_coverage=1 00:06:57.899 --rc genhtml_legend=1 00:06:57.899 --rc geninfo_all_blocks=1 00:06:57.899 --rc geninfo_unexecuted_blocks=1 00:06:57.899 00:06:57.899 ' 00:06:57.899 08:14:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:57.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:57.899 --rc genhtml_branch_coverage=1 00:06:57.899 --rc genhtml_function_coverage=1 00:06:57.899 --rc genhtml_legend=1 00:06:57.899 --rc geninfo_all_blocks=1 00:06:57.899 --rc geninfo_unexecuted_blocks=1 00:06:57.899 00:06:57.899 ' 00:06:57.899 08:14:43 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:57.899 08:14:43 -- nvmf/common.sh@7 -- # uname -s 00:06:57.899 08:14:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:57.899 08:14:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:57.899 08:14:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:57.899 08:14:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:57.899 08:14:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:57.899 08:14:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:57.899 08:14:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:57.899 08:14:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:57.899 08:14:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:57.899 08:14:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:57.899 08:14:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:57.899 08:14:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:57.899 08:14:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:57.899 08:14:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:57.899 08:14:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:57.899 08:14:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:57.899 08:14:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:57.899 08:14:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:57.899 08:14:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:57.900 08:14:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.900 08:14:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.900 08:14:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.900 08:14:43 -- paths/export.sh@5 -- # export PATH 00:06:57.900 08:14:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:57.900 08:14:43 -- nvmf/common.sh@46 -- # : 0 00:06:57.900 08:14:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:57.900 08:14:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:57.900 08:14:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:57.900 08:14:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:57.900 08:14:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:57.900 08:14:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:57.900 08:14:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:57.900 08:14:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:57.900 08:14:43 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:57.900 08:14:43 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:57.900 08:14:43 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:57.900 08:14:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:57.900 08:14:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:57.900 08:14:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:57.900 08:14:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:57.900 08:14:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:57.900 08:14:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.900 08:14:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.900 08:14:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:57.900 08:14:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:57.900 08:14:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:57.900 08:14:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:57.900 08:14:43 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 08:14:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:00.435 08:14:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:00.435 08:14:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:00.435 08:14:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:00.435 08:14:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:00.435 08:14:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:00.435 08:14:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:00.435 08:14:45 -- nvmf/common.sh@294 -- # net_devs=() 00:07:00.435 08:14:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:00.435 08:14:45 -- nvmf/common.sh@295 -- # e810=() 00:07:00.435 08:14:45 -- nvmf/common.sh@295 -- # local -ga e810 00:07:00.435 08:14:45 -- nvmf/common.sh@296 -- # x722=() 00:07:00.435 08:14:45 -- nvmf/common.sh@296 -- # local -ga x722 00:07:00.435 08:14:45 -- nvmf/common.sh@297 -- # mlx=() 00:07:00.435 08:14:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:00.435 08:14:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:00.435 08:14:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:00.435 08:14:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:00.435 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:00.435 08:14:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:00.435 08:14:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:00.435 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:00.435 08:14:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.435 08:14:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.435 08:14:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.435 08:14:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:00.435 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:00.435 08:14:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.435 08:14:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.435 08:14:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.435 08:14:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:00.435 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:00.435 08:14:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:00.435 08:14:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:00.435 08:14:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:00.435 08:14:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:00.435 08:14:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:00.435 08:14:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:00.435 08:14:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:00.435 08:14:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:00.435 08:14:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:00.435 08:14:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:00.435 08:14:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:00.435 08:14:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:00.435 08:14:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:00.435 08:14:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:00.435 08:14:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:00.435 08:14:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:00.435 08:14:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:00.435 08:14:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:00.435 08:14:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:00.435 08:14:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:00.435 08:14:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:00.435 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:00.435 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:07:00.435 00:07:00.435 --- 10.0.0.2 ping statistics --- 00:07:00.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.435 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:07:00.435 08:14:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:00.435 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:00.435 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:07:00.435 00:07:00.435 --- 10.0.0.1 ping statistics --- 00:07:00.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.435 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:07:00.435 08:14:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:00.435 08:14:45 -- nvmf/common.sh@410 -- # return 0 00:07:00.435 08:14:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:00.435 08:14:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:00.435 08:14:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:00.435 08:14:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:00.435 08:14:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:00.435 08:14:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:00.435 08:14:46 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:00.435 08:14:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:00.435 08:14:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.435 08:14:46 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 ************************************ 00:07:00.435 START TEST nvmf_filesystem_no_in_capsule 00:07:00.435 ************************************ 00:07:00.435 08:14:46 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:00.435 08:14:46 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:00.435 08:14:46 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:00.435 08:14:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:00.435 08:14:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:00.435 08:14:46 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 08:14:46 -- nvmf/common.sh@469 -- # nvmfpid=860355 00:07:00.435 08:14:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:00.435 08:14:46 -- nvmf/common.sh@470 -- # waitforlisten 860355 00:07:00.435 08:14:46 -- common/autotest_common.sh@829 -- # '[' -z 860355 ']' 00:07:00.435 08:14:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.435 08:14:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.435 08:14:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.435 08:14:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.435 08:14:46 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 [2024-11-26 08:14:46.076851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.435 [2024-11-26 08:14:46.076946] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:00.435 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.436 [2024-11-26 08:14:46.153047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:00.436 [2024-11-26 08:14:46.275692] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:00.436 [2024-11-26 08:14:46.275848] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:00.436 [2024-11-26 08:14:46.275868] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:00.436 [2024-11-26 08:14:46.275881] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:00.436 [2024-11-26 08:14:46.275937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:00.436 [2024-11-26 08:14:46.275994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:00.436 [2024-11-26 08:14:46.276046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:00.436 [2024-11-26 08:14:46.276050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.371 08:14:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:01.371 08:14:47 -- common/autotest_common.sh@862 -- # return 0 00:07:01.371 08:14:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:01.371 08:14:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:01.371 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.371 08:14:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:01.371 08:14:47 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:01.371 08:14:47 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:01.371 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.371 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.371 [2024-11-26 08:14:47.164485] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:01.371 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.371 08:14:47 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:01.371 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.371 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.628 Malloc1 00:07:01.628 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.628 08:14:47 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:01.628 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.628 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.628 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.628 08:14:47 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:01.628 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.628 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.628 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.628 08:14:47 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:01.628 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.628 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.628 [2024-11-26 08:14:47.362174] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:01.628 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.628 08:14:47 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:01.628 08:14:47 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:01.628 08:14:47 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:01.628 08:14:47 -- common/autotest_common.sh@1369 -- # local bs 00:07:01.628 08:14:47 -- common/autotest_common.sh@1370 -- # local nb 00:07:01.628 08:14:47 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:01.628 08:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.628 08:14:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.628 08:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.628 08:14:47 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:01.628 { 00:07:01.628 "name": "Malloc1", 00:07:01.628 "aliases": [ 00:07:01.628 "f28b1bc4-03a4-4267-bad2-689b54fa81bc" 00:07:01.628 ], 00:07:01.628 "product_name": "Malloc disk", 00:07:01.628 "block_size": 512, 00:07:01.628 "num_blocks": 1048576, 00:07:01.628 "uuid": "f28b1bc4-03a4-4267-bad2-689b54fa81bc", 00:07:01.628 "assigned_rate_limits": { 00:07:01.628 "rw_ios_per_sec": 0, 00:07:01.628 "rw_mbytes_per_sec": 0, 00:07:01.628 "r_mbytes_per_sec": 0, 00:07:01.628 "w_mbytes_per_sec": 0 00:07:01.628 }, 00:07:01.628 "claimed": true, 00:07:01.628 "claim_type": "exclusive_write", 00:07:01.628 "zoned": false, 00:07:01.628 "supported_io_types": { 00:07:01.628 "read": true, 00:07:01.628 "write": true, 00:07:01.628 "unmap": true, 00:07:01.628 "write_zeroes": true, 00:07:01.628 "flush": true, 00:07:01.628 "reset": true, 00:07:01.628 "compare": false, 00:07:01.628 "compare_and_write": false, 00:07:01.628 "abort": true, 00:07:01.628 "nvme_admin": false, 00:07:01.628 "nvme_io": false 00:07:01.628 }, 00:07:01.628 "memory_domains": [ 00:07:01.628 { 00:07:01.628 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:01.628 "dma_device_type": 2 00:07:01.628 } 00:07:01.628 ], 00:07:01.628 "driver_specific": {} 00:07:01.628 } 00:07:01.628 ]' 00:07:01.628 08:14:47 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:01.628 08:14:47 -- common/autotest_common.sh@1372 -- # bs=512 00:07:01.628 08:14:47 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:01.628 08:14:47 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:01.628 08:14:47 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:01.628 08:14:47 -- common/autotest_common.sh@1377 -- # echo 512 00:07:01.628 08:14:47 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:01.628 08:14:47 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:02.559 08:14:48 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:02.559 08:14:48 -- common/autotest_common.sh@1187 -- # local i=0 00:07:02.559 08:14:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:02.559 08:14:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:02.559 08:14:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:04.461 08:14:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:04.461 08:14:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:04.461 08:14:50 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:04.461 08:14:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:04.461 08:14:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:04.461 08:14:50 -- common/autotest_common.sh@1197 -- # return 0 00:07:04.461 08:14:50 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:04.461 08:14:50 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:04.461 08:14:50 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:04.461 08:14:50 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:04.461 08:14:50 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:04.461 08:14:50 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:04.461 08:14:50 -- setup/common.sh@80 -- # echo 536870912 00:07:04.461 08:14:50 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:04.461 08:14:50 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:04.461 08:14:50 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:04.461 08:14:50 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:04.719 08:14:50 -- target/filesystem.sh@69 -- # partprobe 00:07:04.976 08:14:50 -- target/filesystem.sh@70 -- # sleep 1 00:07:05.909 08:14:51 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:05.909 08:14:51 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:05.909 08:14:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:05.909 08:14:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.909 08:14:51 -- common/autotest_common.sh@10 -- # set +x 00:07:05.909 ************************************ 00:07:05.909 START TEST filesystem_ext4 00:07:05.909 ************************************ 00:07:05.909 08:14:51 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:05.909 08:14:51 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:05.909 08:14:51 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.909 08:14:51 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:05.909 08:14:51 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:05.909 08:14:51 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:05.909 08:14:51 -- common/autotest_common.sh@914 -- # local i=0 00:07:05.909 08:14:51 -- common/autotest_common.sh@915 -- # local force 00:07:05.909 08:14:51 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:05.909 08:14:51 -- common/autotest_common.sh@918 -- # force=-F 00:07:05.909 08:14:51 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:05.909 mke2fs 1.47.0 (5-Feb-2023) 00:07:06.168 Discarding device blocks: 0/522240 done 00:07:06.168 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:06.168 Filesystem UUID: 00b84aae-3a7a-4f49-a449-28349ddc0b80 00:07:06.168 Superblock backups stored on blocks: 00:07:06.168 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:06.168 00:07:06.168 Allocating group tables: 0/64 done 00:07:06.168 Writing inode tables: 0/64 done 00:07:08.068 Creating journal (8192 blocks): done 00:07:09.824 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:07:09.824 00:07:09.824 08:14:55 -- common/autotest_common.sh@931 -- # return 0 00:07:09.824 08:14:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.381 08:15:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.381 08:15:01 -- target/filesystem.sh@25 -- # sync 00:07:16.381 08:15:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.381 08:15:01 -- target/filesystem.sh@27 -- # sync 00:07:16.381 08:15:01 -- target/filesystem.sh@29 -- # i=0 00:07:16.381 08:15:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.381 08:15:01 -- target/filesystem.sh@37 -- # kill -0 860355 00:07:16.381 08:15:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.381 08:15:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.381 08:15:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.381 00:07:16.381 real 0m9.414s 00:07:16.381 user 0m0.015s 00:07:16.381 sys 0m0.065s 00:07:16.381 08:15:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.381 08:15:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.381 ************************************ 00:07:16.381 END TEST filesystem_ext4 00:07:16.381 ************************************ 00:07:16.381 08:15:01 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:16.381 08:15:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:16.381 08:15:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.381 08:15:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.381 ************************************ 00:07:16.381 START TEST filesystem_btrfs 00:07:16.381 ************************************ 00:07:16.381 08:15:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:16.381 08:15:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:16.381 08:15:01 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:16.381 08:15:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:16.381 08:15:01 -- common/autotest_common.sh@914 -- # local i=0 00:07:16.381 08:15:01 -- common/autotest_common.sh@915 -- # local force 00:07:16.381 08:15:01 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:16.381 08:15:01 -- common/autotest_common.sh@920 -- # force=-f 00:07:16.381 08:15:01 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:16.381 btrfs-progs v6.8.1 00:07:16.381 See https://btrfs.readthedocs.io for more information. 00:07:16.381 00:07:16.381 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:16.381 NOTE: several default settings have changed in version 5.15, please make sure 00:07:16.381 this does not affect your deployments: 00:07:16.381 - DUP for metadata (-m dup) 00:07:16.381 - enabled no-holes (-O no-holes) 00:07:16.381 - enabled free-space-tree (-R free-space-tree) 00:07:16.381 00:07:16.381 Label: (null) 00:07:16.381 UUID: 3b9b69bc-1da5-46e0-9c20-50abee1ac839 00:07:16.381 Node size: 16384 00:07:16.381 Sector size: 4096 (CPU page size: 4096) 00:07:16.381 Filesystem size: 510.00MiB 00:07:16.381 Block group profiles: 00:07:16.381 Data: single 8.00MiB 00:07:16.381 Metadata: DUP 32.00MiB 00:07:16.381 System: DUP 8.00MiB 00:07:16.381 SSD detected: yes 00:07:16.381 Zoned device: no 00:07:16.381 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:16.381 Checksum: crc32c 00:07:16.381 Number of devices: 1 00:07:16.381 Devices: 00:07:16.381 ID SIZE PATH 00:07:16.381 1 510.00MiB /dev/nvme0n1p1 00:07:16.381 00:07:16.381 08:15:01 -- common/autotest_common.sh@931 -- # return 0 00:07:16.381 08:15:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.381 08:15:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.381 08:15:01 -- target/filesystem.sh@25 -- # sync 00:07:16.381 08:15:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.381 08:15:01 -- target/filesystem.sh@27 -- # sync 00:07:16.381 08:15:01 -- target/filesystem.sh@29 -- # i=0 00:07:16.381 08:15:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.381 08:15:01 -- target/filesystem.sh@37 -- # kill -0 860355 00:07:16.381 08:15:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.381 08:15:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.381 08:15:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.381 00:07:16.381 real 0m0.637s 00:07:16.381 user 0m0.015s 00:07:16.381 sys 0m0.095s 00:07:16.381 08:15:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.381 08:15:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.381 ************************************ 00:07:16.381 END TEST filesystem_btrfs 00:07:16.381 ************************************ 00:07:16.381 08:15:01 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:16.381 08:15:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:16.381 08:15:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.381 08:15:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.381 ************************************ 00:07:16.381 START TEST filesystem_xfs 00:07:16.381 ************************************ 00:07:16.381 08:15:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:16.381 08:15:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:16.381 08:15:01 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:16.381 08:15:01 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:16.381 08:15:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:16.381 08:15:01 -- common/autotest_common.sh@914 -- # local i=0 00:07:16.381 08:15:01 -- common/autotest_common.sh@915 -- # local force 00:07:16.381 08:15:01 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:16.381 08:15:01 -- common/autotest_common.sh@920 -- # force=-f 00:07:16.381 08:15:01 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:16.381 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:16.381 = sectsz=512 attr=2, projid32bit=1 00:07:16.381 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:16.381 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:16.381 data = bsize=4096 blocks=130560, imaxpct=25 00:07:16.381 = sunit=0 swidth=0 blks 00:07:16.381 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:16.381 log =internal log bsize=4096 blocks=16384, version=2 00:07:16.381 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:16.381 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:16.975 Discarding blocks...Done. 00:07:16.975 08:15:02 -- common/autotest_common.sh@931 -- # return 0 00:07:16.975 08:15:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:19.501 08:15:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:19.501 08:15:05 -- target/filesystem.sh@25 -- # sync 00:07:19.501 08:15:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:19.501 08:15:05 -- target/filesystem.sh@27 -- # sync 00:07:19.501 08:15:05 -- target/filesystem.sh@29 -- # i=0 00:07:19.501 08:15:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:19.501 08:15:05 -- target/filesystem.sh@37 -- # kill -0 860355 00:07:19.501 08:15:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:19.501 08:15:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:19.501 08:15:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:19.501 08:15:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:19.501 00:07:19.501 real 0m3.278s 00:07:19.501 user 0m0.014s 00:07:19.501 sys 0m0.065s 00:07:19.501 08:15:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.501 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:19.501 ************************************ 00:07:19.501 END TEST filesystem_xfs 00:07:19.501 ************************************ 00:07:19.501 08:15:05 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:19.501 08:15:05 -- target/filesystem.sh@93 -- # sync 00:07:19.501 08:15:05 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:19.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:19.501 08:15:05 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:19.501 08:15:05 -- common/autotest_common.sh@1208 -- # local i=0 00:07:19.501 08:15:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:19.501 08:15:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:19.501 08:15:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:19.501 08:15:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:19.501 08:15:05 -- common/autotest_common.sh@1220 -- # return 0 00:07:19.501 08:15:05 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:19.501 08:15:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:19.501 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:19.501 08:15:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:19.502 08:15:05 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:19.502 08:15:05 -- target/filesystem.sh@101 -- # killprocess 860355 00:07:19.502 08:15:05 -- common/autotest_common.sh@936 -- # '[' -z 860355 ']' 00:07:19.502 08:15:05 -- common/autotest_common.sh@940 -- # kill -0 860355 00:07:19.502 08:15:05 -- common/autotest_common.sh@941 -- # uname 00:07:19.502 08:15:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:19.502 08:15:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 860355 00:07:19.502 08:15:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:19.502 08:15:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:19.502 08:15:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 860355' 00:07:19.502 killing process with pid 860355 00:07:19.502 08:15:05 -- common/autotest_common.sh@955 -- # kill 860355 00:07:19.502 08:15:05 -- common/autotest_common.sh@960 -- # wait 860355 00:07:20.069 08:15:05 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:20.069 00:07:20.069 real 0m19.767s 00:07:20.069 user 1m16.337s 00:07:20.069 sys 0m2.452s 00:07:20.069 08:15:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.069 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:20.069 ************************************ 00:07:20.069 END TEST nvmf_filesystem_no_in_capsule 00:07:20.069 ************************************ 00:07:20.069 08:15:05 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:20.069 08:15:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:20.069 08:15:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.069 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:20.069 ************************************ 00:07:20.069 START TEST nvmf_filesystem_in_capsule 00:07:20.069 ************************************ 00:07:20.069 08:15:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:20.069 08:15:05 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:20.069 08:15:05 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:20.069 08:15:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:20.069 08:15:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:20.069 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:20.069 08:15:05 -- nvmf/common.sh@469 -- # nvmfpid=863042 00:07:20.069 08:15:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:20.069 08:15:05 -- nvmf/common.sh@470 -- # waitforlisten 863042 00:07:20.069 08:15:05 -- common/autotest_common.sh@829 -- # '[' -z 863042 ']' 00:07:20.069 08:15:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:20.069 08:15:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:20.069 08:15:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:20.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:20.069 08:15:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:20.069 08:15:05 -- common/autotest_common.sh@10 -- # set +x 00:07:20.069 [2024-11-26 08:15:05.877235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.069 [2024-11-26 08:15:05.877314] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:20.069 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.328 [2024-11-26 08:15:05.949091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:20.328 [2024-11-26 08:15:06.059177] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:20.328 [2024-11-26 08:15:06.059328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:20.328 [2024-11-26 08:15:06.059345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:20.328 [2024-11-26 08:15:06.059358] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:20.328 [2024-11-26 08:15:06.059415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:20.328 [2024-11-26 08:15:06.059475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:20.328 [2024-11-26 08:15:06.059540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:20.328 [2024-11-26 08:15:06.059544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.260 08:15:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:21.260 08:15:06 -- common/autotest_common.sh@862 -- # return 0 00:07:21.260 08:15:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:21.260 08:15:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:21.260 08:15:06 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 08:15:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:21.260 08:15:06 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:21.260 08:15:06 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:21.260 08:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.260 08:15:06 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 [2024-11-26 08:15:06.929448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:21.260 08:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.260 08:15:06 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:21.260 08:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.260 08:15:06 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 Malloc1 00:07:21.260 08:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.260 08:15:07 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:21.260 08:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.260 08:15:07 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 08:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.260 08:15:07 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:21.260 08:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.260 08:15:07 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 08:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.260 08:15:07 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:21.260 08:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.260 08:15:07 -- common/autotest_common.sh@10 -- # set +x 00:07:21.260 [2024-11-26 08:15:07.114572] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:21.518 08:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.518 08:15:07 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:21.518 08:15:07 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:21.518 08:15:07 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:21.518 08:15:07 -- common/autotest_common.sh@1369 -- # local bs 00:07:21.518 08:15:07 -- common/autotest_common.sh@1370 -- # local nb 00:07:21.518 08:15:07 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:21.518 08:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.518 08:15:07 -- common/autotest_common.sh@10 -- # set +x 00:07:21.518 08:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.518 08:15:07 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:21.518 { 00:07:21.518 "name": "Malloc1", 00:07:21.518 "aliases": [ 00:07:21.518 "3fb10db4-300a-441c-a179-0b01e5e83f49" 00:07:21.518 ], 00:07:21.518 "product_name": "Malloc disk", 00:07:21.518 "block_size": 512, 00:07:21.518 "num_blocks": 1048576, 00:07:21.518 "uuid": "3fb10db4-300a-441c-a179-0b01e5e83f49", 00:07:21.518 "assigned_rate_limits": { 00:07:21.518 "rw_ios_per_sec": 0, 00:07:21.518 "rw_mbytes_per_sec": 0, 00:07:21.518 "r_mbytes_per_sec": 0, 00:07:21.518 "w_mbytes_per_sec": 0 00:07:21.518 }, 00:07:21.518 "claimed": true, 00:07:21.518 "claim_type": "exclusive_write", 00:07:21.518 "zoned": false, 00:07:21.518 "supported_io_types": { 00:07:21.518 "read": true, 00:07:21.518 "write": true, 00:07:21.518 "unmap": true, 00:07:21.518 "write_zeroes": true, 00:07:21.518 "flush": true, 00:07:21.518 "reset": true, 00:07:21.518 "compare": false, 00:07:21.518 "compare_and_write": false, 00:07:21.518 "abort": true, 00:07:21.518 "nvme_admin": false, 00:07:21.518 "nvme_io": false 00:07:21.518 }, 00:07:21.518 "memory_domains": [ 00:07:21.518 { 00:07:21.518 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:21.518 "dma_device_type": 2 00:07:21.518 } 00:07:21.518 ], 00:07:21.518 "driver_specific": {} 00:07:21.518 } 00:07:21.518 ]' 00:07:21.518 08:15:07 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:21.518 08:15:07 -- common/autotest_common.sh@1372 -- # bs=512 00:07:21.518 08:15:07 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:21.518 08:15:07 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:21.518 08:15:07 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:21.518 08:15:07 -- common/autotest_common.sh@1377 -- # echo 512 00:07:21.518 08:15:07 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:21.518 08:15:07 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:22.082 08:15:07 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:22.082 08:15:07 -- common/autotest_common.sh@1187 -- # local i=0 00:07:22.083 08:15:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:22.083 08:15:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:22.083 08:15:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:24.609 08:15:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:24.609 08:15:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:24.609 08:15:09 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:24.609 08:15:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:24.609 08:15:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:24.609 08:15:09 -- common/autotest_common.sh@1197 -- # return 0 00:07:24.609 08:15:09 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:24.609 08:15:09 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:24.609 08:15:09 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:24.609 08:15:09 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:24.609 08:15:09 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:24.609 08:15:09 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:24.609 08:15:09 -- setup/common.sh@80 -- # echo 536870912 00:07:24.610 08:15:09 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:24.610 08:15:09 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:24.610 08:15:09 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:24.610 08:15:09 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:24.610 08:15:10 -- target/filesystem.sh@69 -- # partprobe 00:07:25.541 08:15:11 -- target/filesystem.sh@70 -- # sleep 1 00:07:26.475 08:15:12 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:26.475 08:15:12 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:26.475 08:15:12 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:26.475 08:15:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.475 08:15:12 -- common/autotest_common.sh@10 -- # set +x 00:07:26.475 ************************************ 00:07:26.475 START TEST filesystem_in_capsule_ext4 00:07:26.475 ************************************ 00:07:26.475 08:15:12 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:26.475 08:15:12 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:26.475 08:15:12 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:26.475 08:15:12 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:26.475 08:15:12 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:26.475 08:15:12 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:26.475 08:15:12 -- common/autotest_common.sh@914 -- # local i=0 00:07:26.475 08:15:12 -- common/autotest_common.sh@915 -- # local force 00:07:26.475 08:15:12 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:26.475 08:15:12 -- common/autotest_common.sh@918 -- # force=-F 00:07:26.475 08:15:12 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:26.475 mke2fs 1.47.0 (5-Feb-2023) 00:07:26.475 Discarding device blocks: 0/522240 done 00:07:26.475 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:26.475 Filesystem UUID: cee84754-acb2-4633-ade9-0a256302a0ab 00:07:26.475 Superblock backups stored on blocks: 00:07:26.475 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:26.475 00:07:26.475 Allocating group tables: 0/64 done 00:07:26.475 Writing inode tables: 0/64 done 00:07:28.374 Creating journal (8192 blocks): done 00:07:28.374 Writing superblocks and filesystem accounting information: 0/64 done 00:07:28.374 00:07:28.374 08:15:13 -- common/autotest_common.sh@931 -- # return 0 00:07:28.374 08:15:13 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:34.927 08:15:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:34.927 08:15:19 -- target/filesystem.sh@25 -- # sync 00:07:34.927 08:15:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:34.927 08:15:19 -- target/filesystem.sh@27 -- # sync 00:07:34.927 08:15:19 -- target/filesystem.sh@29 -- # i=0 00:07:34.927 08:15:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:34.927 08:15:19 -- target/filesystem.sh@37 -- # kill -0 863042 00:07:34.927 08:15:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:34.927 08:15:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:34.927 08:15:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:34.927 08:15:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:34.927 00:07:34.927 real 0m7.698s 00:07:34.927 user 0m0.016s 00:07:34.927 sys 0m0.061s 00:07:34.927 08:15:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.927 08:15:19 -- common/autotest_common.sh@10 -- # set +x 00:07:34.927 ************************************ 00:07:34.927 END TEST filesystem_in_capsule_ext4 00:07:34.927 ************************************ 00:07:34.927 08:15:19 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:34.927 08:15:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:34.927 08:15:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.927 08:15:19 -- common/autotest_common.sh@10 -- # set +x 00:07:34.927 ************************************ 00:07:34.927 START TEST filesystem_in_capsule_btrfs 00:07:34.927 ************************************ 00:07:34.927 08:15:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:34.927 08:15:19 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:34.927 08:15:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:34.927 08:15:19 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:34.927 08:15:19 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:34.927 08:15:19 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:34.927 08:15:19 -- common/autotest_common.sh@914 -- # local i=0 00:07:34.927 08:15:19 -- common/autotest_common.sh@915 -- # local force 00:07:34.927 08:15:19 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:34.927 08:15:19 -- common/autotest_common.sh@920 -- # force=-f 00:07:34.927 08:15:19 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:34.927 btrfs-progs v6.8.1 00:07:34.927 See https://btrfs.readthedocs.io for more information. 00:07:34.927 00:07:34.927 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:34.927 NOTE: several default settings have changed in version 5.15, please make sure 00:07:34.927 this does not affect your deployments: 00:07:34.927 - DUP for metadata (-m dup) 00:07:34.927 - enabled no-holes (-O no-holes) 00:07:34.927 - enabled free-space-tree (-R free-space-tree) 00:07:34.927 00:07:34.927 Label: (null) 00:07:34.927 UUID: 7dd6f038-d0d7-4dfe-9ed8-c1a393cf542b 00:07:34.927 Node size: 16384 00:07:34.927 Sector size: 4096 (CPU page size: 4096) 00:07:34.927 Filesystem size: 510.00MiB 00:07:34.927 Block group profiles: 00:07:34.927 Data: single 8.00MiB 00:07:34.927 Metadata: DUP 32.00MiB 00:07:34.927 System: DUP 8.00MiB 00:07:34.927 SSD detected: yes 00:07:34.927 Zoned device: no 00:07:34.927 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:34.927 Checksum: crc32c 00:07:34.927 Number of devices: 1 00:07:34.927 Devices: 00:07:34.927 ID SIZE PATH 00:07:34.927 1 510.00MiB /dev/nvme0n1p1 00:07:34.927 00:07:34.927 08:15:19 -- common/autotest_common.sh@931 -- # return 0 00:07:34.927 08:15:19 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:34.927 08:15:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:34.927 08:15:20 -- target/filesystem.sh@25 -- # sync 00:07:34.927 08:15:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:34.927 08:15:20 -- target/filesystem.sh@27 -- # sync 00:07:34.927 08:15:20 -- target/filesystem.sh@29 -- # i=0 00:07:34.927 08:15:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:34.927 08:15:20 -- target/filesystem.sh@37 -- # kill -0 863042 00:07:34.927 08:15:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:34.927 08:15:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:34.927 08:15:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:34.927 08:15:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:34.927 00:07:34.927 real 0m0.917s 00:07:34.927 user 0m0.022s 00:07:34.927 sys 0m0.102s 00:07:34.927 08:15:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.927 08:15:20 -- common/autotest_common.sh@10 -- # set +x 00:07:34.927 ************************************ 00:07:34.927 END TEST filesystem_in_capsule_btrfs 00:07:34.927 ************************************ 00:07:34.927 08:15:20 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:34.927 08:15:20 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:34.927 08:15:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.927 08:15:20 -- common/autotest_common.sh@10 -- # set +x 00:07:34.927 ************************************ 00:07:34.927 START TEST filesystem_in_capsule_xfs 00:07:34.927 ************************************ 00:07:34.927 08:15:20 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:34.927 08:15:20 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:34.927 08:15:20 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:34.927 08:15:20 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:34.927 08:15:20 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:34.927 08:15:20 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:34.927 08:15:20 -- common/autotest_common.sh@914 -- # local i=0 00:07:34.927 08:15:20 -- common/autotest_common.sh@915 -- # local force 00:07:34.927 08:15:20 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:34.927 08:15:20 -- common/autotest_common.sh@920 -- # force=-f 00:07:34.927 08:15:20 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:35.185 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:35.185 = sectsz=512 attr=2, projid32bit=1 00:07:35.185 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:35.185 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:35.185 data = bsize=4096 blocks=130560, imaxpct=25 00:07:35.185 = sunit=0 swidth=0 blks 00:07:35.185 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:35.185 log =internal log bsize=4096 blocks=16384, version=2 00:07:35.185 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:35.185 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:35.749 Discarding blocks...Done. 00:07:35.749 08:15:21 -- common/autotest_common.sh@931 -- # return 0 00:07:35.749 08:15:21 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:37.644 08:15:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:37.644 08:15:23 -- target/filesystem.sh@25 -- # sync 00:07:37.644 08:15:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:37.644 08:15:23 -- target/filesystem.sh@27 -- # sync 00:07:37.644 08:15:23 -- target/filesystem.sh@29 -- # i=0 00:07:37.644 08:15:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:37.644 08:15:23 -- target/filesystem.sh@37 -- # kill -0 863042 00:07:37.644 08:15:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:37.644 08:15:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:37.644 08:15:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:37.644 08:15:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:37.644 00:07:37.644 real 0m2.725s 00:07:37.644 user 0m0.013s 00:07:37.644 sys 0m0.058s 00:07:37.644 08:15:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.644 08:15:23 -- common/autotest_common.sh@10 -- # set +x 00:07:37.644 ************************************ 00:07:37.644 END TEST filesystem_in_capsule_xfs 00:07:37.644 ************************************ 00:07:37.644 08:15:23 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:37.900 08:15:23 -- target/filesystem.sh@93 -- # sync 00:07:37.900 08:15:23 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:37.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.900 08:15:23 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:37.900 08:15:23 -- common/autotest_common.sh@1208 -- # local i=0 00:07:37.900 08:15:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:37.900 08:15:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:37.900 08:15:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:37.900 08:15:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:37.900 08:15:23 -- common/autotest_common.sh@1220 -- # return 0 00:07:37.900 08:15:23 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:37.900 08:15:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.900 08:15:23 -- common/autotest_common.sh@10 -- # set +x 00:07:37.900 08:15:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.900 08:15:23 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:37.900 08:15:23 -- target/filesystem.sh@101 -- # killprocess 863042 00:07:37.900 08:15:23 -- common/autotest_common.sh@936 -- # '[' -z 863042 ']' 00:07:37.900 08:15:23 -- common/autotest_common.sh@940 -- # kill -0 863042 00:07:37.900 08:15:23 -- common/autotest_common.sh@941 -- # uname 00:07:37.900 08:15:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.900 08:15:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 863042 00:07:37.900 08:15:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.900 08:15:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.900 08:15:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 863042' 00:07:37.900 killing process with pid 863042 00:07:37.900 08:15:23 -- common/autotest_common.sh@955 -- # kill 863042 00:07:37.900 08:15:23 -- common/autotest_common.sh@960 -- # wait 863042 00:07:38.464 08:15:24 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:38.464 00:07:38.464 real 0m18.389s 00:07:38.464 user 1m10.936s 00:07:38.464 sys 0m2.400s 00:07:38.464 08:15:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.464 08:15:24 -- common/autotest_common.sh@10 -- # set +x 00:07:38.464 ************************************ 00:07:38.464 END TEST nvmf_filesystem_in_capsule 00:07:38.464 ************************************ 00:07:38.464 08:15:24 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:38.464 08:15:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:38.464 08:15:24 -- nvmf/common.sh@116 -- # sync 00:07:38.464 08:15:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:38.464 08:15:24 -- nvmf/common.sh@119 -- # set +e 00:07:38.464 08:15:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:38.464 08:15:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:38.464 rmmod nvme_tcp 00:07:38.464 rmmod nvme_fabrics 00:07:38.464 rmmod nvme_keyring 00:07:38.464 08:15:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:38.464 08:15:24 -- nvmf/common.sh@123 -- # set -e 00:07:38.464 08:15:24 -- nvmf/common.sh@124 -- # return 0 00:07:38.464 08:15:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:38.464 08:15:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:38.464 08:15:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:38.464 08:15:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:38.464 08:15:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:38.464 08:15:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:38.464 08:15:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.464 08:15:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.464 08:15:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.000 08:15:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:41.000 00:07:41.000 real 0m43.054s 00:07:41.000 user 2m28.428s 00:07:41.000 sys 0m6.598s 00:07:41.000 08:15:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.000 08:15:26 -- common/autotest_common.sh@10 -- # set +x 00:07:41.000 ************************************ 00:07:41.000 END TEST nvmf_filesystem 00:07:41.000 ************************************ 00:07:41.000 08:15:26 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:41.000 08:15:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.000 08:15:26 -- common/autotest_common.sh@10 -- # set +x 00:07:41.000 ************************************ 00:07:41.000 START TEST nvmf_discovery 00:07:41.000 ************************************ 00:07:41.000 08:15:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:41.000 * Looking for test storage... 00:07:41.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.000 08:15:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:41.000 08:15:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:41.000 08:15:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:41.000 08:15:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:41.000 08:15:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:41.000 08:15:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:41.000 08:15:26 -- scripts/common.sh@335 -- # IFS=.-: 00:07:41.000 08:15:26 -- scripts/common.sh@335 -- # read -ra ver1 00:07:41.000 08:15:26 -- scripts/common.sh@336 -- # IFS=.-: 00:07:41.000 08:15:26 -- scripts/common.sh@336 -- # read -ra ver2 00:07:41.000 08:15:26 -- scripts/common.sh@337 -- # local 'op=<' 00:07:41.000 08:15:26 -- scripts/common.sh@339 -- # ver1_l=2 00:07:41.000 08:15:26 -- scripts/common.sh@340 -- # ver2_l=1 00:07:41.000 08:15:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:41.000 08:15:26 -- scripts/common.sh@343 -- # case "$op" in 00:07:41.000 08:15:26 -- scripts/common.sh@344 -- # : 1 00:07:41.000 08:15:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:41.000 08:15:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:41.000 08:15:26 -- scripts/common.sh@364 -- # decimal 1 00:07:41.000 08:15:26 -- scripts/common.sh@352 -- # local d=1 00:07:41.000 08:15:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:41.000 08:15:26 -- scripts/common.sh@354 -- # echo 1 00:07:41.000 08:15:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:41.000 08:15:26 -- scripts/common.sh@365 -- # decimal 2 00:07:41.000 08:15:26 -- scripts/common.sh@352 -- # local d=2 00:07:41.000 08:15:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:41.000 08:15:26 -- scripts/common.sh@354 -- # echo 2 00:07:41.000 08:15:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:41.000 08:15:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:41.000 08:15:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:41.000 08:15:26 -- scripts/common.sh@367 -- # return 0 00:07:41.000 08:15:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:41.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.000 --rc genhtml_branch_coverage=1 00:07:41.000 --rc genhtml_function_coverage=1 00:07:41.000 --rc genhtml_legend=1 00:07:41.000 --rc geninfo_all_blocks=1 00:07:41.000 --rc geninfo_unexecuted_blocks=1 00:07:41.000 00:07:41.000 ' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:41.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.000 --rc genhtml_branch_coverage=1 00:07:41.000 --rc genhtml_function_coverage=1 00:07:41.000 --rc genhtml_legend=1 00:07:41.000 --rc geninfo_all_blocks=1 00:07:41.000 --rc geninfo_unexecuted_blocks=1 00:07:41.000 00:07:41.000 ' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:41.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.000 --rc genhtml_branch_coverage=1 00:07:41.000 --rc genhtml_function_coverage=1 00:07:41.000 --rc genhtml_legend=1 00:07:41.000 --rc geninfo_all_blocks=1 00:07:41.000 --rc geninfo_unexecuted_blocks=1 00:07:41.000 00:07:41.000 ' 00:07:41.000 08:15:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:41.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.000 --rc genhtml_branch_coverage=1 00:07:41.000 --rc genhtml_function_coverage=1 00:07:41.000 --rc genhtml_legend=1 00:07:41.000 --rc geninfo_all_blocks=1 00:07:41.000 --rc geninfo_unexecuted_blocks=1 00:07:41.000 00:07:41.000 ' 00:07:41.001 08:15:26 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:41.001 08:15:26 -- nvmf/common.sh@7 -- # uname -s 00:07:41.001 08:15:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:41.001 08:15:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:41.001 08:15:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:41.001 08:15:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:41.001 08:15:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:41.001 08:15:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:41.001 08:15:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:41.001 08:15:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:41.001 08:15:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:41.001 08:15:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:41.001 08:15:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.001 08:15:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.001 08:15:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:41.001 08:15:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:41.001 08:15:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:41.001 08:15:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:41.001 08:15:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:41.001 08:15:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:41.001 08:15:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:41.001 08:15:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.001 08:15:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.001 08:15:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.001 08:15:26 -- paths/export.sh@5 -- # export PATH 00:07:41.001 08:15:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.001 08:15:26 -- nvmf/common.sh@46 -- # : 0 00:07:41.001 08:15:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:41.001 08:15:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:41.001 08:15:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:41.001 08:15:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:41.001 08:15:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:41.001 08:15:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:41.001 08:15:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:41.001 08:15:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:41.001 08:15:26 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:41.001 08:15:26 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:41.001 08:15:26 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:41.001 08:15:26 -- target/discovery.sh@15 -- # hash nvme 00:07:41.001 08:15:26 -- target/discovery.sh@20 -- # nvmftestinit 00:07:41.001 08:15:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:41.001 08:15:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:41.001 08:15:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:41.001 08:15:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:41.001 08:15:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:41.001 08:15:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.001 08:15:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.001 08:15:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.001 08:15:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:41.001 08:15:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:41.001 08:15:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:41.001 08:15:26 -- common/autotest_common.sh@10 -- # set +x 00:07:42.903 08:15:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:42.903 08:15:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:42.903 08:15:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:42.903 08:15:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:42.903 08:15:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:42.903 08:15:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:42.903 08:15:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:42.903 08:15:28 -- nvmf/common.sh@294 -- # net_devs=() 00:07:42.903 08:15:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:42.903 08:15:28 -- nvmf/common.sh@295 -- # e810=() 00:07:42.903 08:15:28 -- nvmf/common.sh@295 -- # local -ga e810 00:07:42.903 08:15:28 -- nvmf/common.sh@296 -- # x722=() 00:07:42.903 08:15:28 -- nvmf/common.sh@296 -- # local -ga x722 00:07:42.903 08:15:28 -- nvmf/common.sh@297 -- # mlx=() 00:07:42.903 08:15:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:42.903 08:15:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:42.903 08:15:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:42.903 08:15:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:42.903 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:42.903 08:15:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:42.903 08:15:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:42.903 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:42.903 08:15:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:42.903 08:15:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:42.903 08:15:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:42.903 08:15:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:42.903 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:42.903 08:15:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:42.903 08:15:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:42.903 08:15:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:42.903 08:15:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:42.903 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:42.903 08:15:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:42.903 08:15:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:42.903 08:15:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:42.903 08:15:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:42.903 08:15:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:42.903 08:15:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:42.903 08:15:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:42.903 08:15:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:42.903 08:15:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:42.903 08:15:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:42.903 08:15:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:42.903 08:15:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:42.903 08:15:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:42.903 08:15:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:42.903 08:15:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:42.903 08:15:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:42.903 08:15:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:42.903 08:15:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:42.903 08:15:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:42.903 08:15:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:42.903 08:15:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:42.903 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:42.903 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:07:42.903 00:07:42.903 --- 10.0.0.2 ping statistics --- 00:07:42.903 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.903 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:07:42.903 08:15:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:42.903 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:42.903 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:07:42.903 00:07:42.903 --- 10.0.0.1 ping statistics --- 00:07:42.903 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.903 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:07:42.903 08:15:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:42.903 08:15:28 -- nvmf/common.sh@410 -- # return 0 00:07:42.903 08:15:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:42.903 08:15:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:42.903 08:15:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:42.903 08:15:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:42.903 08:15:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:42.903 08:15:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:42.903 08:15:28 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:42.903 08:15:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:42.903 08:15:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:42.903 08:15:28 -- common/autotest_common.sh@10 -- # set +x 00:07:42.903 08:15:28 -- nvmf/common.sh@469 -- # nvmfpid=867921 00:07:42.903 08:15:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:42.903 08:15:28 -- nvmf/common.sh@470 -- # waitforlisten 867921 00:07:42.903 08:15:28 -- common/autotest_common.sh@829 -- # '[' -z 867921 ']' 00:07:42.903 08:15:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.903 08:15:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:42.903 08:15:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.903 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.903 08:15:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:42.903 08:15:28 -- common/autotest_common.sh@10 -- # set +x 00:07:42.903 [2024-11-26 08:15:28.757098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.903 [2024-11-26 08:15:28.757185] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:43.172 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.172 [2024-11-26 08:15:28.828653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:43.172 [2024-11-26 08:15:28.948918] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:43.172 [2024-11-26 08:15:28.949102] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:43.172 [2024-11-26 08:15:28.949122] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:43.172 [2024-11-26 08:15:28.949136] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:43.172 [2024-11-26 08:15:28.949247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:43.172 [2024-11-26 08:15:28.949302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:43.172 [2024-11-26 08:15:28.949357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:43.172 [2024-11-26 08:15:28.949360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.105 08:15:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:44.105 08:15:29 -- common/autotest_common.sh@862 -- # return 0 00:07:44.105 08:15:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:44.105 08:15:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:44.105 08:15:29 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 [2024-11-26 08:15:29.739203] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@26 -- # seq 1 4 00:07:44.105 08:15:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:44.105 08:15:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 Null1 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 [2024-11-26 08:15:29.779511] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:44.105 08:15:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 Null2 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:44.105 08:15:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 Null3 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:44.105 08:15:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 Null4 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:44.105 08:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.105 08:15:29 -- common/autotest_common.sh@10 -- # set +x 00:07:44.105 08:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.105 08:15:29 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:44.364 00:07:44.364 Discovery Log Number of Records 6, Generation counter 6 00:07:44.364 =====Discovery Log Entry 0====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: current discovery subsystem 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4420 00:07:44.364 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: explicit discovery connections, duplicate discovery information 00:07:44.364 sectype: none 00:07:44.364 =====Discovery Log Entry 1====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: nvme subsystem 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4420 00:07:44.364 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: none 00:07:44.364 sectype: none 00:07:44.364 =====Discovery Log Entry 2====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: nvme subsystem 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4420 00:07:44.364 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: none 00:07:44.364 sectype: none 00:07:44.364 =====Discovery Log Entry 3====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: nvme subsystem 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4420 00:07:44.364 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: none 00:07:44.364 sectype: none 00:07:44.364 =====Discovery Log Entry 4====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: nvme subsystem 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4420 00:07:44.364 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: none 00:07:44.364 sectype: none 00:07:44.364 =====Discovery Log Entry 5====== 00:07:44.364 trtype: tcp 00:07:44.364 adrfam: ipv4 00:07:44.364 subtype: discovery subsystem referral 00:07:44.364 treq: not required 00:07:44.364 portid: 0 00:07:44.364 trsvcid: 4430 00:07:44.364 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:44.364 traddr: 10.0.0.2 00:07:44.364 eflags: none 00:07:44.364 sectype: none 00:07:44.364 08:15:30 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:44.364 Perform nvmf subsystem discovery via RPC 00:07:44.364 08:15:30 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:44.364 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.364 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.364 [2024-11-26 08:15:30.076387] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:44.364 [ 00:07:44.364 { 00:07:44.364 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:44.364 "subtype": "Discovery", 00:07:44.364 "listen_addresses": [ 00:07:44.364 { 00:07:44.364 "transport": "TCP", 00:07:44.364 "trtype": "TCP", 00:07:44.364 "adrfam": "IPv4", 00:07:44.364 "traddr": "10.0.0.2", 00:07:44.364 "trsvcid": "4420" 00:07:44.364 } 00:07:44.364 ], 00:07:44.364 "allow_any_host": true, 00:07:44.364 "hosts": [] 00:07:44.364 }, 00:07:44.364 { 00:07:44.364 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:44.364 "subtype": "NVMe", 00:07:44.364 "listen_addresses": [ 00:07:44.364 { 00:07:44.364 "transport": "TCP", 00:07:44.364 "trtype": "TCP", 00:07:44.364 "adrfam": "IPv4", 00:07:44.364 "traddr": "10.0.0.2", 00:07:44.364 "trsvcid": "4420" 00:07:44.364 } 00:07:44.364 ], 00:07:44.364 "allow_any_host": true, 00:07:44.364 "hosts": [], 00:07:44.364 "serial_number": "SPDK00000000000001", 00:07:44.364 "model_number": "SPDK bdev Controller", 00:07:44.364 "max_namespaces": 32, 00:07:44.364 "min_cntlid": 1, 00:07:44.364 "max_cntlid": 65519, 00:07:44.364 "namespaces": [ 00:07:44.364 { 00:07:44.364 "nsid": 1, 00:07:44.364 "bdev_name": "Null1", 00:07:44.364 "name": "Null1", 00:07:44.364 "nguid": "41272E42E46C459AB43A34914254C676", 00:07:44.364 "uuid": "41272e42-e46c-459a-b43a-34914254c676" 00:07:44.364 } 00:07:44.364 ] 00:07:44.364 }, 00:07:44.364 { 00:07:44.364 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:44.364 "subtype": "NVMe", 00:07:44.364 "listen_addresses": [ 00:07:44.364 { 00:07:44.364 "transport": "TCP", 00:07:44.364 "trtype": "TCP", 00:07:44.364 "adrfam": "IPv4", 00:07:44.364 "traddr": "10.0.0.2", 00:07:44.364 "trsvcid": "4420" 00:07:44.364 } 00:07:44.364 ], 00:07:44.364 "allow_any_host": true, 00:07:44.364 "hosts": [], 00:07:44.364 "serial_number": "SPDK00000000000002", 00:07:44.364 "model_number": "SPDK bdev Controller", 00:07:44.364 "max_namespaces": 32, 00:07:44.364 "min_cntlid": 1, 00:07:44.364 "max_cntlid": 65519, 00:07:44.364 "namespaces": [ 00:07:44.364 { 00:07:44.364 "nsid": 1, 00:07:44.364 "bdev_name": "Null2", 00:07:44.364 "name": "Null2", 00:07:44.364 "nguid": "B30411A9E33743828243030E9F711B03", 00:07:44.364 "uuid": "b30411a9-e337-4382-8243-030e9f711b03" 00:07:44.364 } 00:07:44.364 ] 00:07:44.364 }, 00:07:44.364 { 00:07:44.364 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:44.364 "subtype": "NVMe", 00:07:44.364 "listen_addresses": [ 00:07:44.364 { 00:07:44.364 "transport": "TCP", 00:07:44.364 "trtype": "TCP", 00:07:44.364 "adrfam": "IPv4", 00:07:44.364 "traddr": "10.0.0.2", 00:07:44.364 "trsvcid": "4420" 00:07:44.364 } 00:07:44.364 ], 00:07:44.364 "allow_any_host": true, 00:07:44.364 "hosts": [], 00:07:44.364 "serial_number": "SPDK00000000000003", 00:07:44.364 "model_number": "SPDK bdev Controller", 00:07:44.364 "max_namespaces": 32, 00:07:44.364 "min_cntlid": 1, 00:07:44.364 "max_cntlid": 65519, 00:07:44.364 "namespaces": [ 00:07:44.364 { 00:07:44.364 "nsid": 1, 00:07:44.364 "bdev_name": "Null3", 00:07:44.364 "name": "Null3", 00:07:44.364 "nguid": "C228398C4A614129B12EBCDCF07C9FB3", 00:07:44.364 "uuid": "c228398c-4a61-4129-b12e-bcdcf07c9fb3" 00:07:44.364 } 00:07:44.364 ] 00:07:44.364 }, 00:07:44.364 { 00:07:44.364 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:44.364 "subtype": "NVMe", 00:07:44.364 "listen_addresses": [ 00:07:44.364 { 00:07:44.364 "transport": "TCP", 00:07:44.364 "trtype": "TCP", 00:07:44.364 "adrfam": "IPv4", 00:07:44.365 "traddr": "10.0.0.2", 00:07:44.365 "trsvcid": "4420" 00:07:44.365 } 00:07:44.365 ], 00:07:44.365 "allow_any_host": true, 00:07:44.365 "hosts": [], 00:07:44.365 "serial_number": "SPDK00000000000004", 00:07:44.365 "model_number": "SPDK bdev Controller", 00:07:44.365 "max_namespaces": 32, 00:07:44.365 "min_cntlid": 1, 00:07:44.365 "max_cntlid": 65519, 00:07:44.365 "namespaces": [ 00:07:44.365 { 00:07:44.365 "nsid": 1, 00:07:44.365 "bdev_name": "Null4", 00:07:44.365 "name": "Null4", 00:07:44.365 "nguid": "FCB227908B27471F9FD1807E6CEDB0CD", 00:07:44.365 "uuid": "fcb22790-8b27-471f-9fd1-807e6cedb0cd" 00:07:44.365 } 00:07:44.365 ] 00:07:44.365 } 00:07:44.365 ] 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@42 -- # seq 1 4 00:07:44.365 08:15:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.365 08:15:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.365 08:15:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.365 08:15:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.365 08:15:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:44.365 08:15:30 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:44.365 08:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.365 08:15:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.365 08:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.365 08:15:30 -- target/discovery.sh@49 -- # check_bdevs= 00:07:44.365 08:15:30 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:44.365 08:15:30 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:44.365 08:15:30 -- target/discovery.sh@57 -- # nvmftestfini 00:07:44.365 08:15:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:44.365 08:15:30 -- nvmf/common.sh@116 -- # sync 00:07:44.365 08:15:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:44.365 08:15:30 -- nvmf/common.sh@119 -- # set +e 00:07:44.365 08:15:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:44.365 08:15:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:44.365 rmmod nvme_tcp 00:07:44.623 rmmod nvme_fabrics 00:07:44.623 rmmod nvme_keyring 00:07:44.623 08:15:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:44.623 08:15:30 -- nvmf/common.sh@123 -- # set -e 00:07:44.623 08:15:30 -- nvmf/common.sh@124 -- # return 0 00:07:44.623 08:15:30 -- nvmf/common.sh@477 -- # '[' -n 867921 ']' 00:07:44.623 08:15:30 -- nvmf/common.sh@478 -- # killprocess 867921 00:07:44.623 08:15:30 -- common/autotest_common.sh@936 -- # '[' -z 867921 ']' 00:07:44.623 08:15:30 -- common/autotest_common.sh@940 -- # kill -0 867921 00:07:44.623 08:15:30 -- common/autotest_common.sh@941 -- # uname 00:07:44.623 08:15:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:44.623 08:15:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 867921 00:07:44.623 08:15:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:44.623 08:15:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:44.623 08:15:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 867921' 00:07:44.623 killing process with pid 867921 00:07:44.623 08:15:30 -- common/autotest_common.sh@955 -- # kill 867921 00:07:44.623 [2024-11-26 08:15:30.307084] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:44.623 08:15:30 -- common/autotest_common.sh@960 -- # wait 867921 00:07:44.881 08:15:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:44.881 08:15:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:44.881 08:15:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:44.881 08:15:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:44.881 08:15:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:44.881 08:15:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.881 08:15:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.881 08:15:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.809 08:15:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:46.809 00:07:46.809 real 0m6.245s 00:07:46.809 user 0m7.476s 00:07:46.809 sys 0m1.900s 00:07:46.809 08:15:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.809 08:15:32 -- common/autotest_common.sh@10 -- # set +x 00:07:46.809 ************************************ 00:07:46.809 END TEST nvmf_discovery 00:07:46.809 ************************************ 00:07:46.809 08:15:32 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:46.810 08:15:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:46.810 08:15:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.810 08:15:32 -- common/autotest_common.sh@10 -- # set +x 00:07:46.810 ************************************ 00:07:46.810 START TEST nvmf_referrals 00:07:46.810 ************************************ 00:07:46.810 08:15:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:47.077 * Looking for test storage... 00:07:47.077 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.077 08:15:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.077 08:15:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.077 08:15:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.077 08:15:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.077 08:15:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.077 08:15:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.077 08:15:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.077 08:15:32 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.077 08:15:32 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.077 08:15:32 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.077 08:15:32 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.077 08:15:32 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.077 08:15:32 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.077 08:15:32 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.077 08:15:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.077 08:15:32 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.077 08:15:32 -- scripts/common.sh@344 -- # : 1 00:07:47.077 08:15:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.077 08:15:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.077 08:15:32 -- scripts/common.sh@364 -- # decimal 1 00:07:47.077 08:15:32 -- scripts/common.sh@352 -- # local d=1 00:07:47.077 08:15:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.077 08:15:32 -- scripts/common.sh@354 -- # echo 1 00:07:47.077 08:15:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.077 08:15:32 -- scripts/common.sh@365 -- # decimal 2 00:07:47.077 08:15:32 -- scripts/common.sh@352 -- # local d=2 00:07:47.077 08:15:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.077 08:15:32 -- scripts/common.sh@354 -- # echo 2 00:07:47.077 08:15:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.077 08:15:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.077 08:15:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.077 08:15:32 -- scripts/common.sh@367 -- # return 0 00:07:47.077 08:15:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.077 08:15:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.077 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.077 --rc genhtml_branch_coverage=1 00:07:47.077 --rc genhtml_function_coverage=1 00:07:47.077 --rc genhtml_legend=1 00:07:47.077 --rc geninfo_all_blocks=1 00:07:47.077 --rc geninfo_unexecuted_blocks=1 00:07:47.077 00:07:47.077 ' 00:07:47.077 08:15:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.077 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.077 --rc genhtml_branch_coverage=1 00:07:47.077 --rc genhtml_function_coverage=1 00:07:47.077 --rc genhtml_legend=1 00:07:47.077 --rc geninfo_all_blocks=1 00:07:47.077 --rc geninfo_unexecuted_blocks=1 00:07:47.077 00:07:47.077 ' 00:07:47.077 08:15:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.077 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.077 --rc genhtml_branch_coverage=1 00:07:47.077 --rc genhtml_function_coverage=1 00:07:47.077 --rc genhtml_legend=1 00:07:47.077 --rc geninfo_all_blocks=1 00:07:47.077 --rc geninfo_unexecuted_blocks=1 00:07:47.077 00:07:47.077 ' 00:07:47.077 08:15:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.077 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.077 --rc genhtml_branch_coverage=1 00:07:47.077 --rc genhtml_function_coverage=1 00:07:47.077 --rc genhtml_legend=1 00:07:47.077 --rc geninfo_all_blocks=1 00:07:47.077 --rc geninfo_unexecuted_blocks=1 00:07:47.077 00:07:47.077 ' 00:07:47.077 08:15:32 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:47.077 08:15:32 -- nvmf/common.sh@7 -- # uname -s 00:07:47.077 08:15:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:47.077 08:15:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:47.077 08:15:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:47.077 08:15:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:47.077 08:15:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:47.077 08:15:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:47.077 08:15:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:47.077 08:15:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:47.077 08:15:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:47.077 08:15:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:47.077 08:15:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.077 08:15:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.077 08:15:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:47.077 08:15:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:47.077 08:15:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:47.077 08:15:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:47.077 08:15:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.077 08:15:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.077 08:15:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.077 08:15:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.077 08:15:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.077 08:15:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.077 08:15:32 -- paths/export.sh@5 -- # export PATH 00:07:47.077 08:15:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.077 08:15:32 -- nvmf/common.sh@46 -- # : 0 00:07:47.077 08:15:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:47.077 08:15:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:47.077 08:15:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:47.077 08:15:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:47.077 08:15:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:47.077 08:15:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:47.077 08:15:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:47.077 08:15:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:47.077 08:15:32 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:47.077 08:15:32 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:47.077 08:15:32 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:47.077 08:15:32 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:47.077 08:15:32 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:47.077 08:15:32 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:47.077 08:15:32 -- target/referrals.sh@37 -- # nvmftestinit 00:07:47.077 08:15:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:47.077 08:15:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:47.077 08:15:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:47.078 08:15:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:47.078 08:15:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:47.078 08:15:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:47.078 08:15:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:47.078 08:15:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.078 08:15:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:47.078 08:15:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:47.078 08:15:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:47.078 08:15:32 -- common/autotest_common.sh@10 -- # set +x 00:07:48.980 08:15:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.980 08:15:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.980 08:15:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.980 08:15:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.980 08:15:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.980 08:15:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.980 08:15:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.980 08:15:34 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.980 08:15:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.980 08:15:34 -- nvmf/common.sh@295 -- # e810=() 00:07:48.980 08:15:34 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.980 08:15:34 -- nvmf/common.sh@296 -- # x722=() 00:07:48.980 08:15:34 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.980 08:15:34 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.980 08:15:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.980 08:15:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.980 08:15:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.980 08:15:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.980 08:15:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.980 08:15:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.980 08:15:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:48.980 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:48.980 08:15:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.980 08:15:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:48.980 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:48.980 08:15:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.980 08:15:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.980 08:15:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.981 08:15:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.981 08:15:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.981 08:15:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.981 08:15:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.981 08:15:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:48.981 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:48.981 08:15:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.981 08:15:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.981 08:15:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.981 08:15:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.981 08:15:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.981 08:15:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:48.981 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:48.981 08:15:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.981 08:15:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.981 08:15:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.981 08:15:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.981 08:15:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.981 08:15:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.981 08:15:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.981 08:15:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.981 08:15:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.981 08:15:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.981 08:15:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.981 08:15:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.981 08:15:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.981 08:15:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.981 08:15:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.981 08:15:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.981 08:15:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.981 08:15:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.981 08:15:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:49.239 08:15:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:49.239 08:15:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:49.239 08:15:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:49.239 08:15:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:49.239 08:15:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:49.239 08:15:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:49.239 08:15:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:49.239 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:49.239 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:07:49.239 00:07:49.239 --- 10.0.0.2 ping statistics --- 00:07:49.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.239 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:07:49.239 08:15:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:49.239 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:49.239 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:07:49.239 00:07:49.239 --- 10.0.0.1 ping statistics --- 00:07:49.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.239 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:07:49.239 08:15:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:49.239 08:15:34 -- nvmf/common.sh@410 -- # return 0 00:07:49.239 08:15:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:49.239 08:15:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:49.239 08:15:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:49.239 08:15:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:49.239 08:15:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:49.239 08:15:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:49.239 08:15:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:49.239 08:15:34 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:49.239 08:15:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:49.239 08:15:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:49.239 08:15:34 -- common/autotest_common.sh@10 -- # set +x 00:07:49.239 08:15:34 -- nvmf/common.sh@469 -- # nvmfpid=870164 00:07:49.239 08:15:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:49.239 08:15:34 -- nvmf/common.sh@470 -- # waitforlisten 870164 00:07:49.239 08:15:34 -- common/autotest_common.sh@829 -- # '[' -z 870164 ']' 00:07:49.239 08:15:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.239 08:15:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:49.239 08:15:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.239 08:15:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:49.239 08:15:34 -- common/autotest_common.sh@10 -- # set +x 00:07:49.239 [2024-11-26 08:15:35.010431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.239 [2024-11-26 08:15:35.010503] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:49.239 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.239 [2024-11-26 08:15:35.079591] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.498 [2024-11-26 08:15:35.199672] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.498 [2024-11-26 08:15:35.199854] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:49.498 [2024-11-26 08:15:35.199874] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:49.499 [2024-11-26 08:15:35.199889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:49.499 [2024-11-26 08:15:35.200209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.499 [2024-11-26 08:15:35.200266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.499 [2024-11-26 08:15:35.200320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.499 [2024-11-26 08:15:35.200323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.433 08:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.433 08:15:36 -- common/autotest_common.sh@862 -- # return 0 00:07:50.433 08:15:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:50.433 08:15:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:50.433 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.433 08:15:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:50.433 08:15:36 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:50.433 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.433 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.433 [2024-11-26 08:15:36.059416] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:50.433 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.433 08:15:36 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:50.433 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.433 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.433 [2024-11-26 08:15:36.071634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:50.433 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.433 08:15:36 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:50.433 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.433 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.433 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:50.434 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.434 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.434 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:50.434 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.434 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.434 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.434 08:15:36 -- target/referrals.sh@48 -- # jq length 00:07:50.434 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.434 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.434 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:50.434 08:15:36 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:50.434 08:15:36 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:50.434 08:15:36 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.434 08:15:36 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:50.434 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.434 08:15:36 -- target/referrals.sh@21 -- # sort 00:07:50.434 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.434 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:50.434 08:15:36 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:50.434 08:15:36 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:50.434 08:15:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.434 08:15:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.434 08:15:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.434 08:15:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.434 08:15:36 -- target/referrals.sh@26 -- # sort 00:07:50.779 08:15:36 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:50.779 08:15:36 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:50.779 08:15:36 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:50.779 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.779 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.779 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.779 08:15:36 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:50.779 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.779 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.779 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.779 08:15:36 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:50.779 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.779 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.779 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.779 08:15:36 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.779 08:15:36 -- target/referrals.sh@56 -- # jq length 00:07:50.779 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.779 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.779 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.779 08:15:36 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:50.779 08:15:36 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:50.779 08:15:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.779 08:15:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.779 08:15:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.779 08:15:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.779 08:15:36 -- target/referrals.sh@26 -- # sort 00:07:51.063 08:15:36 -- target/referrals.sh@26 -- # echo 00:07:51.063 08:15:36 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:51.063 08:15:36 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:51.063 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.063 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:51.063 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.063 08:15:36 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:51.063 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.063 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:51.063 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.063 08:15:36 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:51.063 08:15:36 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:51.063 08:15:36 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:51.063 08:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.063 08:15:36 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:51.063 08:15:36 -- common/autotest_common.sh@10 -- # set +x 00:07:51.063 08:15:36 -- target/referrals.sh@21 -- # sort 00:07:51.063 08:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.063 08:15:36 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:51.063 08:15:36 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:51.063 08:15:36 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:51.063 08:15:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:51.063 08:15:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:51.063 08:15:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.063 08:15:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:51.063 08:15:36 -- target/referrals.sh@26 -- # sort 00:07:51.063 08:15:36 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:51.063 08:15:36 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:51.063 08:15:36 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:51.064 08:15:36 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:51.064 08:15:36 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:51.064 08:15:36 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.064 08:15:36 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:51.321 08:15:37 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:51.322 08:15:37 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:51.322 08:15:37 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:51.322 08:15:37 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:51.322 08:15:37 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.322 08:15:37 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:51.580 08:15:37 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:51.580 08:15:37 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:51.580 08:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.580 08:15:37 -- common/autotest_common.sh@10 -- # set +x 00:07:51.580 08:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.580 08:15:37 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:51.580 08:15:37 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:51.580 08:15:37 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:51.580 08:15:37 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:51.580 08:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.580 08:15:37 -- common/autotest_common.sh@10 -- # set +x 00:07:51.580 08:15:37 -- target/referrals.sh@21 -- # sort 00:07:51.580 08:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.580 08:15:37 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:51.580 08:15:37 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:51.580 08:15:37 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:51.580 08:15:37 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:51.580 08:15:37 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:51.580 08:15:37 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.580 08:15:37 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:51.580 08:15:37 -- target/referrals.sh@26 -- # sort 00:07:51.838 08:15:37 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:51.838 08:15:37 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:51.838 08:15:37 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:51.838 08:15:37 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:51.838 08:15:37 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:51.838 08:15:37 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.838 08:15:37 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:51.838 08:15:37 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:51.838 08:15:37 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:51.838 08:15:37 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:51.838 08:15:37 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:51.838 08:15:37 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.838 08:15:37 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:52.096 08:15:37 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:52.096 08:15:37 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:52.096 08:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.096 08:15:37 -- common/autotest_common.sh@10 -- # set +x 00:07:52.096 08:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.096 08:15:37 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:52.096 08:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.096 08:15:37 -- target/referrals.sh@82 -- # jq length 00:07:52.096 08:15:37 -- common/autotest_common.sh@10 -- # set +x 00:07:52.096 08:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.096 08:15:37 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:52.096 08:15:37 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:52.096 08:15:37 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:52.096 08:15:37 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:52.096 08:15:37 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:52.096 08:15:37 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:52.096 08:15:37 -- target/referrals.sh@26 -- # sort 00:07:52.354 08:15:38 -- target/referrals.sh@26 -- # echo 00:07:52.354 08:15:38 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:52.354 08:15:38 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:52.354 08:15:38 -- target/referrals.sh@86 -- # nvmftestfini 00:07:52.354 08:15:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:52.354 08:15:38 -- nvmf/common.sh@116 -- # sync 00:07:52.354 08:15:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:52.354 08:15:38 -- nvmf/common.sh@119 -- # set +e 00:07:52.354 08:15:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:52.354 08:15:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:52.354 rmmod nvme_tcp 00:07:52.354 rmmod nvme_fabrics 00:07:52.354 rmmod nvme_keyring 00:07:52.354 08:15:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:52.354 08:15:38 -- nvmf/common.sh@123 -- # set -e 00:07:52.354 08:15:38 -- nvmf/common.sh@124 -- # return 0 00:07:52.355 08:15:38 -- nvmf/common.sh@477 -- # '[' -n 870164 ']' 00:07:52.355 08:15:38 -- nvmf/common.sh@478 -- # killprocess 870164 00:07:52.355 08:15:38 -- common/autotest_common.sh@936 -- # '[' -z 870164 ']' 00:07:52.355 08:15:38 -- common/autotest_common.sh@940 -- # kill -0 870164 00:07:52.355 08:15:38 -- common/autotest_common.sh@941 -- # uname 00:07:52.355 08:15:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:52.355 08:15:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 870164 00:07:52.355 08:15:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:52.355 08:15:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:52.355 08:15:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 870164' 00:07:52.355 killing process with pid 870164 00:07:52.355 08:15:38 -- common/autotest_common.sh@955 -- # kill 870164 00:07:52.355 08:15:38 -- common/autotest_common.sh@960 -- # wait 870164 00:07:52.614 08:15:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:52.614 08:15:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:52.614 08:15:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:52.614 08:15:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:52.614 08:15:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:52.614 08:15:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.614 08:15:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.614 08:15:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:55.184 08:15:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:55.184 00:07:55.184 real 0m7.801s 00:07:55.184 user 0m14.356s 00:07:55.184 sys 0m2.338s 00:07:55.184 08:15:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:55.184 08:15:40 -- common/autotest_common.sh@10 -- # set +x 00:07:55.184 ************************************ 00:07:55.184 END TEST nvmf_referrals 00:07:55.185 ************************************ 00:07:55.185 08:15:40 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:55.185 08:15:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.185 08:15:40 -- common/autotest_common.sh@10 -- # set +x 00:07:55.185 ************************************ 00:07:55.185 START TEST nvmf_connect_disconnect 00:07:55.185 ************************************ 00:07:55.185 08:15:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:55.185 * Looking for test storage... 00:07:55.185 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.185 08:15:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:55.185 08:15:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:55.185 08:15:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:55.185 08:15:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:55.185 08:15:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:55.185 08:15:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:55.185 08:15:40 -- scripts/common.sh@335 -- # IFS=.-: 00:07:55.185 08:15:40 -- scripts/common.sh@335 -- # read -ra ver1 00:07:55.185 08:15:40 -- scripts/common.sh@336 -- # IFS=.-: 00:07:55.185 08:15:40 -- scripts/common.sh@336 -- # read -ra ver2 00:07:55.185 08:15:40 -- scripts/common.sh@337 -- # local 'op=<' 00:07:55.185 08:15:40 -- scripts/common.sh@339 -- # ver1_l=2 00:07:55.185 08:15:40 -- scripts/common.sh@340 -- # ver2_l=1 00:07:55.185 08:15:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:55.185 08:15:40 -- scripts/common.sh@343 -- # case "$op" in 00:07:55.185 08:15:40 -- scripts/common.sh@344 -- # : 1 00:07:55.185 08:15:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:55.185 08:15:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:55.185 08:15:40 -- scripts/common.sh@364 -- # decimal 1 00:07:55.185 08:15:40 -- scripts/common.sh@352 -- # local d=1 00:07:55.185 08:15:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:55.185 08:15:40 -- scripts/common.sh@354 -- # echo 1 00:07:55.185 08:15:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:55.185 08:15:40 -- scripts/common.sh@365 -- # decimal 2 00:07:55.185 08:15:40 -- scripts/common.sh@352 -- # local d=2 00:07:55.185 08:15:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:55.185 08:15:40 -- scripts/common.sh@354 -- # echo 2 00:07:55.185 08:15:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:55.185 08:15:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:55.185 08:15:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:55.185 08:15:40 -- scripts/common.sh@367 -- # return 0 00:07:55.185 08:15:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:55.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.185 --rc genhtml_branch_coverage=1 00:07:55.185 --rc genhtml_function_coverage=1 00:07:55.185 --rc genhtml_legend=1 00:07:55.185 --rc geninfo_all_blocks=1 00:07:55.185 --rc geninfo_unexecuted_blocks=1 00:07:55.185 00:07:55.185 ' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:55.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.185 --rc genhtml_branch_coverage=1 00:07:55.185 --rc genhtml_function_coverage=1 00:07:55.185 --rc genhtml_legend=1 00:07:55.185 --rc geninfo_all_blocks=1 00:07:55.185 --rc geninfo_unexecuted_blocks=1 00:07:55.185 00:07:55.185 ' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:55.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.185 --rc genhtml_branch_coverage=1 00:07:55.185 --rc genhtml_function_coverage=1 00:07:55.185 --rc genhtml_legend=1 00:07:55.185 --rc geninfo_all_blocks=1 00:07:55.185 --rc geninfo_unexecuted_blocks=1 00:07:55.185 00:07:55.185 ' 00:07:55.185 08:15:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:55.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.185 --rc genhtml_branch_coverage=1 00:07:55.185 --rc genhtml_function_coverage=1 00:07:55.185 --rc genhtml_legend=1 00:07:55.185 --rc geninfo_all_blocks=1 00:07:55.185 --rc geninfo_unexecuted_blocks=1 00:07:55.185 00:07:55.185 ' 00:07:55.185 08:15:40 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:55.185 08:15:40 -- nvmf/common.sh@7 -- # uname -s 00:07:55.185 08:15:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:55.185 08:15:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:55.185 08:15:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:55.185 08:15:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:55.185 08:15:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:55.185 08:15:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:55.185 08:15:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:55.185 08:15:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:55.185 08:15:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:55.185 08:15:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:55.185 08:15:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.185 08:15:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.185 08:15:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:55.185 08:15:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:55.185 08:15:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:55.185 08:15:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:55.185 08:15:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:55.185 08:15:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:55.185 08:15:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:55.185 08:15:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.185 08:15:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.185 08:15:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.185 08:15:40 -- paths/export.sh@5 -- # export PATH 00:07:55.185 08:15:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.185 08:15:40 -- nvmf/common.sh@46 -- # : 0 00:07:55.185 08:15:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:55.185 08:15:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:55.185 08:15:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:55.185 08:15:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:55.185 08:15:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:55.185 08:15:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:55.185 08:15:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:55.185 08:15:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:55.185 08:15:40 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:55.185 08:15:40 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:55.185 08:15:40 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:55.185 08:15:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:55.185 08:15:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:55.185 08:15:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:55.185 08:15:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:55.185 08:15:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:55.185 08:15:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:55.185 08:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:55.185 08:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:55.185 08:15:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:55.185 08:15:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:55.185 08:15:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:55.185 08:15:40 -- common/autotest_common.sh@10 -- # set +x 00:07:57.086 08:15:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:57.086 08:15:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:57.086 08:15:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:57.086 08:15:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:57.086 08:15:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:57.086 08:15:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:57.086 08:15:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:57.086 08:15:42 -- nvmf/common.sh@294 -- # net_devs=() 00:07:57.086 08:15:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:57.086 08:15:42 -- nvmf/common.sh@295 -- # e810=() 00:07:57.086 08:15:42 -- nvmf/common.sh@295 -- # local -ga e810 00:07:57.086 08:15:42 -- nvmf/common.sh@296 -- # x722=() 00:07:57.086 08:15:42 -- nvmf/common.sh@296 -- # local -ga x722 00:07:57.086 08:15:42 -- nvmf/common.sh@297 -- # mlx=() 00:07:57.086 08:15:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:57.086 08:15:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:57.086 08:15:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:57.086 08:15:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:57.086 08:15:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:57.086 08:15:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.086 08:15:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:57.086 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:57.086 08:15:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.086 08:15:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.087 08:15:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:57.087 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:57.087 08:15:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:57.087 08:15:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.087 08:15:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.087 08:15:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.087 08:15:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.087 08:15:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:57.087 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:57.087 08:15:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.087 08:15:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.087 08:15:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.087 08:15:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.087 08:15:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.087 08:15:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:57.087 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:57.087 08:15:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.087 08:15:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:57.087 08:15:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:57.087 08:15:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:57.087 08:15:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:57.087 08:15:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:57.087 08:15:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:57.087 08:15:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:57.087 08:15:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:57.087 08:15:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:57.087 08:15:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:57.087 08:15:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:57.087 08:15:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:57.087 08:15:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:57.087 08:15:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:57.087 08:15:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:57.087 08:15:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:57.087 08:15:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:57.087 08:15:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:57.087 08:15:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:57.087 08:15:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:57.087 08:15:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:57.087 08:15:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:57.087 08:15:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:57.087 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:57.087 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:07:57.087 00:07:57.087 --- 10.0.0.2 ping statistics --- 00:07:57.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.087 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:07:57.087 08:15:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:57.087 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:57.087 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:07:57.087 00:07:57.087 --- 10.0.0.1 ping statistics --- 00:07:57.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.087 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:07:57.087 08:15:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:57.087 08:15:42 -- nvmf/common.sh@410 -- # return 0 00:07:57.087 08:15:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:57.087 08:15:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:57.087 08:15:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:57.087 08:15:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:57.087 08:15:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:57.087 08:15:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:57.087 08:15:42 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:57.087 08:15:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:57.087 08:15:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:57.087 08:15:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.087 08:15:42 -- nvmf/common.sh@469 -- # nvmfpid=872625 00:07:57.087 08:15:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:57.087 08:15:42 -- nvmf/common.sh@470 -- # waitforlisten 872625 00:07:57.087 08:15:42 -- common/autotest_common.sh@829 -- # '[' -z 872625 ']' 00:07:57.087 08:15:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:57.087 08:15:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:57.087 08:15:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:57.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:57.087 08:15:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:57.087 08:15:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.087 [2024-11-26 08:15:42.918436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:57.087 [2024-11-26 08:15:42.918516] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:57.345 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.345 [2024-11-26 08:15:42.992291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:57.345 [2024-11-26 08:15:43.111067] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:57.345 [2024-11-26 08:15:43.111239] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:57.345 [2024-11-26 08:15:43.111269] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:57.345 [2024-11-26 08:15:43.111292] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:57.345 [2024-11-26 08:15:43.111385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:57.345 [2024-11-26 08:15:43.111450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:57.345 [2024-11-26 08:15:43.111508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:57.345 [2024-11-26 08:15:43.111512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.277 08:15:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:58.277 08:15:43 -- common/autotest_common.sh@862 -- # return 0 00:07:58.277 08:15:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:58.277 08:15:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 08:15:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:58.277 08:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 [2024-11-26 08:15:43.934369] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:58.277 08:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:58.277 08:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 08:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:58.277 08:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 08:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:58.277 08:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 08:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:58.277 08:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.277 08:15:43 -- common/autotest_common.sh@10 -- # set +x 00:07:58.277 [2024-11-26 08:15:43.985542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:58.277 08:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:58.277 08:15:43 -- target/connect_disconnect.sh@34 -- # set +x 00:08:00.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.226 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.128 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.606 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.130 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.026 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.075 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.499 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.489 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.393 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.931 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.375 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.817 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.882 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.338 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.872 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.313 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.829 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.818 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.349 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.174 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.713 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.138 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.018 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.088 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.994 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.531 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.443 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.992 08:19:35 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:49.992 08:19:35 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:49.992 08:19:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:49.992 08:19:35 -- nvmf/common.sh@116 -- # sync 00:11:49.992 08:19:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:49.992 08:19:35 -- nvmf/common.sh@119 -- # set +e 00:11:49.992 08:19:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:49.992 08:19:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:49.992 rmmod nvme_tcp 00:11:49.992 rmmod nvme_fabrics 00:11:49.992 rmmod nvme_keyring 00:11:49.992 08:19:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:49.992 08:19:35 -- nvmf/common.sh@123 -- # set -e 00:11:49.992 08:19:35 -- nvmf/common.sh@124 -- # return 0 00:11:49.992 08:19:35 -- nvmf/common.sh@477 -- # '[' -n 872625 ']' 00:11:49.992 08:19:35 -- nvmf/common.sh@478 -- # killprocess 872625 00:11:49.992 08:19:35 -- common/autotest_common.sh@936 -- # '[' -z 872625 ']' 00:11:49.992 08:19:35 -- common/autotest_common.sh@940 -- # kill -0 872625 00:11:49.992 08:19:35 -- common/autotest_common.sh@941 -- # uname 00:11:49.992 08:19:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:49.992 08:19:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 872625 00:11:49.992 08:19:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:49.992 08:19:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:49.992 08:19:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 872625' 00:11:49.992 killing process with pid 872625 00:11:49.992 08:19:35 -- common/autotest_common.sh@955 -- # kill 872625 00:11:49.992 08:19:35 -- common/autotest_common.sh@960 -- # wait 872625 00:11:50.252 08:19:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:50.252 08:19:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:50.252 08:19:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:50.252 08:19:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:50.252 08:19:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:50.252 08:19:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:50.252 08:19:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:50.252 08:19:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.790 08:19:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:52.790 00:11:52.790 real 3m57.528s 00:11:52.790 user 15m6.013s 00:11:52.790 sys 0m34.184s 00:11:52.790 08:19:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:52.790 08:19:38 -- common/autotest_common.sh@10 -- # set +x 00:11:52.790 ************************************ 00:11:52.790 END TEST nvmf_connect_disconnect 00:11:52.790 ************************************ 00:11:52.790 08:19:38 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:52.790 08:19:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:52.790 08:19:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:52.790 08:19:38 -- common/autotest_common.sh@10 -- # set +x 00:11:52.790 ************************************ 00:11:52.790 START TEST nvmf_multitarget 00:11:52.790 ************************************ 00:11:52.790 08:19:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:52.790 * Looking for test storage... 00:11:52.790 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:52.790 08:19:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:52.790 08:19:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:52.790 08:19:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:52.790 08:19:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:52.790 08:19:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:52.790 08:19:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:52.790 08:19:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:52.790 08:19:38 -- scripts/common.sh@335 -- # IFS=.-: 00:11:52.790 08:19:38 -- scripts/common.sh@335 -- # read -ra ver1 00:11:52.790 08:19:38 -- scripts/common.sh@336 -- # IFS=.-: 00:11:52.790 08:19:38 -- scripts/common.sh@336 -- # read -ra ver2 00:11:52.790 08:19:38 -- scripts/common.sh@337 -- # local 'op=<' 00:11:52.790 08:19:38 -- scripts/common.sh@339 -- # ver1_l=2 00:11:52.790 08:19:38 -- scripts/common.sh@340 -- # ver2_l=1 00:11:52.790 08:19:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:52.790 08:19:38 -- scripts/common.sh@343 -- # case "$op" in 00:11:52.790 08:19:38 -- scripts/common.sh@344 -- # : 1 00:11:52.790 08:19:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:52.790 08:19:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:52.790 08:19:38 -- scripts/common.sh@364 -- # decimal 1 00:11:52.790 08:19:38 -- scripts/common.sh@352 -- # local d=1 00:11:52.790 08:19:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:52.790 08:19:38 -- scripts/common.sh@354 -- # echo 1 00:11:52.790 08:19:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:52.790 08:19:38 -- scripts/common.sh@365 -- # decimal 2 00:11:52.790 08:19:38 -- scripts/common.sh@352 -- # local d=2 00:11:52.790 08:19:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:52.790 08:19:38 -- scripts/common.sh@354 -- # echo 2 00:11:52.790 08:19:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:52.790 08:19:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:52.790 08:19:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:52.790 08:19:38 -- scripts/common.sh@367 -- # return 0 00:11:52.790 08:19:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:52.790 08:19:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:52.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.790 --rc genhtml_branch_coverage=1 00:11:52.790 --rc genhtml_function_coverage=1 00:11:52.790 --rc genhtml_legend=1 00:11:52.790 --rc geninfo_all_blocks=1 00:11:52.790 --rc geninfo_unexecuted_blocks=1 00:11:52.790 00:11:52.790 ' 00:11:52.790 08:19:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:52.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.790 --rc genhtml_branch_coverage=1 00:11:52.790 --rc genhtml_function_coverage=1 00:11:52.790 --rc genhtml_legend=1 00:11:52.790 --rc geninfo_all_blocks=1 00:11:52.790 --rc geninfo_unexecuted_blocks=1 00:11:52.790 00:11:52.791 ' 00:11:52.791 08:19:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:52.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.791 --rc genhtml_branch_coverage=1 00:11:52.791 --rc genhtml_function_coverage=1 00:11:52.791 --rc genhtml_legend=1 00:11:52.791 --rc geninfo_all_blocks=1 00:11:52.791 --rc geninfo_unexecuted_blocks=1 00:11:52.791 00:11:52.791 ' 00:11:52.791 08:19:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:52.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.791 --rc genhtml_branch_coverage=1 00:11:52.791 --rc genhtml_function_coverage=1 00:11:52.791 --rc genhtml_legend=1 00:11:52.791 --rc geninfo_all_blocks=1 00:11:52.791 --rc geninfo_unexecuted_blocks=1 00:11:52.791 00:11:52.791 ' 00:11:52.791 08:19:38 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:52.791 08:19:38 -- nvmf/common.sh@7 -- # uname -s 00:11:52.791 08:19:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:52.791 08:19:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:52.791 08:19:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:52.791 08:19:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:52.791 08:19:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:52.791 08:19:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:52.791 08:19:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:52.791 08:19:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:52.791 08:19:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:52.791 08:19:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:52.791 08:19:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:52.791 08:19:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:52.791 08:19:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:52.791 08:19:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:52.791 08:19:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:52.791 08:19:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:52.791 08:19:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:52.791 08:19:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:52.791 08:19:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:52.791 08:19:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.791 08:19:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.791 08:19:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.791 08:19:38 -- paths/export.sh@5 -- # export PATH 00:11:52.791 08:19:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.791 08:19:38 -- nvmf/common.sh@46 -- # : 0 00:11:52.791 08:19:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:52.791 08:19:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:52.791 08:19:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:52.791 08:19:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:52.791 08:19:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:52.791 08:19:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:52.791 08:19:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:52.791 08:19:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:52.791 08:19:38 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:52.791 08:19:38 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:52.791 08:19:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:52.791 08:19:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:52.791 08:19:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:52.791 08:19:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:52.791 08:19:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:52.791 08:19:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:52.791 08:19:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:52.791 08:19:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.791 08:19:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:52.791 08:19:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:52.791 08:19:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:52.791 08:19:38 -- common/autotest_common.sh@10 -- # set +x 00:11:54.693 08:19:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:54.693 08:19:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:54.693 08:19:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:54.693 08:19:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:54.693 08:19:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:54.693 08:19:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:54.693 08:19:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:54.693 08:19:40 -- nvmf/common.sh@294 -- # net_devs=() 00:11:54.693 08:19:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:54.693 08:19:40 -- nvmf/common.sh@295 -- # e810=() 00:11:54.693 08:19:40 -- nvmf/common.sh@295 -- # local -ga e810 00:11:54.693 08:19:40 -- nvmf/common.sh@296 -- # x722=() 00:11:54.693 08:19:40 -- nvmf/common.sh@296 -- # local -ga x722 00:11:54.693 08:19:40 -- nvmf/common.sh@297 -- # mlx=() 00:11:54.693 08:19:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:54.693 08:19:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:54.693 08:19:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:54.693 08:19:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:54.693 08:19:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:54.693 08:19:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:54.693 08:19:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:54.693 08:19:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:54.693 08:19:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.693 08:19:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:54.694 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:54.694 08:19:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.694 08:19:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:54.694 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:54.694 08:19:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:54.694 08:19:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.694 08:19:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.694 08:19:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.694 08:19:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.694 08:19:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:54.694 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:54.694 08:19:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.694 08:19:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.694 08:19:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.694 08:19:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.694 08:19:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.694 08:19:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:54.694 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:54.694 08:19:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.694 08:19:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:54.694 08:19:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:54.694 08:19:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:54.694 08:19:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:54.694 08:19:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:54.694 08:19:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:54.694 08:19:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:54.694 08:19:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:54.694 08:19:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:54.694 08:19:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:54.694 08:19:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:54.694 08:19:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:54.694 08:19:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:54.694 08:19:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:54.694 08:19:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:54.694 08:19:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:54.694 08:19:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:54.694 08:19:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:54.694 08:19:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:54.694 08:19:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:54.694 08:19:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:54.694 08:19:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:54.694 08:19:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:54.694 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:54.694 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:11:54.694 00:11:54.694 --- 10.0.0.2 ping statistics --- 00:11:54.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.694 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:11:54.694 08:19:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:54.694 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:54.694 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:11:54.694 00:11:54.694 --- 10.0.0.1 ping statistics --- 00:11:54.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.694 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:11:54.694 08:19:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:54.694 08:19:40 -- nvmf/common.sh@410 -- # return 0 00:11:54.694 08:19:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:54.694 08:19:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:54.694 08:19:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:54.694 08:19:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:54.694 08:19:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:54.694 08:19:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:54.694 08:19:40 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:54.694 08:19:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:54.694 08:19:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:54.694 08:19:40 -- common/autotest_common.sh@10 -- # set +x 00:11:54.694 08:19:40 -- nvmf/common.sh@469 -- # nvmfpid=904768 00:11:54.694 08:19:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:54.694 08:19:40 -- nvmf/common.sh@470 -- # waitforlisten 904768 00:11:54.694 08:19:40 -- common/autotest_common.sh@829 -- # '[' -z 904768 ']' 00:11:54.694 08:19:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:54.694 08:19:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:54.694 08:19:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:54.694 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:54.694 08:19:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:54.694 08:19:40 -- common/autotest_common.sh@10 -- # set +x 00:11:54.953 [2024-11-26 08:19:40.555495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:54.953 [2024-11-26 08:19:40.555575] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:54.953 EAL: No free 2048 kB hugepages reported on node 1 00:11:54.953 [2024-11-26 08:19:40.623114] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:54.953 [2024-11-26 08:19:40.741410] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:54.953 [2024-11-26 08:19:40.741596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:54.953 [2024-11-26 08:19:40.741627] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:54.953 [2024-11-26 08:19:40.741649] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:54.953 [2024-11-26 08:19:40.741743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:54.953 [2024-11-26 08:19:40.741803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:54.953 [2024-11-26 08:19:40.741864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:54.953 [2024-11-26 08:19:40.741874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:55.887 08:19:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:55.887 08:19:41 -- common/autotest_common.sh@862 -- # return 0 00:11:55.887 08:19:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:55.887 08:19:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:55.887 08:19:41 -- common/autotest_common.sh@10 -- # set +x 00:11:55.887 08:19:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:55.887 08:19:41 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:55.887 08:19:41 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.887 08:19:41 -- target/multitarget.sh@21 -- # jq length 00:11:55.887 08:19:41 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:55.887 08:19:41 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:56.145 "nvmf_tgt_1" 00:11:56.145 08:19:41 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:56.145 "nvmf_tgt_2" 00:11:56.145 08:19:41 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:56.145 08:19:41 -- target/multitarget.sh@28 -- # jq length 00:11:56.403 08:19:42 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:56.403 08:19:42 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:56.403 true 00:11:56.403 08:19:42 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:56.403 true 00:11:56.403 08:19:42 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:56.403 08:19:42 -- target/multitarget.sh@35 -- # jq length 00:11:56.660 08:19:42 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:56.660 08:19:42 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:56.660 08:19:42 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:56.660 08:19:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:56.660 08:19:42 -- nvmf/common.sh@116 -- # sync 00:11:56.660 08:19:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:56.660 08:19:42 -- nvmf/common.sh@119 -- # set +e 00:11:56.660 08:19:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:56.660 08:19:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:56.660 rmmod nvme_tcp 00:11:56.660 rmmod nvme_fabrics 00:11:56.660 rmmod nvme_keyring 00:11:56.660 08:19:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:56.660 08:19:42 -- nvmf/common.sh@123 -- # set -e 00:11:56.660 08:19:42 -- nvmf/common.sh@124 -- # return 0 00:11:56.660 08:19:42 -- nvmf/common.sh@477 -- # '[' -n 904768 ']' 00:11:56.660 08:19:42 -- nvmf/common.sh@478 -- # killprocess 904768 00:11:56.660 08:19:42 -- common/autotest_common.sh@936 -- # '[' -z 904768 ']' 00:11:56.660 08:19:42 -- common/autotest_common.sh@940 -- # kill -0 904768 00:11:56.660 08:19:42 -- common/autotest_common.sh@941 -- # uname 00:11:56.660 08:19:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:56.660 08:19:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 904768 00:11:56.660 08:19:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:56.660 08:19:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:56.661 08:19:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 904768' 00:11:56.661 killing process with pid 904768 00:11:56.661 08:19:42 -- common/autotest_common.sh@955 -- # kill 904768 00:11:56.661 08:19:42 -- common/autotest_common.sh@960 -- # wait 904768 00:11:56.920 08:19:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:56.920 08:19:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:56.920 08:19:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:56.920 08:19:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:56.920 08:19:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:56.920 08:19:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.920 08:19:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.920 08:19:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:59.457 08:19:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:59.457 00:11:59.457 real 0m6.688s 00:11:59.457 user 0m9.409s 00:11:59.457 sys 0m2.120s 00:11:59.457 08:19:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:59.457 08:19:44 -- common/autotest_common.sh@10 -- # set +x 00:11:59.457 ************************************ 00:11:59.457 END TEST nvmf_multitarget 00:11:59.457 ************************************ 00:11:59.457 08:19:44 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:59.457 08:19:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:59.457 08:19:44 -- common/autotest_common.sh@10 -- # set +x 00:11:59.457 ************************************ 00:11:59.457 START TEST nvmf_rpc 00:11:59.457 ************************************ 00:11:59.457 08:19:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:59.457 * Looking for test storage... 00:11:59.457 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:59.457 08:19:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:59.457 08:19:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:59.457 08:19:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:59.457 08:19:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:59.457 08:19:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:59.457 08:19:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:59.457 08:19:44 -- scripts/common.sh@335 -- # IFS=.-: 00:11:59.457 08:19:44 -- scripts/common.sh@335 -- # read -ra ver1 00:11:59.457 08:19:44 -- scripts/common.sh@336 -- # IFS=.-: 00:11:59.457 08:19:44 -- scripts/common.sh@336 -- # read -ra ver2 00:11:59.457 08:19:44 -- scripts/common.sh@337 -- # local 'op=<' 00:11:59.457 08:19:44 -- scripts/common.sh@339 -- # ver1_l=2 00:11:59.457 08:19:44 -- scripts/common.sh@340 -- # ver2_l=1 00:11:59.457 08:19:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:59.457 08:19:44 -- scripts/common.sh@343 -- # case "$op" in 00:11:59.457 08:19:44 -- scripts/common.sh@344 -- # : 1 00:11:59.457 08:19:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:59.457 08:19:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:59.457 08:19:44 -- scripts/common.sh@364 -- # decimal 1 00:11:59.457 08:19:44 -- scripts/common.sh@352 -- # local d=1 00:11:59.457 08:19:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:59.457 08:19:44 -- scripts/common.sh@354 -- # echo 1 00:11:59.457 08:19:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:59.457 08:19:44 -- scripts/common.sh@365 -- # decimal 2 00:11:59.457 08:19:44 -- scripts/common.sh@352 -- # local d=2 00:11:59.457 08:19:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:59.457 08:19:44 -- scripts/common.sh@354 -- # echo 2 00:11:59.457 08:19:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:59.457 08:19:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:59.457 08:19:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:59.457 08:19:44 -- scripts/common.sh@367 -- # return 0 00:11:59.457 08:19:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:59.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.457 --rc genhtml_branch_coverage=1 00:11:59.457 --rc genhtml_function_coverage=1 00:11:59.457 --rc genhtml_legend=1 00:11:59.457 --rc geninfo_all_blocks=1 00:11:59.457 --rc geninfo_unexecuted_blocks=1 00:11:59.457 00:11:59.457 ' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:59.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.457 --rc genhtml_branch_coverage=1 00:11:59.457 --rc genhtml_function_coverage=1 00:11:59.457 --rc genhtml_legend=1 00:11:59.457 --rc geninfo_all_blocks=1 00:11:59.457 --rc geninfo_unexecuted_blocks=1 00:11:59.457 00:11:59.457 ' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:59.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.457 --rc genhtml_branch_coverage=1 00:11:59.457 --rc genhtml_function_coverage=1 00:11:59.457 --rc genhtml_legend=1 00:11:59.457 --rc geninfo_all_blocks=1 00:11:59.457 --rc geninfo_unexecuted_blocks=1 00:11:59.457 00:11:59.457 ' 00:11:59.457 08:19:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:59.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.457 --rc genhtml_branch_coverage=1 00:11:59.457 --rc genhtml_function_coverage=1 00:11:59.457 --rc genhtml_legend=1 00:11:59.457 --rc geninfo_all_blocks=1 00:11:59.457 --rc geninfo_unexecuted_blocks=1 00:11:59.457 00:11:59.457 ' 00:11:59.457 08:19:44 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:59.457 08:19:44 -- nvmf/common.sh@7 -- # uname -s 00:11:59.457 08:19:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:59.457 08:19:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:59.457 08:19:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:59.457 08:19:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:59.457 08:19:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:59.457 08:19:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:59.457 08:19:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:59.457 08:19:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:59.457 08:19:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:59.457 08:19:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:59.457 08:19:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.457 08:19:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.457 08:19:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:59.457 08:19:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:59.457 08:19:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:59.457 08:19:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:59.457 08:19:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:59.457 08:19:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:59.457 08:19:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:59.457 08:19:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.457 08:19:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.457 08:19:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.457 08:19:44 -- paths/export.sh@5 -- # export PATH 00:11:59.458 08:19:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.458 08:19:44 -- nvmf/common.sh@46 -- # : 0 00:11:59.458 08:19:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:59.458 08:19:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:59.458 08:19:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:59.458 08:19:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:59.458 08:19:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:59.458 08:19:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:59.458 08:19:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:59.458 08:19:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:59.458 08:19:44 -- target/rpc.sh@11 -- # loops=5 00:11:59.458 08:19:44 -- target/rpc.sh@23 -- # nvmftestinit 00:11:59.458 08:19:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:59.458 08:19:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:59.458 08:19:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:59.458 08:19:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:59.458 08:19:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:59.458 08:19:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:59.458 08:19:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:59.458 08:19:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:59.458 08:19:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:59.458 08:19:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:59.458 08:19:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:59.458 08:19:44 -- common/autotest_common.sh@10 -- # set +x 00:12:01.362 08:19:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:01.362 08:19:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:01.362 08:19:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:01.362 08:19:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:01.362 08:19:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:01.362 08:19:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:01.362 08:19:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:01.362 08:19:46 -- nvmf/common.sh@294 -- # net_devs=() 00:12:01.362 08:19:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:01.362 08:19:46 -- nvmf/common.sh@295 -- # e810=() 00:12:01.362 08:19:46 -- nvmf/common.sh@295 -- # local -ga e810 00:12:01.362 08:19:46 -- nvmf/common.sh@296 -- # x722=() 00:12:01.362 08:19:46 -- nvmf/common.sh@296 -- # local -ga x722 00:12:01.362 08:19:46 -- nvmf/common.sh@297 -- # mlx=() 00:12:01.362 08:19:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:01.362 08:19:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:01.362 08:19:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:01.362 08:19:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:01.362 08:19:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:01.362 08:19:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:01.362 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:01.362 08:19:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:01.362 08:19:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:01.362 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:01.362 08:19:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:01.362 08:19:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.362 08:19:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.362 08:19:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:01.362 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:01.362 08:19:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.362 08:19:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:01.362 08:19:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.362 08:19:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.362 08:19:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:01.362 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:01.362 08:19:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.362 08:19:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:01.362 08:19:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:01.362 08:19:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:01.362 08:19:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:01.362 08:19:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:01.362 08:19:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:01.362 08:19:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:01.362 08:19:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:01.362 08:19:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:01.362 08:19:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:01.362 08:19:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:01.363 08:19:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:01.363 08:19:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:01.363 08:19:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:01.363 08:19:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:01.363 08:19:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:01.363 08:19:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:01.363 08:19:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:01.363 08:19:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:01.363 08:19:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:01.363 08:19:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:01.363 08:19:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:01.363 08:19:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:01.363 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:01.363 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:12:01.363 00:12:01.363 --- 10.0.0.2 ping statistics --- 00:12:01.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:01.363 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:12:01.363 08:19:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:01.363 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:01.363 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:12:01.363 00:12:01.363 --- 10.0.0.1 ping statistics --- 00:12:01.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:01.363 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:12:01.363 08:19:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:01.363 08:19:47 -- nvmf/common.sh@410 -- # return 0 00:12:01.363 08:19:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:01.363 08:19:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:01.363 08:19:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:01.363 08:19:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:01.363 08:19:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:01.363 08:19:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:01.363 08:19:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:01.363 08:19:47 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:01.363 08:19:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:01.363 08:19:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:01.363 08:19:47 -- common/autotest_common.sh@10 -- # set +x 00:12:01.363 08:19:47 -- nvmf/common.sh@469 -- # nvmfpid=907026 00:12:01.363 08:19:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:01.363 08:19:47 -- nvmf/common.sh@470 -- # waitforlisten 907026 00:12:01.363 08:19:47 -- common/autotest_common.sh@829 -- # '[' -z 907026 ']' 00:12:01.363 08:19:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:01.363 08:19:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:01.363 08:19:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:01.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:01.363 08:19:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:01.363 08:19:47 -- common/autotest_common.sh@10 -- # set +x 00:12:01.363 [2024-11-26 08:19:47.212707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:01.363 [2024-11-26 08:19:47.212796] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:01.621 EAL: No free 2048 kB hugepages reported on node 1 00:12:01.621 [2024-11-26 08:19:47.277070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:01.621 [2024-11-26 08:19:47.386414] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:01.621 [2024-11-26 08:19:47.386568] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:01.621 [2024-11-26 08:19:47.386585] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:01.621 [2024-11-26 08:19:47.386597] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:01.621 [2024-11-26 08:19:47.386650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:01.621 [2024-11-26 08:19:47.386745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:01.621 [2024-11-26 08:19:47.386773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:01.621 [2024-11-26 08:19:47.386776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:02.553 08:19:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:02.553 08:19:48 -- common/autotest_common.sh@862 -- # return 0 00:12:02.553 08:19:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:02.553 08:19:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:02.553 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.553 08:19:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:02.553 08:19:48 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:02.553 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.553 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.553 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.553 08:19:48 -- target/rpc.sh@26 -- # stats='{ 00:12:02.553 "tick_rate": 2700000000, 00:12:02.553 "poll_groups": [ 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_0", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_1", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_2", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_3", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [] 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 }' 00:12:02.553 08:19:48 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:02.553 08:19:48 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:02.553 08:19:48 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:02.553 08:19:48 -- target/rpc.sh@15 -- # wc -l 00:12:02.553 08:19:48 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:02.553 08:19:48 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:02.553 08:19:48 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:02.553 08:19:48 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:02.553 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.553 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.553 [2024-11-26 08:19:48.314586] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:02.553 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.553 08:19:48 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:02.553 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.553 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.553 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.553 08:19:48 -- target/rpc.sh@33 -- # stats='{ 00:12:02.553 "tick_rate": 2700000000, 00:12:02.553 "poll_groups": [ 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_0", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [ 00:12:02.553 { 00:12:02.553 "trtype": "TCP" 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_1", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [ 00:12:02.553 { 00:12:02.553 "trtype": "TCP" 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_2", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [ 00:12:02.553 { 00:12:02.553 "trtype": "TCP" 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 }, 00:12:02.553 { 00:12:02.553 "name": "nvmf_tgt_poll_group_3", 00:12:02.553 "admin_qpairs": 0, 00:12:02.553 "io_qpairs": 0, 00:12:02.553 "current_admin_qpairs": 0, 00:12:02.553 "current_io_qpairs": 0, 00:12:02.553 "pending_bdev_io": 0, 00:12:02.553 "completed_nvme_io": 0, 00:12:02.553 "transports": [ 00:12:02.553 { 00:12:02.553 "trtype": "TCP" 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 } 00:12:02.553 ] 00:12:02.553 }' 00:12:02.553 08:19:48 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.553 08:19:48 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:02.553 08:19:48 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:02.553 08:19:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.811 08:19:48 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:02.811 08:19:48 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:02.811 08:19:48 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:02.811 08:19:48 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:02.811 08:19:48 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 Malloc1 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 [2024-11-26 08:19:48.468163] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.811 08:19:48 -- common/autotest_common.sh@650 -- # local es=0 00:12:02.811 08:19:48 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.811 08:19:48 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:02.811 08:19:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.811 08:19:48 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:02.811 08:19:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.811 08:19:48 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:02.811 08:19:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.811 08:19:48 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:02.811 08:19:48 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:02.811 08:19:48 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.811 [2024-11-26 08:19:48.490464] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:02.811 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:02.811 could not add new controller: failed to write to nvme-fabrics device 00:12:02.811 08:19:48 -- common/autotest_common.sh@653 -- # es=1 00:12:02.811 08:19:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:02.811 08:19:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:02.811 08:19:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:02.811 08:19:48 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:02.811 08:19:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.811 08:19:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.811 08:19:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.811 08:19:48 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:03.374 08:19:49 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:03.374 08:19:49 -- common/autotest_common.sh@1187 -- # local i=0 00:12:03.374 08:19:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:03.374 08:19:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:03.374 08:19:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:05.896 08:19:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:05.896 08:19:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:05.896 08:19:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:05.896 08:19:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:05.896 08:19:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:05.896 08:19:51 -- common/autotest_common.sh@1197 -- # return 0 00:12:05.896 08:19:51 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:05.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.896 08:19:51 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:05.896 08:19:51 -- common/autotest_common.sh@1208 -- # local i=0 00:12:05.896 08:19:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:05.896 08:19:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.896 08:19:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:05.896 08:19:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.896 08:19:51 -- common/autotest_common.sh@1220 -- # return 0 00:12:05.896 08:19:51 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.896 08:19:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.896 08:19:51 -- common/autotest_common.sh@10 -- # set +x 00:12:05.896 08:19:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.896 08:19:51 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.896 08:19:51 -- common/autotest_common.sh@650 -- # local es=0 00:12:05.896 08:19:51 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.896 08:19:51 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:05.896 08:19:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.896 08:19:51 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:05.896 08:19:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.896 08:19:51 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:05.896 08:19:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.896 08:19:51 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:05.896 08:19:51 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:05.896 08:19:51 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.896 [2024-11-26 08:19:51.243403] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:05.896 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:05.896 could not add new controller: failed to write to nvme-fabrics device 00:12:05.896 08:19:51 -- common/autotest_common.sh@653 -- # es=1 00:12:05.896 08:19:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:05.896 08:19:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:05.896 08:19:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:05.896 08:19:51 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:05.896 08:19:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.896 08:19:51 -- common/autotest_common.sh@10 -- # set +x 00:12:05.896 08:19:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.896 08:19:51 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:06.153 08:19:51 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:06.153 08:19:51 -- common/autotest_common.sh@1187 -- # local i=0 00:12:06.153 08:19:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:06.153 08:19:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:06.153 08:19:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:08.051 08:19:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:08.051 08:19:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:08.051 08:19:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:08.309 08:19:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:08.309 08:19:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:08.309 08:19:53 -- common/autotest_common.sh@1197 -- # return 0 00:12:08.309 08:19:53 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:08.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.309 08:19:53 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:08.309 08:19:53 -- common/autotest_common.sh@1208 -- # local i=0 00:12:08.309 08:19:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:08.309 08:19:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.309 08:19:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:08.309 08:19:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.309 08:19:53 -- common/autotest_common.sh@1220 -- # return 0 00:12:08.309 08:19:53 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.309 08:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.309 08:19:53 -- common/autotest_common.sh@10 -- # set +x 00:12:08.309 08:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.309 08:19:53 -- target/rpc.sh@81 -- # seq 1 5 00:12:08.309 08:19:54 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:08.309 08:19:54 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.309 08:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.309 08:19:54 -- common/autotest_common.sh@10 -- # set +x 00:12:08.309 08:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.309 08:19:54 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.309 08:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.309 08:19:54 -- common/autotest_common.sh@10 -- # set +x 00:12:08.309 [2024-11-26 08:19:54.015980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.309 08:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.309 08:19:54 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:08.309 08:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.309 08:19:54 -- common/autotest_common.sh@10 -- # set +x 00:12:08.309 08:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.309 08:19:54 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.309 08:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.309 08:19:54 -- common/autotest_common.sh@10 -- # set +x 00:12:08.309 08:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.309 08:19:54 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.876 08:19:54 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.876 08:19:54 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.876 08:19:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.876 08:19:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.876 08:19:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:11.404 08:19:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:11.404 08:19:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:11.404 08:19:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:11.404 08:19:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:11.404 08:19:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:11.404 08:19:56 -- common/autotest_common.sh@1197 -- # return 0 00:12:11.404 08:19:56 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:11.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.404 08:19:56 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:11.404 08:19:56 -- common/autotest_common.sh@1208 -- # local i=0 00:12:11.404 08:19:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:11.404 08:19:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.404 08:19:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:11.404 08:19:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.404 08:19:56 -- common/autotest_common.sh@1220 -- # return 0 00:12:11.404 08:19:56 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:11.404 08:19:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 [2024-11-26 08:19:56.800241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:11.404 08:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.404 08:19:56 -- common/autotest_common.sh@10 -- # set +x 00:12:11.404 08:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.404 08:19:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:11.662 08:19:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:11.662 08:19:57 -- common/autotest_common.sh@1187 -- # local i=0 00:12:11.662 08:19:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:11.662 08:19:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:11.662 08:19:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:14.188 08:19:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:14.188 08:19:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:14.188 08:19:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:14.188 08:19:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:14.188 08:19:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:14.188 08:19:59 -- common/autotest_common.sh@1197 -- # return 0 00:12:14.188 08:19:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:14.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.188 08:19:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:14.188 08:19:59 -- common/autotest_common.sh@1208 -- # local i=0 00:12:14.188 08:19:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:14.188 08:19:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.188 08:19:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:14.188 08:19:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.188 08:19:59 -- common/autotest_common.sh@1220 -- # return 0 00:12:14.188 08:19:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:14.188 08:19:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 [2024-11-26 08:19:59.585374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:14.188 08:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.188 08:19:59 -- common/autotest_common.sh@10 -- # set +x 00:12:14.188 08:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.188 08:19:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.446 08:20:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:14.446 08:20:00 -- common/autotest_common.sh@1187 -- # local i=0 00:12:14.446 08:20:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:14.446 08:20:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:14.446 08:20:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:16.973 08:20:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:16.973 08:20:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:16.973 08:20:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:16.973 08:20:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:16.973 08:20:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:16.973 08:20:02 -- common/autotest_common.sh@1197 -- # return 0 00:12:16.973 08:20:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:16.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.973 08:20:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:16.973 08:20:02 -- common/autotest_common.sh@1208 -- # local i=0 00:12:16.973 08:20:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:16.973 08:20:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.973 08:20:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:16.973 08:20:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.973 08:20:02 -- common/autotest_common.sh@1220 -- # return 0 00:12:16.973 08:20:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:16.973 08:20:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 [2024-11-26 08:20:02.370520] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:16.973 08:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.973 08:20:02 -- common/autotest_common.sh@10 -- # set +x 00:12:16.973 08:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.973 08:20:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:17.231 08:20:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:17.231 08:20:02 -- common/autotest_common.sh@1187 -- # local i=0 00:12:17.231 08:20:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:17.231 08:20:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:17.231 08:20:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:19.757 08:20:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:19.757 08:20:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:19.757 08:20:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.757 08:20:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:19.757 08:20:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.757 08:20:05 -- common/autotest_common.sh@1197 -- # return 0 00:12:19.757 08:20:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.757 08:20:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.757 08:20:05 -- common/autotest_common.sh@1208 -- # local i=0 00:12:19.757 08:20:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:19.757 08:20:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.757 08:20:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:19.757 08:20:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.757 08:20:05 -- common/autotest_common.sh@1220 -- # return 0 00:12:19.757 08:20:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:19.757 08:20:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 [2024-11-26 08:20:05.140287] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.757 08:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.757 08:20:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.757 08:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.757 08:20:05 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:20.015 08:20:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:20.015 08:20:05 -- common/autotest_common.sh@1187 -- # local i=0 00:12:20.015 08:20:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:20.015 08:20:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:20.015 08:20:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:22.543 08:20:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:22.543 08:20:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:22.543 08:20:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:22.543 08:20:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:22.543 08:20:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:22.543 08:20:07 -- common/autotest_common.sh@1197 -- # return 0 00:12:22.543 08:20:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:22.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.543 08:20:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:22.543 08:20:07 -- common/autotest_common.sh@1208 -- # local i=0 00:12:22.543 08:20:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:22.543 08:20:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.543 08:20:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:22.543 08:20:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.543 08:20:07 -- common/autotest_common.sh@1220 -- # return 0 00:12:22.543 08:20:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:22.543 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.543 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.543 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.543 08:20:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.543 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.543 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.543 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.543 08:20:07 -- target/rpc.sh@99 -- # seq 1 5 00:12:22.543 08:20:07 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.543 08:20:07 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.543 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.543 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:07 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.544 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 [2024-11-26 08:20:07.970206] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.544 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:07 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.544 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:07 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:07 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.544 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:07 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:07 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.544 08:20:08 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 [2024-11-26 08:20:08.018233] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.544 08:20:08 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 [2024-11-26 08:20:08.066405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.544 08:20:08 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 [2024-11-26 08:20:08.114552] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.544 08:20:08 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 [2024-11-26 08:20:08.162722] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:22.544 08:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.544 08:20:08 -- common/autotest_common.sh@10 -- # set +x 00:12:22.544 08:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.544 08:20:08 -- target/rpc.sh@110 -- # stats='{ 00:12:22.544 "tick_rate": 2700000000, 00:12:22.544 "poll_groups": [ 00:12:22.544 { 00:12:22.544 "name": "nvmf_tgt_poll_group_0", 00:12:22.544 "admin_qpairs": 2, 00:12:22.544 "io_qpairs": 84, 00:12:22.544 "current_admin_qpairs": 0, 00:12:22.544 "current_io_qpairs": 0, 00:12:22.544 "pending_bdev_io": 0, 00:12:22.544 "completed_nvme_io": 135, 00:12:22.544 "transports": [ 00:12:22.544 { 00:12:22.544 "trtype": "TCP" 00:12:22.544 } 00:12:22.544 ] 00:12:22.544 }, 00:12:22.544 { 00:12:22.544 "name": "nvmf_tgt_poll_group_1", 00:12:22.544 "admin_qpairs": 2, 00:12:22.544 "io_qpairs": 84, 00:12:22.545 "current_admin_qpairs": 0, 00:12:22.545 "current_io_qpairs": 0, 00:12:22.545 "pending_bdev_io": 0, 00:12:22.545 "completed_nvme_io": 184, 00:12:22.545 "transports": [ 00:12:22.545 { 00:12:22.545 "trtype": "TCP" 00:12:22.545 } 00:12:22.545 ] 00:12:22.545 }, 00:12:22.545 { 00:12:22.545 "name": "nvmf_tgt_poll_group_2", 00:12:22.545 "admin_qpairs": 1, 00:12:22.545 "io_qpairs": 84, 00:12:22.545 "current_admin_qpairs": 0, 00:12:22.545 "current_io_qpairs": 0, 00:12:22.545 "pending_bdev_io": 0, 00:12:22.545 "completed_nvme_io": 183, 00:12:22.545 "transports": [ 00:12:22.545 { 00:12:22.545 "trtype": "TCP" 00:12:22.545 } 00:12:22.545 ] 00:12:22.545 }, 00:12:22.545 { 00:12:22.545 "name": "nvmf_tgt_poll_group_3", 00:12:22.545 "admin_qpairs": 2, 00:12:22.545 "io_qpairs": 84, 00:12:22.545 "current_admin_qpairs": 0, 00:12:22.545 "current_io_qpairs": 0, 00:12:22.545 "pending_bdev_io": 0, 00:12:22.545 "completed_nvme_io": 184, 00:12:22.545 "transports": [ 00:12:22.545 { 00:12:22.545 "trtype": "TCP" 00:12:22.545 } 00:12:22.545 ] 00:12:22.545 } 00:12:22.545 ] 00:12:22.545 }' 00:12:22.545 08:20:08 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:22.545 08:20:08 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:22.545 08:20:08 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:22.545 08:20:08 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:22.545 08:20:08 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:22.545 08:20:08 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:22.545 08:20:08 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:22.545 08:20:08 -- target/rpc.sh@123 -- # nvmftestfini 00:12:22.545 08:20:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:22.545 08:20:08 -- nvmf/common.sh@116 -- # sync 00:12:22.545 08:20:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:22.545 08:20:08 -- nvmf/common.sh@119 -- # set +e 00:12:22.545 08:20:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:22.545 08:20:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:22.545 rmmod nvme_tcp 00:12:22.545 rmmod nvme_fabrics 00:12:22.545 rmmod nvme_keyring 00:12:22.545 08:20:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:22.545 08:20:08 -- nvmf/common.sh@123 -- # set -e 00:12:22.545 08:20:08 -- nvmf/common.sh@124 -- # return 0 00:12:22.545 08:20:08 -- nvmf/common.sh@477 -- # '[' -n 907026 ']' 00:12:22.545 08:20:08 -- nvmf/common.sh@478 -- # killprocess 907026 00:12:22.545 08:20:08 -- common/autotest_common.sh@936 -- # '[' -z 907026 ']' 00:12:22.545 08:20:08 -- common/autotest_common.sh@940 -- # kill -0 907026 00:12:22.545 08:20:08 -- common/autotest_common.sh@941 -- # uname 00:12:22.545 08:20:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:22.545 08:20:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 907026 00:12:22.545 08:20:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:22.545 08:20:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:22.545 08:20:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 907026' 00:12:22.545 killing process with pid 907026 00:12:22.545 08:20:08 -- common/autotest_common.sh@955 -- # kill 907026 00:12:22.545 08:20:08 -- common/autotest_common.sh@960 -- # wait 907026 00:12:23.114 08:20:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:23.114 08:20:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:23.114 08:20:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:23.114 08:20:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:23.114 08:20:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:23.114 08:20:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:23.114 08:20:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:23.114 08:20:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:25.147 08:20:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:25.147 00:12:25.147 real 0m25.951s 00:12:25.147 user 1m24.536s 00:12:25.147 sys 0m4.282s 00:12:25.147 08:20:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:25.147 08:20:10 -- common/autotest_common.sh@10 -- # set +x 00:12:25.147 ************************************ 00:12:25.147 END TEST nvmf_rpc 00:12:25.147 ************************************ 00:12:25.147 08:20:10 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:25.147 08:20:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:25.147 08:20:10 -- common/autotest_common.sh@10 -- # set +x 00:12:25.147 ************************************ 00:12:25.147 START TEST nvmf_invalid 00:12:25.147 ************************************ 00:12:25.147 08:20:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:25.147 * Looking for test storage... 00:12:25.147 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:25.147 08:20:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:25.147 08:20:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:25.147 08:20:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:25.147 08:20:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:25.147 08:20:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:25.147 08:20:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:25.147 08:20:10 -- scripts/common.sh@335 -- # IFS=.-: 00:12:25.147 08:20:10 -- scripts/common.sh@335 -- # read -ra ver1 00:12:25.147 08:20:10 -- scripts/common.sh@336 -- # IFS=.-: 00:12:25.147 08:20:10 -- scripts/common.sh@336 -- # read -ra ver2 00:12:25.147 08:20:10 -- scripts/common.sh@337 -- # local 'op=<' 00:12:25.147 08:20:10 -- scripts/common.sh@339 -- # ver1_l=2 00:12:25.147 08:20:10 -- scripts/common.sh@340 -- # ver2_l=1 00:12:25.147 08:20:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:25.147 08:20:10 -- scripts/common.sh@343 -- # case "$op" in 00:12:25.147 08:20:10 -- scripts/common.sh@344 -- # : 1 00:12:25.147 08:20:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:25.147 08:20:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:25.147 08:20:10 -- scripts/common.sh@364 -- # decimal 1 00:12:25.147 08:20:10 -- scripts/common.sh@352 -- # local d=1 00:12:25.147 08:20:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:25.147 08:20:10 -- scripts/common.sh@354 -- # echo 1 00:12:25.147 08:20:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:25.147 08:20:10 -- scripts/common.sh@365 -- # decimal 2 00:12:25.147 08:20:10 -- scripts/common.sh@352 -- # local d=2 00:12:25.147 08:20:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:25.147 08:20:10 -- scripts/common.sh@354 -- # echo 2 00:12:25.147 08:20:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:25.147 08:20:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:25.147 08:20:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:25.147 08:20:10 -- scripts/common.sh@367 -- # return 0 00:12:25.147 08:20:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:25.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.147 --rc genhtml_branch_coverage=1 00:12:25.147 --rc genhtml_function_coverage=1 00:12:25.147 --rc genhtml_legend=1 00:12:25.147 --rc geninfo_all_blocks=1 00:12:25.147 --rc geninfo_unexecuted_blocks=1 00:12:25.147 00:12:25.147 ' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:25.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.147 --rc genhtml_branch_coverage=1 00:12:25.147 --rc genhtml_function_coverage=1 00:12:25.147 --rc genhtml_legend=1 00:12:25.147 --rc geninfo_all_blocks=1 00:12:25.147 --rc geninfo_unexecuted_blocks=1 00:12:25.147 00:12:25.147 ' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:25.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.147 --rc genhtml_branch_coverage=1 00:12:25.147 --rc genhtml_function_coverage=1 00:12:25.147 --rc genhtml_legend=1 00:12:25.147 --rc geninfo_all_blocks=1 00:12:25.147 --rc geninfo_unexecuted_blocks=1 00:12:25.147 00:12:25.147 ' 00:12:25.147 08:20:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:25.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.147 --rc genhtml_branch_coverage=1 00:12:25.147 --rc genhtml_function_coverage=1 00:12:25.147 --rc genhtml_legend=1 00:12:25.147 --rc geninfo_all_blocks=1 00:12:25.147 --rc geninfo_unexecuted_blocks=1 00:12:25.147 00:12:25.147 ' 00:12:25.147 08:20:10 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:25.147 08:20:10 -- nvmf/common.sh@7 -- # uname -s 00:12:25.148 08:20:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:25.148 08:20:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:25.148 08:20:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:25.148 08:20:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:25.148 08:20:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:25.148 08:20:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:25.148 08:20:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:25.148 08:20:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:25.148 08:20:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:25.148 08:20:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:25.148 08:20:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.148 08:20:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.148 08:20:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:25.148 08:20:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:25.148 08:20:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:25.148 08:20:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:25.148 08:20:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:25.148 08:20:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:25.148 08:20:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:25.148 08:20:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.148 08:20:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.148 08:20:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.148 08:20:10 -- paths/export.sh@5 -- # export PATH 00:12:25.148 08:20:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.148 08:20:10 -- nvmf/common.sh@46 -- # : 0 00:12:25.148 08:20:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:25.148 08:20:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:25.148 08:20:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:25.148 08:20:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:25.148 08:20:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:25.148 08:20:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:25.148 08:20:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:25.148 08:20:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:25.148 08:20:10 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:25.148 08:20:10 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:25.148 08:20:10 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:25.148 08:20:10 -- target/invalid.sh@14 -- # target=foobar 00:12:25.148 08:20:10 -- target/invalid.sh@16 -- # RANDOM=0 00:12:25.148 08:20:10 -- target/invalid.sh@34 -- # nvmftestinit 00:12:25.148 08:20:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:25.148 08:20:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:25.148 08:20:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:25.148 08:20:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:25.148 08:20:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:25.148 08:20:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.148 08:20:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.148 08:20:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:25.148 08:20:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:25.148 08:20:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:25.148 08:20:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:25.148 08:20:10 -- common/autotest_common.sh@10 -- # set +x 00:12:27.682 08:20:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:27.682 08:20:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:27.682 08:20:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:27.682 08:20:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:27.682 08:20:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:27.682 08:20:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:27.682 08:20:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:27.682 08:20:12 -- nvmf/common.sh@294 -- # net_devs=() 00:12:27.682 08:20:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:27.682 08:20:12 -- nvmf/common.sh@295 -- # e810=() 00:12:27.682 08:20:12 -- nvmf/common.sh@295 -- # local -ga e810 00:12:27.682 08:20:12 -- nvmf/common.sh@296 -- # x722=() 00:12:27.682 08:20:12 -- nvmf/common.sh@296 -- # local -ga x722 00:12:27.682 08:20:12 -- nvmf/common.sh@297 -- # mlx=() 00:12:27.682 08:20:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:27.682 08:20:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:27.682 08:20:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:27.682 08:20:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:27.682 08:20:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.682 08:20:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:27.682 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:27.682 08:20:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.682 08:20:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:27.682 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:27.682 08:20:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.682 08:20:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.682 08:20:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.682 08:20:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:27.682 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:27.682 08:20:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.682 08:20:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.682 08:20:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.682 08:20:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.682 08:20:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:27.682 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:27.682 08:20:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.682 08:20:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:27.682 08:20:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:27.682 08:20:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:27.682 08:20:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:27.682 08:20:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:27.682 08:20:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:27.682 08:20:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:27.682 08:20:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:27.682 08:20:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:27.682 08:20:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:27.682 08:20:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:27.682 08:20:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:27.682 08:20:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:27.682 08:20:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:27.682 08:20:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:27.682 08:20:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:27.682 08:20:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:27.682 08:20:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:27.682 08:20:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:27.682 08:20:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:27.682 08:20:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:27.682 08:20:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:27.682 08:20:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:27.682 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:27.682 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:12:27.682 00:12:27.682 --- 10.0.0.2 ping statistics --- 00:12:27.682 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.682 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:12:27.682 08:20:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:27.682 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:27.682 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:12:27.682 00:12:27.682 --- 10.0.0.1 ping statistics --- 00:12:27.682 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.682 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:12:27.682 08:20:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:27.682 08:20:13 -- nvmf/common.sh@410 -- # return 0 00:12:27.682 08:20:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:27.683 08:20:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:27.683 08:20:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:27.683 08:20:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:27.683 08:20:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:27.683 08:20:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:27.683 08:20:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:27.683 08:20:13 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:27.683 08:20:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:27.683 08:20:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:27.683 08:20:13 -- common/autotest_common.sh@10 -- # set +x 00:12:27.683 08:20:13 -- nvmf/common.sh@469 -- # nvmfpid=911617 00:12:27.683 08:20:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:27.683 08:20:13 -- nvmf/common.sh@470 -- # waitforlisten 911617 00:12:27.683 08:20:13 -- common/autotest_common.sh@829 -- # '[' -z 911617 ']' 00:12:27.683 08:20:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:27.683 08:20:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:27.683 08:20:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:27.683 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:27.683 08:20:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:27.683 08:20:13 -- common/autotest_common.sh@10 -- # set +x 00:12:27.683 [2024-11-26 08:20:13.162402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:27.683 [2024-11-26 08:20:13.162474] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:27.683 EAL: No free 2048 kB hugepages reported on node 1 00:12:27.683 [2024-11-26 08:20:13.233053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:27.683 [2024-11-26 08:20:13.353841] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:27.683 [2024-11-26 08:20:13.354015] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:27.683 [2024-11-26 08:20:13.354036] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:27.683 [2024-11-26 08:20:13.354050] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:27.683 [2024-11-26 08:20:13.354123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:27.683 [2024-11-26 08:20:13.354186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:27.683 [2024-11-26 08:20:13.354252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:27.683 [2024-11-26 08:20:13.354255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:28.616 08:20:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:28.616 08:20:14 -- common/autotest_common.sh@862 -- # return 0 00:12:28.616 08:20:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:28.616 08:20:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:28.616 08:20:14 -- common/autotest_common.sh@10 -- # set +x 00:12:28.616 08:20:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:28.616 08:20:14 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:28.616 08:20:14 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode28899 00:12:28.616 [2024-11-26 08:20:14.384009] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:28.616 08:20:14 -- target/invalid.sh@40 -- # out='request: 00:12:28.616 { 00:12:28.616 "nqn": "nqn.2016-06.io.spdk:cnode28899", 00:12:28.616 "tgt_name": "foobar", 00:12:28.616 "method": "nvmf_create_subsystem", 00:12:28.616 "req_id": 1 00:12:28.616 } 00:12:28.616 Got JSON-RPC error response 00:12:28.616 response: 00:12:28.616 { 00:12:28.616 "code": -32603, 00:12:28.616 "message": "Unable to find target foobar" 00:12:28.616 }' 00:12:28.616 08:20:14 -- target/invalid.sh@41 -- # [[ request: 00:12:28.616 { 00:12:28.616 "nqn": "nqn.2016-06.io.spdk:cnode28899", 00:12:28.616 "tgt_name": "foobar", 00:12:28.616 "method": "nvmf_create_subsystem", 00:12:28.616 "req_id": 1 00:12:28.616 } 00:12:28.616 Got JSON-RPC error response 00:12:28.616 response: 00:12:28.616 { 00:12:28.616 "code": -32603, 00:12:28.616 "message": "Unable to find target foobar" 00:12:28.616 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:28.616 08:20:14 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:28.616 08:20:14 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode24067 00:12:28.874 [2024-11-26 08:20:14.632832] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24067: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:28.874 08:20:14 -- target/invalid.sh@45 -- # out='request: 00:12:28.874 { 00:12:28.874 "nqn": "nqn.2016-06.io.spdk:cnode24067", 00:12:28.874 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.874 "method": "nvmf_create_subsystem", 00:12:28.874 "req_id": 1 00:12:28.874 } 00:12:28.874 Got JSON-RPC error response 00:12:28.874 response: 00:12:28.874 { 00:12:28.874 "code": -32602, 00:12:28.874 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.874 }' 00:12:28.874 08:20:14 -- target/invalid.sh@46 -- # [[ request: 00:12:28.874 { 00:12:28.874 "nqn": "nqn.2016-06.io.spdk:cnode24067", 00:12:28.874 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.874 "method": "nvmf_create_subsystem", 00:12:28.874 "req_id": 1 00:12:28.874 } 00:12:28.874 Got JSON-RPC error response 00:12:28.874 response: 00:12:28.874 { 00:12:28.874 "code": -32602, 00:12:28.874 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.874 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:28.874 08:20:14 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:28.874 08:20:14 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode31289 00:12:29.132 [2024-11-26 08:20:14.889655] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31289: invalid model number 'SPDK_Controller' 00:12:29.132 08:20:14 -- target/invalid.sh@50 -- # out='request: 00:12:29.132 { 00:12:29.132 "nqn": "nqn.2016-06.io.spdk:cnode31289", 00:12:29.132 "model_number": "SPDK_Controller\u001f", 00:12:29.132 "method": "nvmf_create_subsystem", 00:12:29.132 "req_id": 1 00:12:29.132 } 00:12:29.132 Got JSON-RPC error response 00:12:29.132 response: 00:12:29.132 { 00:12:29.132 "code": -32602, 00:12:29.132 "message": "Invalid MN SPDK_Controller\u001f" 00:12:29.132 }' 00:12:29.132 08:20:14 -- target/invalid.sh@51 -- # [[ request: 00:12:29.132 { 00:12:29.132 "nqn": "nqn.2016-06.io.spdk:cnode31289", 00:12:29.132 "model_number": "SPDK_Controller\u001f", 00:12:29.132 "method": "nvmf_create_subsystem", 00:12:29.132 "req_id": 1 00:12:29.132 } 00:12:29.132 Got JSON-RPC error response 00:12:29.132 response: 00:12:29.132 { 00:12:29.132 "code": -32602, 00:12:29.132 "message": "Invalid MN SPDK_Controller\u001f" 00:12:29.132 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:29.132 08:20:14 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:29.132 08:20:14 -- target/invalid.sh@19 -- # local length=21 ll 00:12:29.132 08:20:14 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:29.132 08:20:14 -- target/invalid.sh@21 -- # local chars 00:12:29.132 08:20:14 -- target/invalid.sh@22 -- # local string 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 39 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=\' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 33 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='!' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 81 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=Q 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 34 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='"' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 125 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='}' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 32 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=' ' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 83 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=S 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 85 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=U 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 62 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='>' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 86 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+=V 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 124 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='|' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # printf %x 33 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:29.132 08:20:14 -- target/invalid.sh@25 -- # string+='!' 00:12:29.132 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 102 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=f 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 41 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=')' 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 82 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=R 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 76 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=L 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 53 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=5 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 84 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=T 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 75 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=K 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 58 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=: 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # printf %x 77 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:29.133 08:20:14 -- target/invalid.sh@25 -- # string+=M 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.133 08:20:14 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.133 08:20:14 -- target/invalid.sh@28 -- # [[ ' == \- ]] 00:12:29.133 08:20:14 -- target/invalid.sh@31 -- # echo ''\''!Q"} SU>V|!f)RL5TK:M' 00:12:29.133 08:20:14 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s ''\''!Q"} SU>V|!f)RL5TK:M' nqn.2016-06.io.spdk:cnode10707 00:12:29.391 [2024-11-26 08:20:15.206714] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10707: invalid serial number ''!Q"} SU>V|!f)RL5TK:M' 00:12:29.391 08:20:15 -- target/invalid.sh@54 -- # out='request: 00:12:29.391 { 00:12:29.391 "nqn": "nqn.2016-06.io.spdk:cnode10707", 00:12:29.391 "serial_number": "'\''!Q\"} SU>V|!f)RL5TK:M", 00:12:29.391 "method": "nvmf_create_subsystem", 00:12:29.391 "req_id": 1 00:12:29.391 } 00:12:29.391 Got JSON-RPC error response 00:12:29.391 response: 00:12:29.391 { 00:12:29.391 "code": -32602, 00:12:29.391 "message": "Invalid SN '\''!Q\"} SU>V|!f)RL5TK:M" 00:12:29.391 }' 00:12:29.391 08:20:15 -- target/invalid.sh@55 -- # [[ request: 00:12:29.391 { 00:12:29.391 "nqn": "nqn.2016-06.io.spdk:cnode10707", 00:12:29.391 "serial_number": "'!Q\"} SU>V|!f)RL5TK:M", 00:12:29.391 "method": "nvmf_create_subsystem", 00:12:29.391 "req_id": 1 00:12:29.391 } 00:12:29.391 Got JSON-RPC error response 00:12:29.391 response: 00:12:29.391 { 00:12:29.391 "code": -32602, 00:12:29.391 "message": "Invalid SN '!Q\"} SU>V|!f)RL5TK:M" 00:12:29.391 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:29.391 08:20:15 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:29.391 08:20:15 -- target/invalid.sh@19 -- # local length=41 ll 00:12:29.391 08:20:15 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:29.391 08:20:15 -- target/invalid.sh@21 -- # local chars 00:12:29.391 08:20:15 -- target/invalid.sh@22 -- # local string 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # printf %x 65 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # string+=A 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # printf %x 100 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # string+=d 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # printf %x 33 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # string+='!' 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.391 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.391 08:20:15 -- target/invalid.sh@25 -- # printf %x 43 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+=+ 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 37 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+=% 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 89 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+=Y 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 57 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+=9 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 61 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+== 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 70 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+=F 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # printf %x 60 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:29.649 08:20:15 -- target/invalid.sh@25 -- # string+='<' 00:12:29.649 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 49 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=1 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 75 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=K 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 53 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=5 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 70 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=F 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 58 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=: 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 54 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=6 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 71 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=G 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 89 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=Y 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 108 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=l 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 126 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+='~' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 65 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=A 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 91 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+='[' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 49 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=1 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 50 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=2 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 40 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+='(' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 51 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=3 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 118 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=v 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 95 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=_ 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 59 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=';' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 72 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=H 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 93 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=']' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 55 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=7 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 41 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=')' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 44 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=, 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 71 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=G 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 47 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=/ 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 77 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=M 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 90 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=Z 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 34 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+='"' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 82 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+=R 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # printf %x 91 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:29.650 08:20:15 -- target/invalid.sh@25 -- # string+='[' 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.650 08:20:15 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.650 08:20:15 -- target/invalid.sh@28 -- # [[ A == \- ]] 00:12:29.650 08:20:15 -- target/invalid.sh@31 -- # echo 'Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ"R[' 00:12:29.650 08:20:15 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ"R[' nqn.2016-06.io.spdk:cnode22351 00:12:29.909 [2024-11-26 08:20:15.596016] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22351: invalid model number 'Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ"R[' 00:12:29.909 08:20:15 -- target/invalid.sh@58 -- # out='request: 00:12:29.909 { 00:12:29.909 "nqn": "nqn.2016-06.io.spdk:cnode22351", 00:12:29.909 "model_number": "Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ\"R[", 00:12:29.909 "method": "nvmf_create_subsystem", 00:12:29.909 "req_id": 1 00:12:29.909 } 00:12:29.909 Got JSON-RPC error response 00:12:29.909 response: 00:12:29.909 { 00:12:29.909 "code": -32602, 00:12:29.909 "message": "Invalid MN Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ\"R[" 00:12:29.909 }' 00:12:29.909 08:20:15 -- target/invalid.sh@59 -- # [[ request: 00:12:29.909 { 00:12:29.909 "nqn": "nqn.2016-06.io.spdk:cnode22351", 00:12:29.909 "model_number": "Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ\"R[", 00:12:29.909 "method": "nvmf_create_subsystem", 00:12:29.909 "req_id": 1 00:12:29.909 } 00:12:29.909 Got JSON-RPC error response 00:12:29.909 response: 00:12:29.909 { 00:12:29.909 "code": -32602, 00:12:29.909 "message": "Invalid MN Ad!+%Y9=F<1K5F:6GYl~A[12(3v_;H]7),G/MZ\"R[" 00:12:29.909 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:29.909 08:20:15 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:30.167 [2024-11-26 08:20:15.840918] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:30.167 08:20:15 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:30.425 08:20:16 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:30.425 08:20:16 -- target/invalid.sh@67 -- # echo '' 00:12:30.425 08:20:16 -- target/invalid.sh@67 -- # head -n 1 00:12:30.425 08:20:16 -- target/invalid.sh@67 -- # IP= 00:12:30.425 08:20:16 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:30.682 [2024-11-26 08:20:16.358678] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:30.682 08:20:16 -- target/invalid.sh@69 -- # out='request: 00:12:30.682 { 00:12:30.682 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.683 "listen_address": { 00:12:30.683 "trtype": "tcp", 00:12:30.683 "traddr": "", 00:12:30.683 "trsvcid": "4421" 00:12:30.683 }, 00:12:30.683 "method": "nvmf_subsystem_remove_listener", 00:12:30.683 "req_id": 1 00:12:30.683 } 00:12:30.683 Got JSON-RPC error response 00:12:30.683 response: 00:12:30.683 { 00:12:30.683 "code": -32602, 00:12:30.683 "message": "Invalid parameters" 00:12:30.683 }' 00:12:30.683 08:20:16 -- target/invalid.sh@70 -- # [[ request: 00:12:30.683 { 00:12:30.683 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.683 "listen_address": { 00:12:30.683 "trtype": "tcp", 00:12:30.683 "traddr": "", 00:12:30.683 "trsvcid": "4421" 00:12:30.683 }, 00:12:30.683 "method": "nvmf_subsystem_remove_listener", 00:12:30.683 "req_id": 1 00:12:30.683 } 00:12:30.683 Got JSON-RPC error response 00:12:30.683 response: 00:12:30.683 { 00:12:30.683 "code": -32602, 00:12:30.683 "message": "Invalid parameters" 00:12:30.683 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:30.683 08:20:16 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11089 -i 0 00:12:30.940 [2024-11-26 08:20:16.619546] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11089: invalid cntlid range [0-65519] 00:12:30.940 08:20:16 -- target/invalid.sh@73 -- # out='request: 00:12:30.940 { 00:12:30.940 "nqn": "nqn.2016-06.io.spdk:cnode11089", 00:12:30.940 "min_cntlid": 0, 00:12:30.940 "method": "nvmf_create_subsystem", 00:12:30.940 "req_id": 1 00:12:30.940 } 00:12:30.940 Got JSON-RPC error response 00:12:30.940 response: 00:12:30.940 { 00:12:30.940 "code": -32602, 00:12:30.940 "message": "Invalid cntlid range [0-65519]" 00:12:30.940 }' 00:12:30.940 08:20:16 -- target/invalid.sh@74 -- # [[ request: 00:12:30.940 { 00:12:30.940 "nqn": "nqn.2016-06.io.spdk:cnode11089", 00:12:30.940 "min_cntlid": 0, 00:12:30.940 "method": "nvmf_create_subsystem", 00:12:30.940 "req_id": 1 00:12:30.940 } 00:12:30.940 Got JSON-RPC error response 00:12:30.940 response: 00:12:30.940 { 00:12:30.940 "code": -32602, 00:12:30.940 "message": "Invalid cntlid range [0-65519]" 00:12:30.940 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.940 08:20:16 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode21926 -i 65520 00:12:31.199 [2024-11-26 08:20:16.872402] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21926: invalid cntlid range [65520-65519] 00:12:31.199 08:20:16 -- target/invalid.sh@75 -- # out='request: 00:12:31.199 { 00:12:31.199 "nqn": "nqn.2016-06.io.spdk:cnode21926", 00:12:31.199 "min_cntlid": 65520, 00:12:31.199 "method": "nvmf_create_subsystem", 00:12:31.199 "req_id": 1 00:12:31.199 } 00:12:31.199 Got JSON-RPC error response 00:12:31.199 response: 00:12:31.199 { 00:12:31.199 "code": -32602, 00:12:31.199 "message": "Invalid cntlid range [65520-65519]" 00:12:31.199 }' 00:12:31.199 08:20:16 -- target/invalid.sh@76 -- # [[ request: 00:12:31.199 { 00:12:31.199 "nqn": "nqn.2016-06.io.spdk:cnode21926", 00:12:31.199 "min_cntlid": 65520, 00:12:31.199 "method": "nvmf_create_subsystem", 00:12:31.199 "req_id": 1 00:12:31.199 } 00:12:31.199 Got JSON-RPC error response 00:12:31.199 response: 00:12:31.199 { 00:12:31.199 "code": -32602, 00:12:31.199 "message": "Invalid cntlid range [65520-65519]" 00:12:31.199 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.199 08:20:16 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15507 -I 0 00:12:31.457 [2024-11-26 08:20:17.113238] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15507: invalid cntlid range [1-0] 00:12:31.457 08:20:17 -- target/invalid.sh@77 -- # out='request: 00:12:31.457 { 00:12:31.457 "nqn": "nqn.2016-06.io.spdk:cnode15507", 00:12:31.457 "max_cntlid": 0, 00:12:31.457 "method": "nvmf_create_subsystem", 00:12:31.457 "req_id": 1 00:12:31.457 } 00:12:31.457 Got JSON-RPC error response 00:12:31.457 response: 00:12:31.457 { 00:12:31.457 "code": -32602, 00:12:31.457 "message": "Invalid cntlid range [1-0]" 00:12:31.457 }' 00:12:31.457 08:20:17 -- target/invalid.sh@78 -- # [[ request: 00:12:31.457 { 00:12:31.457 "nqn": "nqn.2016-06.io.spdk:cnode15507", 00:12:31.457 "max_cntlid": 0, 00:12:31.457 "method": "nvmf_create_subsystem", 00:12:31.457 "req_id": 1 00:12:31.457 } 00:12:31.457 Got JSON-RPC error response 00:12:31.457 response: 00:12:31.457 { 00:12:31.457 "code": -32602, 00:12:31.457 "message": "Invalid cntlid range [1-0]" 00:12:31.457 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.457 08:20:17 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6768 -I 65520 00:12:31.714 [2024-11-26 08:20:17.370123] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6768: invalid cntlid range [1-65520] 00:12:31.714 08:20:17 -- target/invalid.sh@79 -- # out='request: 00:12:31.714 { 00:12:31.714 "nqn": "nqn.2016-06.io.spdk:cnode6768", 00:12:31.715 "max_cntlid": 65520, 00:12:31.715 "method": "nvmf_create_subsystem", 00:12:31.715 "req_id": 1 00:12:31.715 } 00:12:31.715 Got JSON-RPC error response 00:12:31.715 response: 00:12:31.715 { 00:12:31.715 "code": -32602, 00:12:31.715 "message": "Invalid cntlid range [1-65520]" 00:12:31.715 }' 00:12:31.715 08:20:17 -- target/invalid.sh@80 -- # [[ request: 00:12:31.715 { 00:12:31.715 "nqn": "nqn.2016-06.io.spdk:cnode6768", 00:12:31.715 "max_cntlid": 65520, 00:12:31.715 "method": "nvmf_create_subsystem", 00:12:31.715 "req_id": 1 00:12:31.715 } 00:12:31.715 Got JSON-RPC error response 00:12:31.715 response: 00:12:31.715 { 00:12:31.715 "code": -32602, 00:12:31.715 "message": "Invalid cntlid range [1-65520]" 00:12:31.715 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.715 08:20:17 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9051 -i 6 -I 5 00:12:31.972 [2024-11-26 08:20:17.618991] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9051: invalid cntlid range [6-5] 00:12:31.972 08:20:17 -- target/invalid.sh@83 -- # out='request: 00:12:31.972 { 00:12:31.972 "nqn": "nqn.2016-06.io.spdk:cnode9051", 00:12:31.972 "min_cntlid": 6, 00:12:31.972 "max_cntlid": 5, 00:12:31.972 "method": "nvmf_create_subsystem", 00:12:31.972 "req_id": 1 00:12:31.972 } 00:12:31.972 Got JSON-RPC error response 00:12:31.972 response: 00:12:31.972 { 00:12:31.972 "code": -32602, 00:12:31.972 "message": "Invalid cntlid range [6-5]" 00:12:31.972 }' 00:12:31.972 08:20:17 -- target/invalid.sh@84 -- # [[ request: 00:12:31.972 { 00:12:31.972 "nqn": "nqn.2016-06.io.spdk:cnode9051", 00:12:31.972 "min_cntlid": 6, 00:12:31.972 "max_cntlid": 5, 00:12:31.972 "method": "nvmf_create_subsystem", 00:12:31.972 "req_id": 1 00:12:31.972 } 00:12:31.972 Got JSON-RPC error response 00:12:31.972 response: 00:12:31.972 { 00:12:31.972 "code": -32602, 00:12:31.972 "message": "Invalid cntlid range [6-5]" 00:12:31.972 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.972 08:20:17 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:31.972 08:20:17 -- target/invalid.sh@87 -- # out='request: 00:12:31.973 { 00:12:31.973 "name": "foobar", 00:12:31.973 "method": "nvmf_delete_target", 00:12:31.973 "req_id": 1 00:12:31.973 } 00:12:31.973 Got JSON-RPC error response 00:12:31.973 response: 00:12:31.973 { 00:12:31.973 "code": -32602, 00:12:31.973 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:31.973 }' 00:12:31.973 08:20:17 -- target/invalid.sh@88 -- # [[ request: 00:12:31.973 { 00:12:31.973 "name": "foobar", 00:12:31.973 "method": "nvmf_delete_target", 00:12:31.973 "req_id": 1 00:12:31.973 } 00:12:31.973 Got JSON-RPC error response 00:12:31.973 response: 00:12:31.973 { 00:12:31.973 "code": -32602, 00:12:31.973 "message": "The specified target doesn't exist, cannot delete it." 00:12:31.973 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:31.973 08:20:17 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:31.973 08:20:17 -- target/invalid.sh@91 -- # nvmftestfini 00:12:31.973 08:20:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:31.973 08:20:17 -- nvmf/common.sh@116 -- # sync 00:12:31.973 08:20:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:31.973 08:20:17 -- nvmf/common.sh@119 -- # set +e 00:12:31.973 08:20:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:31.973 08:20:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:31.973 rmmod nvme_tcp 00:12:31.973 rmmod nvme_fabrics 00:12:31.973 rmmod nvme_keyring 00:12:32.231 08:20:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:32.231 08:20:17 -- nvmf/common.sh@123 -- # set -e 00:12:32.231 08:20:17 -- nvmf/common.sh@124 -- # return 0 00:12:32.231 08:20:17 -- nvmf/common.sh@477 -- # '[' -n 911617 ']' 00:12:32.231 08:20:17 -- nvmf/common.sh@478 -- # killprocess 911617 00:12:32.231 08:20:17 -- common/autotest_common.sh@936 -- # '[' -z 911617 ']' 00:12:32.231 08:20:17 -- common/autotest_common.sh@940 -- # kill -0 911617 00:12:32.231 08:20:17 -- common/autotest_common.sh@941 -- # uname 00:12:32.231 08:20:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:32.231 08:20:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 911617 00:12:32.231 08:20:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:32.231 08:20:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:32.231 08:20:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 911617' 00:12:32.231 killing process with pid 911617 00:12:32.231 08:20:17 -- common/autotest_common.sh@955 -- # kill 911617 00:12:32.231 08:20:17 -- common/autotest_common.sh@960 -- # wait 911617 00:12:32.490 08:20:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:32.490 08:20:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:32.490 08:20:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:32.490 08:20:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:32.490 08:20:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:32.490 08:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:32.490 08:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:32.490 08:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.398 08:20:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:34.398 00:12:34.398 real 0m9.439s 00:12:34.398 user 0m23.030s 00:12:34.398 sys 0m2.425s 00:12:34.398 08:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:34.398 08:20:20 -- common/autotest_common.sh@10 -- # set +x 00:12:34.398 ************************************ 00:12:34.398 END TEST nvmf_invalid 00:12:34.398 ************************************ 00:12:34.398 08:20:20 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:34.398 08:20:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:34.398 08:20:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:34.398 08:20:20 -- common/autotest_common.sh@10 -- # set +x 00:12:34.398 ************************************ 00:12:34.398 START TEST nvmf_abort 00:12:34.398 ************************************ 00:12:34.398 08:20:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:34.658 * Looking for test storage... 00:12:34.658 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:34.658 08:20:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:34.658 08:20:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:34.658 08:20:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:34.658 08:20:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:34.658 08:20:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:34.658 08:20:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:34.658 08:20:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:34.658 08:20:20 -- scripts/common.sh@335 -- # IFS=.-: 00:12:34.658 08:20:20 -- scripts/common.sh@335 -- # read -ra ver1 00:12:34.658 08:20:20 -- scripts/common.sh@336 -- # IFS=.-: 00:12:34.658 08:20:20 -- scripts/common.sh@336 -- # read -ra ver2 00:12:34.658 08:20:20 -- scripts/common.sh@337 -- # local 'op=<' 00:12:34.658 08:20:20 -- scripts/common.sh@339 -- # ver1_l=2 00:12:34.658 08:20:20 -- scripts/common.sh@340 -- # ver2_l=1 00:12:34.658 08:20:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:34.658 08:20:20 -- scripts/common.sh@343 -- # case "$op" in 00:12:34.658 08:20:20 -- scripts/common.sh@344 -- # : 1 00:12:34.658 08:20:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:34.658 08:20:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:34.658 08:20:20 -- scripts/common.sh@364 -- # decimal 1 00:12:34.658 08:20:20 -- scripts/common.sh@352 -- # local d=1 00:12:34.658 08:20:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:34.658 08:20:20 -- scripts/common.sh@354 -- # echo 1 00:12:34.658 08:20:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:34.658 08:20:20 -- scripts/common.sh@365 -- # decimal 2 00:12:34.658 08:20:20 -- scripts/common.sh@352 -- # local d=2 00:12:34.658 08:20:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:34.658 08:20:20 -- scripts/common.sh@354 -- # echo 2 00:12:34.658 08:20:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:34.658 08:20:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:34.658 08:20:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:34.658 08:20:20 -- scripts/common.sh@367 -- # return 0 00:12:34.658 08:20:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:34.658 08:20:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:34.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.658 --rc genhtml_branch_coverage=1 00:12:34.658 --rc genhtml_function_coverage=1 00:12:34.658 --rc genhtml_legend=1 00:12:34.658 --rc geninfo_all_blocks=1 00:12:34.658 --rc geninfo_unexecuted_blocks=1 00:12:34.658 00:12:34.658 ' 00:12:34.658 08:20:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:34.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.658 --rc genhtml_branch_coverage=1 00:12:34.658 --rc genhtml_function_coverage=1 00:12:34.658 --rc genhtml_legend=1 00:12:34.658 --rc geninfo_all_blocks=1 00:12:34.658 --rc geninfo_unexecuted_blocks=1 00:12:34.658 00:12:34.658 ' 00:12:34.658 08:20:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:34.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.658 --rc genhtml_branch_coverage=1 00:12:34.658 --rc genhtml_function_coverage=1 00:12:34.658 --rc genhtml_legend=1 00:12:34.658 --rc geninfo_all_blocks=1 00:12:34.658 --rc geninfo_unexecuted_blocks=1 00:12:34.658 00:12:34.658 ' 00:12:34.658 08:20:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:34.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.658 --rc genhtml_branch_coverage=1 00:12:34.658 --rc genhtml_function_coverage=1 00:12:34.658 --rc genhtml_legend=1 00:12:34.658 --rc geninfo_all_blocks=1 00:12:34.658 --rc geninfo_unexecuted_blocks=1 00:12:34.658 00:12:34.658 ' 00:12:34.658 08:20:20 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:34.658 08:20:20 -- nvmf/common.sh@7 -- # uname -s 00:12:34.658 08:20:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:34.658 08:20:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:34.658 08:20:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:34.658 08:20:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:34.658 08:20:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:34.658 08:20:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:34.658 08:20:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:34.658 08:20:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:34.658 08:20:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:34.658 08:20:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:34.658 08:20:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.658 08:20:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.658 08:20:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:34.658 08:20:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:34.658 08:20:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:34.658 08:20:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:34.658 08:20:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:34.658 08:20:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:34.658 08:20:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:34.658 08:20:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.659 08:20:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.659 08:20:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.659 08:20:20 -- paths/export.sh@5 -- # export PATH 00:12:34.659 08:20:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.659 08:20:20 -- nvmf/common.sh@46 -- # : 0 00:12:34.659 08:20:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:34.659 08:20:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:34.659 08:20:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:34.659 08:20:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:34.659 08:20:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:34.659 08:20:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:34.659 08:20:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:34.659 08:20:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:34.659 08:20:20 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:34.659 08:20:20 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:34.659 08:20:20 -- target/abort.sh@14 -- # nvmftestinit 00:12:34.659 08:20:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:34.659 08:20:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:34.659 08:20:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:34.659 08:20:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:34.659 08:20:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:34.659 08:20:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:34.659 08:20:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:34.659 08:20:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.659 08:20:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:34.659 08:20:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:34.659 08:20:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:34.659 08:20:20 -- common/autotest_common.sh@10 -- # set +x 00:12:37.191 08:20:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:37.191 08:20:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:37.191 08:20:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:37.191 08:20:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:37.191 08:20:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:37.191 08:20:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:37.191 08:20:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:37.191 08:20:22 -- nvmf/common.sh@294 -- # net_devs=() 00:12:37.191 08:20:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:37.191 08:20:22 -- nvmf/common.sh@295 -- # e810=() 00:12:37.191 08:20:22 -- nvmf/common.sh@295 -- # local -ga e810 00:12:37.191 08:20:22 -- nvmf/common.sh@296 -- # x722=() 00:12:37.191 08:20:22 -- nvmf/common.sh@296 -- # local -ga x722 00:12:37.191 08:20:22 -- nvmf/common.sh@297 -- # mlx=() 00:12:37.191 08:20:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:37.191 08:20:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:37.191 08:20:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:37.192 08:20:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:37.192 08:20:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:37.192 08:20:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.192 08:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:37.192 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:37.192 08:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.192 08:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:37.192 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:37.192 08:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.192 08:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.192 08:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.192 08:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:37.192 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:37.192 08:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.192 08:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.192 08:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.192 08:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:37.192 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:37.192 08:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:37.192 08:20:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:37.192 08:20:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:37.192 08:20:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:37.192 08:20:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:37.192 08:20:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:37.192 08:20:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:37.192 08:20:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:37.192 08:20:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:37.192 08:20:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:37.192 08:20:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:37.192 08:20:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:37.192 08:20:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:37.192 08:20:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:37.192 08:20:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:37.192 08:20:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:37.192 08:20:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:37.192 08:20:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:37.192 08:20:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:37.192 08:20:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:37.192 08:20:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:37.192 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:37.192 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:12:37.192 00:12:37.192 --- 10.0.0.2 ping statistics --- 00:12:37.192 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.192 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:12:37.192 08:20:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:37.192 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:37.192 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:12:37.192 00:12:37.192 --- 10.0.0.1 ping statistics --- 00:12:37.192 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.192 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:12:37.192 08:20:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:37.192 08:20:22 -- nvmf/common.sh@410 -- # return 0 00:12:37.192 08:20:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:37.192 08:20:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:37.192 08:20:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:37.192 08:20:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:37.192 08:20:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:37.192 08:20:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:37.192 08:20:22 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:37.192 08:20:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:37.192 08:20:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:37.192 08:20:22 -- common/autotest_common.sh@10 -- # set +x 00:12:37.192 08:20:22 -- nvmf/common.sh@469 -- # nvmfpid=914418 00:12:37.192 08:20:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:37.192 08:20:22 -- nvmf/common.sh@470 -- # waitforlisten 914418 00:12:37.192 08:20:22 -- common/autotest_common.sh@829 -- # '[' -z 914418 ']' 00:12:37.192 08:20:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.192 08:20:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:37.192 08:20:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.192 08:20:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:37.192 08:20:22 -- common/autotest_common.sh@10 -- # set +x 00:12:37.192 [2024-11-26 08:20:22.722261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:37.192 [2024-11-26 08:20:22.722334] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:37.192 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.192 [2024-11-26 08:20:22.790891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:37.192 [2024-11-26 08:20:22.910260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:37.192 [2024-11-26 08:20:22.910414] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:37.192 [2024-11-26 08:20:22.910434] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:37.192 [2024-11-26 08:20:22.910448] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:37.193 [2024-11-26 08:20:22.910696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:37.193 [2024-11-26 08:20:22.910753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:37.193 [2024-11-26 08:20:22.910758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:38.127 08:20:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:38.127 08:20:23 -- common/autotest_common.sh@862 -- # return 0 00:12:38.127 08:20:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:38.127 08:20:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 08:20:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.127 08:20:23 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 [2024-11-26 08:20:23.717780] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 Malloc0 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 Delay0 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 [2024-11-26 08:20:23.790420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:38.127 08:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.127 08:20:23 -- common/autotest_common.sh@10 -- # set +x 00:12:38.127 08:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.127 08:20:23 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:38.127 EAL: No free 2048 kB hugepages reported on node 1 00:12:38.128 [2024-11-26 08:20:23.927830] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:40.657 Initializing NVMe Controllers 00:12:40.657 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:40.657 controller IO queue size 128 less than required 00:12:40.657 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:40.657 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:40.657 Initialization complete. Launching workers. 00:12:40.657 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33299 00:12:40.657 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33360, failed to submit 62 00:12:40.657 success 33299, unsuccess 61, failed 0 00:12:40.657 08:20:25 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:40.657 08:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.657 08:20:25 -- common/autotest_common.sh@10 -- # set +x 00:12:40.657 08:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.657 08:20:25 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:40.657 08:20:25 -- target/abort.sh@38 -- # nvmftestfini 00:12:40.657 08:20:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:40.657 08:20:25 -- nvmf/common.sh@116 -- # sync 00:12:40.657 08:20:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:40.657 08:20:25 -- nvmf/common.sh@119 -- # set +e 00:12:40.657 08:20:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:40.657 08:20:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:40.657 rmmod nvme_tcp 00:12:40.657 rmmod nvme_fabrics 00:12:40.657 rmmod nvme_keyring 00:12:40.657 08:20:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:40.657 08:20:26 -- nvmf/common.sh@123 -- # set -e 00:12:40.657 08:20:26 -- nvmf/common.sh@124 -- # return 0 00:12:40.657 08:20:26 -- nvmf/common.sh@477 -- # '[' -n 914418 ']' 00:12:40.657 08:20:26 -- nvmf/common.sh@478 -- # killprocess 914418 00:12:40.657 08:20:26 -- common/autotest_common.sh@936 -- # '[' -z 914418 ']' 00:12:40.657 08:20:26 -- common/autotest_common.sh@940 -- # kill -0 914418 00:12:40.657 08:20:26 -- common/autotest_common.sh@941 -- # uname 00:12:40.657 08:20:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:40.657 08:20:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 914418 00:12:40.657 08:20:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:40.657 08:20:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:40.657 08:20:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 914418' 00:12:40.657 killing process with pid 914418 00:12:40.657 08:20:26 -- common/autotest_common.sh@955 -- # kill 914418 00:12:40.657 08:20:26 -- common/autotest_common.sh@960 -- # wait 914418 00:12:40.657 08:20:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:40.657 08:20:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:40.657 08:20:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:40.657 08:20:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:40.657 08:20:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:40.657 08:20:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.657 08:20:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.657 08:20:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:43.193 08:20:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:43.193 00:12:43.193 real 0m8.213s 00:12:43.193 user 0m12.906s 00:12:43.193 sys 0m2.644s 00:12:43.193 08:20:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:43.193 08:20:28 -- common/autotest_common.sh@10 -- # set +x 00:12:43.193 ************************************ 00:12:43.193 END TEST nvmf_abort 00:12:43.193 ************************************ 00:12:43.193 08:20:28 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:43.193 08:20:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:43.193 08:20:28 -- common/autotest_common.sh@10 -- # set +x 00:12:43.193 ************************************ 00:12:43.193 START TEST nvmf_ns_hotplug_stress 00:12:43.193 ************************************ 00:12:43.193 08:20:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:43.193 * Looking for test storage... 00:12:43.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:43.193 08:20:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:43.193 08:20:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:43.193 08:20:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:43.193 08:20:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:43.193 08:20:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:43.193 08:20:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:43.193 08:20:28 -- scripts/common.sh@335 -- # IFS=.-: 00:12:43.193 08:20:28 -- scripts/common.sh@335 -- # read -ra ver1 00:12:43.193 08:20:28 -- scripts/common.sh@336 -- # IFS=.-: 00:12:43.193 08:20:28 -- scripts/common.sh@336 -- # read -ra ver2 00:12:43.193 08:20:28 -- scripts/common.sh@337 -- # local 'op=<' 00:12:43.193 08:20:28 -- scripts/common.sh@339 -- # ver1_l=2 00:12:43.193 08:20:28 -- scripts/common.sh@340 -- # ver2_l=1 00:12:43.193 08:20:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:43.193 08:20:28 -- scripts/common.sh@343 -- # case "$op" in 00:12:43.193 08:20:28 -- scripts/common.sh@344 -- # : 1 00:12:43.193 08:20:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:43.193 08:20:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:43.193 08:20:28 -- scripts/common.sh@364 -- # decimal 1 00:12:43.193 08:20:28 -- scripts/common.sh@352 -- # local d=1 00:12:43.193 08:20:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:43.193 08:20:28 -- scripts/common.sh@354 -- # echo 1 00:12:43.193 08:20:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:43.193 08:20:28 -- scripts/common.sh@365 -- # decimal 2 00:12:43.193 08:20:28 -- scripts/common.sh@352 -- # local d=2 00:12:43.193 08:20:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:43.193 08:20:28 -- scripts/common.sh@354 -- # echo 2 00:12:43.193 08:20:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:43.193 08:20:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:43.193 08:20:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:43.193 08:20:28 -- scripts/common.sh@367 -- # return 0 00:12:43.193 08:20:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:43.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.193 --rc genhtml_branch_coverage=1 00:12:43.193 --rc genhtml_function_coverage=1 00:12:43.193 --rc genhtml_legend=1 00:12:43.193 --rc geninfo_all_blocks=1 00:12:43.193 --rc geninfo_unexecuted_blocks=1 00:12:43.193 00:12:43.193 ' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:43.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.193 --rc genhtml_branch_coverage=1 00:12:43.193 --rc genhtml_function_coverage=1 00:12:43.193 --rc genhtml_legend=1 00:12:43.193 --rc geninfo_all_blocks=1 00:12:43.193 --rc geninfo_unexecuted_blocks=1 00:12:43.193 00:12:43.193 ' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:43.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.193 --rc genhtml_branch_coverage=1 00:12:43.193 --rc genhtml_function_coverage=1 00:12:43.193 --rc genhtml_legend=1 00:12:43.193 --rc geninfo_all_blocks=1 00:12:43.193 --rc geninfo_unexecuted_blocks=1 00:12:43.193 00:12:43.193 ' 00:12:43.193 08:20:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:43.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.193 --rc genhtml_branch_coverage=1 00:12:43.193 --rc genhtml_function_coverage=1 00:12:43.193 --rc genhtml_legend=1 00:12:43.193 --rc geninfo_all_blocks=1 00:12:43.193 --rc geninfo_unexecuted_blocks=1 00:12:43.193 00:12:43.193 ' 00:12:43.193 08:20:28 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:43.193 08:20:28 -- nvmf/common.sh@7 -- # uname -s 00:12:43.193 08:20:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:43.193 08:20:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:43.193 08:20:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:43.193 08:20:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:43.193 08:20:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:43.193 08:20:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:43.193 08:20:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:43.193 08:20:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:43.193 08:20:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:43.193 08:20:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:43.193 08:20:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:43.193 08:20:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:43.193 08:20:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:43.193 08:20:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:43.193 08:20:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:43.193 08:20:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:43.193 08:20:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:43.193 08:20:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:43.193 08:20:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:43.193 08:20:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.193 08:20:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.193 08:20:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.193 08:20:28 -- paths/export.sh@5 -- # export PATH 00:12:43.193 08:20:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.193 08:20:28 -- nvmf/common.sh@46 -- # : 0 00:12:43.193 08:20:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:43.193 08:20:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:43.193 08:20:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:43.193 08:20:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:43.193 08:20:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:43.193 08:20:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:43.193 08:20:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:43.193 08:20:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:43.193 08:20:28 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:43.193 08:20:28 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:43.193 08:20:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:43.193 08:20:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:43.193 08:20:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:43.193 08:20:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:43.193 08:20:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:43.193 08:20:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:43.193 08:20:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:43.193 08:20:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:43.193 08:20:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:43.193 08:20:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:43.194 08:20:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:43.194 08:20:28 -- common/autotest_common.sh@10 -- # set +x 00:12:45.098 08:20:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:45.098 08:20:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:45.098 08:20:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:45.098 08:20:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:45.098 08:20:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:45.098 08:20:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:45.098 08:20:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:45.098 08:20:30 -- nvmf/common.sh@294 -- # net_devs=() 00:12:45.098 08:20:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:45.098 08:20:30 -- nvmf/common.sh@295 -- # e810=() 00:12:45.098 08:20:30 -- nvmf/common.sh@295 -- # local -ga e810 00:12:45.098 08:20:30 -- nvmf/common.sh@296 -- # x722=() 00:12:45.098 08:20:30 -- nvmf/common.sh@296 -- # local -ga x722 00:12:45.098 08:20:30 -- nvmf/common.sh@297 -- # mlx=() 00:12:45.098 08:20:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:45.098 08:20:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:45.098 08:20:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:45.098 08:20:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:45.098 08:20:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:45.098 08:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:45.098 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:45.098 08:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:45.098 08:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:45.098 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:45.098 08:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:45.098 08:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:45.098 08:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:45.098 08:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:45.098 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:45.098 08:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:45.098 08:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:45.098 08:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:45.098 08:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:45.098 08:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:45.098 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:45.098 08:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:45.098 08:20:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:45.098 08:20:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:45.098 08:20:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:45.098 08:20:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:45.098 08:20:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:45.098 08:20:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:45.098 08:20:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:45.098 08:20:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:45.098 08:20:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:45.098 08:20:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:45.098 08:20:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:45.098 08:20:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:45.098 08:20:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:45.098 08:20:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:45.098 08:20:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:45.098 08:20:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:45.098 08:20:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:45.098 08:20:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:45.098 08:20:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:45.098 08:20:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:45.098 08:20:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:45.098 08:20:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:45.098 08:20:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:45.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:45.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:12:45.098 00:12:45.098 --- 10.0.0.2 ping statistics --- 00:12:45.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:45.099 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:12:45.099 08:20:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:45.099 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:45.099 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:12:45.099 00:12:45.099 --- 10.0.0.1 ping statistics --- 00:12:45.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:45.099 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:12:45.099 08:20:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:45.099 08:20:30 -- nvmf/common.sh@410 -- # return 0 00:12:45.099 08:20:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:45.099 08:20:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:45.099 08:20:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:45.099 08:20:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:45.099 08:20:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:45.099 08:20:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:45.099 08:20:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:45.358 08:20:30 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:45.358 08:20:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:45.358 08:20:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:45.358 08:20:30 -- common/autotest_common.sh@10 -- # set +x 00:12:45.358 08:20:30 -- nvmf/common.sh@469 -- # nvmfpid=916808 00:12:45.358 08:20:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:45.358 08:20:30 -- nvmf/common.sh@470 -- # waitforlisten 916808 00:12:45.358 08:20:30 -- common/autotest_common.sh@829 -- # '[' -z 916808 ']' 00:12:45.358 08:20:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:45.358 08:20:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:45.358 08:20:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:45.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:45.358 08:20:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:45.358 08:20:30 -- common/autotest_common.sh@10 -- # set +x 00:12:45.358 [2024-11-26 08:20:31.021607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:45.358 [2024-11-26 08:20:31.021717] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:45.358 EAL: No free 2048 kB hugepages reported on node 1 00:12:45.358 [2024-11-26 08:20:31.090242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:45.358 [2024-11-26 08:20:31.212931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:45.358 [2024-11-26 08:20:31.213097] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:45.358 [2024-11-26 08:20:31.213116] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:45.617 [2024-11-26 08:20:31.213131] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:45.617 [2024-11-26 08:20:31.213217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:45.617 [2024-11-26 08:20:31.214709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:45.617 [2024-11-26 08:20:31.214722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:46.550 08:20:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:46.550 08:20:32 -- common/autotest_common.sh@862 -- # return 0 00:12:46.550 08:20:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:46.550 08:20:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:46.550 08:20:32 -- common/autotest_common.sh@10 -- # set +x 00:12:46.550 08:20:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:46.550 08:20:32 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:46.550 08:20:32 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:46.550 [2024-11-26 08:20:32.297262] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:46.550 08:20:32 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:46.808 08:20:32 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:47.066 [2024-11-26 08:20:32.808214] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:47.066 08:20:32 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:47.324 08:20:33 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:47.583 Malloc0 00:12:47.583 08:20:33 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:47.842 Delay0 00:12:47.842 08:20:33 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.100 08:20:33 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:48.358 NULL1 00:12:48.358 08:20:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:48.616 08:20:34 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=917242 00:12:48.616 08:20:34 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:48.616 08:20:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:48.616 08:20:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.616 EAL: No free 2048 kB hugepages reported on node 1 00:12:49.992 Read completed with error (sct=0, sc=11) 00:12:49.992 08:20:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.992 08:20:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:49.992 08:20:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:50.251 true 00:12:50.251 08:20:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:50.251 08:20:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.189 08:20:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.447 08:20:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:51.447 08:20:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:51.705 true 00:12:51.705 08:20:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:51.705 08:20:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.963 08:20:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.220 08:20:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:52.220 08:20:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:52.478 true 00:12:52.478 08:20:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:52.478 08:20:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.736 08:20:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.994 08:20:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:52.994 08:20:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:53.253 true 00:12:53.253 08:20:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:53.253 08:20:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:54.190 08:20:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:54.448 08:20:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:54.448 08:20:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:54.706 true 00:12:54.706 08:20:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:54.706 08:20:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.964 08:20:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.222 08:20:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:55.222 08:20:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:55.481 true 00:12:55.481 08:20:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:55.481 08:20:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.048 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.309 08:20:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.569 08:20:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:56.569 08:20:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:56.569 true 00:12:56.569 08:20:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:56.569 08:20:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.138 08:20:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.138 08:20:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:57.138 08:20:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:57.427 true 00:12:57.427 08:20:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:57.428 08:20:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.399 08:20:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.657 08:20:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:58.657 08:20:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:58.915 true 00:12:58.915 08:20:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:58.915 08:20:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.173 08:20:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.431 08:20:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:59.431 08:20:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:59.690 true 00:12:59.690 08:20:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:12:59.690 08:20:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.948 08:20:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.207 08:20:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:00.207 08:20:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:00.466 true 00:13:00.466 08:20:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:00.466 08:20:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.403 08:20:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.662 08:20:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:01.662 08:20:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:01.919 true 00:13:01.919 08:20:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:01.919 08:20:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.177 08:20:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.435 08:20:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:02.435 08:20:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:02.694 true 00:13:02.694 08:20:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:02.694 08:20:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.952 08:20:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.210 08:20:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:03.210 08:20:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:03.468 true 00:13:03.468 08:20:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:03.468 08:20:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.401 08:20:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.401 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.658 08:20:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:04.658 08:20:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:04.916 true 00:13:04.916 08:20:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:04.916 08:20:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.174 08:20:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.432 08:20:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:05.432 08:20:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:05.690 true 00:13:05.690 08:20:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:05.690 08:20:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.629 08:20:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.629 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.887 08:20:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:06.887 08:20:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:07.145 true 00:13:07.145 08:20:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:07.145 08:20:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.402 08:20:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.660 08:20:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:07.660 08:20:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:07.918 true 00:13:07.918 08:20:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:07.918 08:20:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.854 08:20:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.854 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.854 08:20:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:08.854 08:20:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:09.113 true 00:13:09.113 08:20:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:09.113 08:20:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.371 08:20:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.629 08:20:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:09.629 08:20:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:09.886 true 00:13:09.886 08:20:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:09.886 08:20:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.824 08:20:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.082 08:20:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:11.082 08:20:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:11.340 true 00:13:11.341 08:20:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:11.341 08:20:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.598 08:20:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.857 08:20:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:11.857 08:20:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:11.857 true 00:13:11.857 08:20:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:11.857 08:20:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.115 08:20:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.681 08:20:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:12.681 08:20:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:12.681 true 00:13:12.681 08:20:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:12.681 08:20:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.108 08:20:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.108 08:20:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:14.108 08:20:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:14.365 true 00:13:14.365 08:21:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:14.365 08:21:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.622 08:21:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.880 08:21:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:14.880 08:21:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:15.137 true 00:13:15.137 08:21:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:15.137 08:21:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.071 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.071 08:21:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.071 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.071 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.329 08:21:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:16.329 08:21:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:16.586 true 00:13:16.586 08:21:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:16.586 08:21:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.844 08:21:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.102 08:21:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:17.102 08:21:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:17.359 true 00:13:17.359 08:21:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:17.359 08:21:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.292 08:21:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.292 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.549 08:21:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:18.549 08:21:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:18.549 true 00:13:18.549 08:21:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:18.549 08:21:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.807 Initializing NVMe Controllers 00:13:18.807 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:18.807 Controller IO queue size 128, less than required. 00:13:18.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:18.807 Controller IO queue size 128, less than required. 00:13:18.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:18.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:18.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:18.807 Initialization complete. Launching workers. 00:13:18.807 ======================================================== 00:13:18.807 Latency(us) 00:13:18.807 Device Information : IOPS MiB/s Average min max 00:13:18.807 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 659.82 0.32 93498.63 2654.55 1094314.23 00:13:18.807 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10961.15 5.35 11677.23 1739.46 365017.35 00:13:18.807 ======================================================== 00:13:18.807 Total : 11620.96 5.67 16322.91 1739.46 1094314.23 00:13:18.807 00:13:18.807 08:21:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.064 08:21:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:19.064 08:21:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:19.322 true 00:13:19.322 08:21:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 917242 00:13:19.322 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (917242) - No such process 00:13:19.322 08:21:05 -- target/ns_hotplug_stress.sh@53 -- # wait 917242 00:13:19.322 08:21:05 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.579 08:21:05 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.836 08:21:05 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:19.836 08:21:05 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:19.836 08:21:05 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:19.836 08:21:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.836 08:21:05 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:20.094 null0 00:13:20.094 08:21:05 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.094 08:21:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.094 08:21:05 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:20.351 null1 00:13:20.352 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.352 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.352 08:21:06 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:20.610 null2 00:13:20.610 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.610 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.610 08:21:06 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:20.867 null3 00:13:20.867 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.867 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.867 08:21:06 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:21.125 null4 00:13:21.125 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.125 08:21:06 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.125 08:21:06 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:21.382 null5 00:13:21.382 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.382 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.382 08:21:07 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:21.639 null6 00:13:21.639 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.639 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.639 08:21:07 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:21.897 null7 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.897 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@66 -- # wait 921784 921786 921788 921791 921795 921797 921799 921803 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.898 08:21:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.464 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.465 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.465 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.465 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.723 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.723 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.723 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.723 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.723 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.981 08:21:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.240 08:21:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.497 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.755 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.013 08:21:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.271 08:21:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.529 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.787 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.788 08:21:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.046 08:21:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.304 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.562 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.820 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.821 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.078 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.078 08:21:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.078 08:21:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.078 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:26.336 08:21:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.630 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.913 08:21:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.171 08:21:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:27.429 08:21:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.687 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:27.688 08:21:13 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:27.688 08:21:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:27.688 08:21:13 -- nvmf/common.sh@116 -- # sync 00:13:27.688 08:21:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:27.688 08:21:13 -- nvmf/common.sh@119 -- # set +e 00:13:27.688 08:21:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:27.688 08:21:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:27.688 rmmod nvme_tcp 00:13:27.688 rmmod nvme_fabrics 00:13:27.688 rmmod nvme_keyring 00:13:27.688 08:21:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:27.688 08:21:13 -- nvmf/common.sh@123 -- # set -e 00:13:27.688 08:21:13 -- nvmf/common.sh@124 -- # return 0 00:13:27.688 08:21:13 -- nvmf/common.sh@477 -- # '[' -n 916808 ']' 00:13:27.688 08:21:13 -- nvmf/common.sh@478 -- # killprocess 916808 00:13:27.688 08:21:13 -- common/autotest_common.sh@936 -- # '[' -z 916808 ']' 00:13:27.688 08:21:13 -- common/autotest_common.sh@940 -- # kill -0 916808 00:13:27.688 08:21:13 -- common/autotest_common.sh@941 -- # uname 00:13:27.688 08:21:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:27.688 08:21:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 916808 00:13:27.688 08:21:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:27.688 08:21:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:27.688 08:21:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 916808' 00:13:27.688 killing process with pid 916808 00:13:27.688 08:21:13 -- common/autotest_common.sh@955 -- # kill 916808 00:13:27.688 08:21:13 -- common/autotest_common.sh@960 -- # wait 916808 00:13:27.945 08:21:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:27.945 08:21:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:27.945 08:21:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:27.945 08:21:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:27.945 08:21:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:27.945 08:21:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.945 08:21:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.945 08:21:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.477 08:21:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:30.477 00:13:30.477 real 0m47.321s 00:13:30.477 user 3m32.529s 00:13:30.477 sys 0m16.516s 00:13:30.477 08:21:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:30.477 08:21:15 -- common/autotest_common.sh@10 -- # set +x 00:13:30.477 ************************************ 00:13:30.477 END TEST nvmf_ns_hotplug_stress 00:13:30.477 ************************************ 00:13:30.477 08:21:15 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.477 08:21:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:30.477 08:21:15 -- common/autotest_common.sh@10 -- # set +x 00:13:30.477 ************************************ 00:13:30.477 START TEST nvmf_connect_stress 00:13:30.477 ************************************ 00:13:30.477 08:21:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.477 * Looking for test storage... 00:13:30.477 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:30.477 08:21:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:30.477 08:21:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:30.477 08:21:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:30.477 08:21:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:30.477 08:21:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:30.477 08:21:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:30.477 08:21:15 -- scripts/common.sh@335 -- # IFS=.-: 00:13:30.477 08:21:15 -- scripts/common.sh@335 -- # read -ra ver1 00:13:30.477 08:21:15 -- scripts/common.sh@336 -- # IFS=.-: 00:13:30.477 08:21:15 -- scripts/common.sh@336 -- # read -ra ver2 00:13:30.477 08:21:15 -- scripts/common.sh@337 -- # local 'op=<' 00:13:30.477 08:21:15 -- scripts/common.sh@339 -- # ver1_l=2 00:13:30.477 08:21:15 -- scripts/common.sh@340 -- # ver2_l=1 00:13:30.477 08:21:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:30.477 08:21:15 -- scripts/common.sh@343 -- # case "$op" in 00:13:30.477 08:21:15 -- scripts/common.sh@344 -- # : 1 00:13:30.477 08:21:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:30.477 08:21:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:30.477 08:21:15 -- scripts/common.sh@364 -- # decimal 1 00:13:30.477 08:21:15 -- scripts/common.sh@352 -- # local d=1 00:13:30.477 08:21:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:30.477 08:21:15 -- scripts/common.sh@354 -- # echo 1 00:13:30.477 08:21:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:30.477 08:21:15 -- scripts/common.sh@365 -- # decimal 2 00:13:30.477 08:21:15 -- scripts/common.sh@352 -- # local d=2 00:13:30.477 08:21:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:30.477 08:21:15 -- scripts/common.sh@354 -- # echo 2 00:13:30.477 08:21:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:30.477 08:21:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:30.477 08:21:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:30.477 08:21:15 -- scripts/common.sh@367 -- # return 0 00:13:30.477 08:21:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:30.477 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.477 --rc genhtml_branch_coverage=1 00:13:30.477 --rc genhtml_function_coverage=1 00:13:30.477 --rc genhtml_legend=1 00:13:30.477 --rc geninfo_all_blocks=1 00:13:30.477 --rc geninfo_unexecuted_blocks=1 00:13:30.477 00:13:30.477 ' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:30.477 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.477 --rc genhtml_branch_coverage=1 00:13:30.477 --rc genhtml_function_coverage=1 00:13:30.477 --rc genhtml_legend=1 00:13:30.477 --rc geninfo_all_blocks=1 00:13:30.477 --rc geninfo_unexecuted_blocks=1 00:13:30.477 00:13:30.477 ' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:30.477 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.477 --rc genhtml_branch_coverage=1 00:13:30.477 --rc genhtml_function_coverage=1 00:13:30.477 --rc genhtml_legend=1 00:13:30.477 --rc geninfo_all_blocks=1 00:13:30.477 --rc geninfo_unexecuted_blocks=1 00:13:30.477 00:13:30.477 ' 00:13:30.477 08:21:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:30.477 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.477 --rc genhtml_branch_coverage=1 00:13:30.477 --rc genhtml_function_coverage=1 00:13:30.477 --rc genhtml_legend=1 00:13:30.477 --rc geninfo_all_blocks=1 00:13:30.477 --rc geninfo_unexecuted_blocks=1 00:13:30.477 00:13:30.477 ' 00:13:30.477 08:21:15 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:30.477 08:21:15 -- nvmf/common.sh@7 -- # uname -s 00:13:30.477 08:21:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:30.477 08:21:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:30.477 08:21:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:30.477 08:21:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:30.477 08:21:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:30.478 08:21:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:30.478 08:21:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:30.478 08:21:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:30.478 08:21:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:30.478 08:21:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:30.478 08:21:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.478 08:21:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.478 08:21:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:30.478 08:21:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:30.478 08:21:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:30.478 08:21:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:30.478 08:21:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:30.478 08:21:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:30.478 08:21:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:30.478 08:21:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.478 08:21:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.478 08:21:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.478 08:21:15 -- paths/export.sh@5 -- # export PATH 00:13:30.478 08:21:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.478 08:21:15 -- nvmf/common.sh@46 -- # : 0 00:13:30.478 08:21:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:30.478 08:21:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:30.478 08:21:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:30.478 08:21:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:30.478 08:21:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:30.478 08:21:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:30.478 08:21:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:30.478 08:21:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:30.478 08:21:15 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:30.478 08:21:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:30.478 08:21:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:30.478 08:21:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:30.478 08:21:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:30.478 08:21:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:30.478 08:21:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.478 08:21:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.478 08:21:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.478 08:21:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:30.478 08:21:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:30.478 08:21:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:30.478 08:21:15 -- common/autotest_common.sh@10 -- # set +x 00:13:32.379 08:21:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:32.379 08:21:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:32.379 08:21:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:32.379 08:21:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:32.379 08:21:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:32.379 08:21:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:32.379 08:21:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:32.379 08:21:17 -- nvmf/common.sh@294 -- # net_devs=() 00:13:32.379 08:21:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:32.379 08:21:17 -- nvmf/common.sh@295 -- # e810=() 00:13:32.379 08:21:17 -- nvmf/common.sh@295 -- # local -ga e810 00:13:32.379 08:21:17 -- nvmf/common.sh@296 -- # x722=() 00:13:32.379 08:21:17 -- nvmf/common.sh@296 -- # local -ga x722 00:13:32.379 08:21:17 -- nvmf/common.sh@297 -- # mlx=() 00:13:32.379 08:21:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:32.379 08:21:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:32.379 08:21:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:32.379 08:21:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:32.379 08:21:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:32.379 08:21:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.379 08:21:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:32.379 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:32.379 08:21:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.379 08:21:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:32.379 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:32.379 08:21:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:32.379 08:21:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:32.379 08:21:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.379 08:21:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.379 08:21:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.379 08:21:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.379 08:21:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:32.379 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:32.380 08:21:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.380 08:21:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.380 08:21:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.380 08:21:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.380 08:21:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.380 08:21:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:32.380 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:32.380 08:21:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.380 08:21:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:32.380 08:21:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:32.380 08:21:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:32.380 08:21:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:32.380 08:21:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:32.380 08:21:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:32.380 08:21:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:32.380 08:21:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:32.380 08:21:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:32.380 08:21:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:32.380 08:21:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:32.380 08:21:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:32.380 08:21:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:32.380 08:21:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:32.380 08:21:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:32.380 08:21:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:32.380 08:21:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:32.380 08:21:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:32.380 08:21:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:32.380 08:21:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:32.380 08:21:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:32.380 08:21:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:32.380 08:21:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:32.380 08:21:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:32.380 08:21:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:32.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:32.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:13:32.380 00:13:32.380 --- 10.0.0.2 ping statistics --- 00:13:32.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.380 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:13:32.380 08:21:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:32.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:32.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:13:32.380 00:13:32.380 --- 10.0.0.1 ping statistics --- 00:13:32.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.380 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:13:32.380 08:21:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:32.380 08:21:18 -- nvmf/common.sh@410 -- # return 0 00:13:32.380 08:21:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:32.380 08:21:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:32.380 08:21:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:32.380 08:21:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:32.380 08:21:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:32.380 08:21:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:32.380 08:21:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:32.380 08:21:18 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:32.380 08:21:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:32.380 08:21:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:32.380 08:21:18 -- common/autotest_common.sh@10 -- # set +x 00:13:32.380 08:21:18 -- nvmf/common.sh@469 -- # nvmfpid=924854 00:13:32.380 08:21:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:32.380 08:21:18 -- nvmf/common.sh@470 -- # waitforlisten 924854 00:13:32.380 08:21:18 -- common/autotest_common.sh@829 -- # '[' -z 924854 ']' 00:13:32.380 08:21:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:32.380 08:21:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:32.380 08:21:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:32.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:32.380 08:21:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:32.380 08:21:18 -- common/autotest_common.sh@10 -- # set +x 00:13:32.380 [2024-11-26 08:21:18.204202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:32.380 [2024-11-26 08:21:18.204279] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:32.639 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.639 [2024-11-26 08:21:18.268495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:32.639 [2024-11-26 08:21:18.376313] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:32.639 [2024-11-26 08:21:18.376457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:32.639 [2024-11-26 08:21:18.376474] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:32.639 [2024-11-26 08:21:18.376487] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:32.639 [2024-11-26 08:21:18.376584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:32.639 [2024-11-26 08:21:18.376645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:32.639 [2024-11-26 08:21:18.376648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:33.571 08:21:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:33.571 08:21:19 -- common/autotest_common.sh@862 -- # return 0 00:13:33.571 08:21:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:33.571 08:21:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.571 08:21:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:33.571 08:21:19 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:33.571 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.571 [2024-11-26 08:21:19.214478] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:33.571 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.571 08:21:19 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:33.571 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.571 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.571 08:21:19 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.571 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.571 [2024-11-26 08:21:19.240861] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.571 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.571 08:21:19 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:33.571 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.571 NULL1 00:13:33.571 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.571 08:21:19 -- target/connect_stress.sh@21 -- # PERF_PID=924993 00:13:33.571 08:21:19 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:33.571 08:21:19 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:33.571 08:21:19 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.571 08:21:19 -- target/connect_stress.sh@28 -- # cat 00:13:33.571 08:21:19 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:33.571 08:21:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.571 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.571 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:33.828 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.828 08:21:19 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:33.828 08:21:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.828 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.828 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:34.394 08:21:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.394 08:21:19 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:34.394 08:21:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.394 08:21:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.394 08:21:19 -- common/autotest_common.sh@10 -- # set +x 00:13:34.651 08:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.651 08:21:20 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:34.651 08:21:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.651 08:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.651 08:21:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.909 08:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.909 08:21:20 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:34.909 08:21:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.909 08:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.909 08:21:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.166 08:21:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.166 08:21:20 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:35.166 08:21:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.166 08:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.166 08:21:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.424 08:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.424 08:21:21 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:35.424 08:21:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.424 08:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.424 08:21:21 -- common/autotest_common.sh@10 -- # set +x 00:13:35.990 08:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.990 08:21:21 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:35.990 08:21:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.990 08:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.990 08:21:21 -- common/autotest_common.sh@10 -- # set +x 00:13:36.247 08:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.247 08:21:21 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:36.247 08:21:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.247 08:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.247 08:21:21 -- common/autotest_common.sh@10 -- # set +x 00:13:36.505 08:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.505 08:21:22 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:36.505 08:21:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.505 08:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.505 08:21:22 -- common/autotest_common.sh@10 -- # set +x 00:13:36.762 08:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.762 08:21:22 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:36.762 08:21:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.762 08:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.762 08:21:22 -- common/autotest_common.sh@10 -- # set +x 00:13:37.020 08:21:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.020 08:21:22 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:37.020 08:21:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.020 08:21:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.020 08:21:22 -- common/autotest_common.sh@10 -- # set +x 00:13:37.585 08:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.585 08:21:23 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:37.585 08:21:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.585 08:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.585 08:21:23 -- common/autotest_common.sh@10 -- # set +x 00:13:37.842 08:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.842 08:21:23 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:37.842 08:21:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.843 08:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.843 08:21:23 -- common/autotest_common.sh@10 -- # set +x 00:13:38.100 08:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.100 08:21:23 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:38.100 08:21:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.100 08:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.100 08:21:23 -- common/autotest_common.sh@10 -- # set +x 00:13:38.357 08:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.357 08:21:24 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:38.358 08:21:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.358 08:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.358 08:21:24 -- common/autotest_common.sh@10 -- # set +x 00:13:38.615 08:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.615 08:21:24 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:38.615 08:21:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.615 08:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.615 08:21:24 -- common/autotest_common.sh@10 -- # set +x 00:13:39.180 08:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.180 08:21:24 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:39.180 08:21:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.180 08:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.180 08:21:24 -- common/autotest_common.sh@10 -- # set +x 00:13:39.438 08:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.438 08:21:25 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:39.438 08:21:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.438 08:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.438 08:21:25 -- common/autotest_common.sh@10 -- # set +x 00:13:39.696 08:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.696 08:21:25 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:39.696 08:21:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.696 08:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.696 08:21:25 -- common/autotest_common.sh@10 -- # set +x 00:13:39.953 08:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.953 08:21:25 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:39.953 08:21:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.953 08:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.953 08:21:25 -- common/autotest_common.sh@10 -- # set +x 00:13:40.211 08:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.211 08:21:26 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:40.211 08:21:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.211 08:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.211 08:21:26 -- common/autotest_common.sh@10 -- # set +x 00:13:40.774 08:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.774 08:21:26 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:40.774 08:21:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.774 08:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.774 08:21:26 -- common/autotest_common.sh@10 -- # set +x 00:13:41.032 08:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.032 08:21:26 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:41.032 08:21:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.032 08:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.032 08:21:26 -- common/autotest_common.sh@10 -- # set +x 00:13:41.289 08:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.289 08:21:27 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:41.289 08:21:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.289 08:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.289 08:21:27 -- common/autotest_common.sh@10 -- # set +x 00:13:41.546 08:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.546 08:21:27 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:41.546 08:21:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.546 08:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.546 08:21:27 -- common/autotest_common.sh@10 -- # set +x 00:13:41.803 08:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.803 08:21:27 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:41.803 08:21:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.803 08:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.803 08:21:27 -- common/autotest_common.sh@10 -- # set +x 00:13:42.368 08:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.368 08:21:27 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:42.368 08:21:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.368 08:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.368 08:21:27 -- common/autotest_common.sh@10 -- # set +x 00:13:42.626 08:21:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.626 08:21:28 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:42.626 08:21:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.626 08:21:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.626 08:21:28 -- common/autotest_common.sh@10 -- # set +x 00:13:42.883 08:21:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.883 08:21:28 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:42.883 08:21:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.883 08:21:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.883 08:21:28 -- common/autotest_common.sh@10 -- # set +x 00:13:43.140 08:21:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.140 08:21:28 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:43.140 08:21:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.140 08:21:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.140 08:21:28 -- common/autotest_common.sh@10 -- # set +x 00:13:43.705 08:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.705 08:21:29 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:43.705 08:21:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.705 08:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.705 08:21:29 -- common/autotest_common.sh@10 -- # set +x 00:13:43.705 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:43.963 08:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.963 08:21:29 -- target/connect_stress.sh@34 -- # kill -0 924993 00:13:43.963 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (924993) - No such process 00:13:43.963 08:21:29 -- target/connect_stress.sh@38 -- # wait 924993 00:13:43.963 08:21:29 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:43.963 08:21:29 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:43.963 08:21:29 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:43.963 08:21:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:43.963 08:21:29 -- nvmf/common.sh@116 -- # sync 00:13:43.963 08:21:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:43.963 08:21:29 -- nvmf/common.sh@119 -- # set +e 00:13:43.963 08:21:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:43.963 08:21:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:43.963 rmmod nvme_tcp 00:13:43.963 rmmod nvme_fabrics 00:13:43.963 rmmod nvme_keyring 00:13:43.963 08:21:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:43.963 08:21:29 -- nvmf/common.sh@123 -- # set -e 00:13:43.963 08:21:29 -- nvmf/common.sh@124 -- # return 0 00:13:43.963 08:21:29 -- nvmf/common.sh@477 -- # '[' -n 924854 ']' 00:13:43.963 08:21:29 -- nvmf/common.sh@478 -- # killprocess 924854 00:13:43.963 08:21:29 -- common/autotest_common.sh@936 -- # '[' -z 924854 ']' 00:13:43.963 08:21:29 -- common/autotest_common.sh@940 -- # kill -0 924854 00:13:43.963 08:21:29 -- common/autotest_common.sh@941 -- # uname 00:13:43.963 08:21:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:43.963 08:21:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 924854 00:13:43.963 08:21:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:43.963 08:21:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:43.963 08:21:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 924854' 00:13:43.963 killing process with pid 924854 00:13:43.963 08:21:29 -- common/autotest_common.sh@955 -- # kill 924854 00:13:43.963 08:21:29 -- common/autotest_common.sh@960 -- # wait 924854 00:13:44.221 08:21:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.221 08:21:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.221 08:21:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.221 08:21:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.221 08:21:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.221 08:21:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.221 08:21:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.221 08:21:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.125 08:21:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.383 00:13:46.383 real 0m16.179s 00:13:46.383 user 0m40.892s 00:13:46.383 sys 0m5.859s 00:13:46.383 08:21:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.383 08:21:31 -- common/autotest_common.sh@10 -- # set +x 00:13:46.383 ************************************ 00:13:46.383 END TEST nvmf_connect_stress 00:13:46.383 ************************************ 00:13:46.383 08:21:32 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.383 08:21:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.383 08:21:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.383 08:21:32 -- common/autotest_common.sh@10 -- # set +x 00:13:46.383 ************************************ 00:13:46.383 START TEST nvmf_fused_ordering 00:13:46.383 ************************************ 00:13:46.383 08:21:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.383 * Looking for test storage... 00:13:46.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.383 08:21:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.383 08:21:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.383 08:21:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:46.383 08:21:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:46.383 08:21:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:46.383 08:21:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:46.383 08:21:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:46.383 08:21:32 -- scripts/common.sh@335 -- # IFS=.-: 00:13:46.383 08:21:32 -- scripts/common.sh@335 -- # read -ra ver1 00:13:46.383 08:21:32 -- scripts/common.sh@336 -- # IFS=.-: 00:13:46.383 08:21:32 -- scripts/common.sh@336 -- # read -ra ver2 00:13:46.383 08:21:32 -- scripts/common.sh@337 -- # local 'op=<' 00:13:46.383 08:21:32 -- scripts/common.sh@339 -- # ver1_l=2 00:13:46.383 08:21:32 -- scripts/common.sh@340 -- # ver2_l=1 00:13:46.383 08:21:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:46.383 08:21:32 -- scripts/common.sh@343 -- # case "$op" in 00:13:46.383 08:21:32 -- scripts/common.sh@344 -- # : 1 00:13:46.383 08:21:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:46.384 08:21:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:46.384 08:21:32 -- scripts/common.sh@364 -- # decimal 1 00:13:46.384 08:21:32 -- scripts/common.sh@352 -- # local d=1 00:13:46.384 08:21:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:46.384 08:21:32 -- scripts/common.sh@354 -- # echo 1 00:13:46.384 08:21:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:46.384 08:21:32 -- scripts/common.sh@365 -- # decimal 2 00:13:46.384 08:21:32 -- scripts/common.sh@352 -- # local d=2 00:13:46.384 08:21:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:46.384 08:21:32 -- scripts/common.sh@354 -- # echo 2 00:13:46.384 08:21:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:46.384 08:21:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:46.384 08:21:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:46.384 08:21:32 -- scripts/common.sh@367 -- # return 0 00:13:46.384 08:21:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:46.384 08:21:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:46.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.384 --rc genhtml_branch_coverage=1 00:13:46.384 --rc genhtml_function_coverage=1 00:13:46.384 --rc genhtml_legend=1 00:13:46.384 --rc geninfo_all_blocks=1 00:13:46.384 --rc geninfo_unexecuted_blocks=1 00:13:46.384 00:13:46.384 ' 00:13:46.384 08:21:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:46.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.384 --rc genhtml_branch_coverage=1 00:13:46.384 --rc genhtml_function_coverage=1 00:13:46.384 --rc genhtml_legend=1 00:13:46.384 --rc geninfo_all_blocks=1 00:13:46.384 --rc geninfo_unexecuted_blocks=1 00:13:46.384 00:13:46.384 ' 00:13:46.384 08:21:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:46.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.384 --rc genhtml_branch_coverage=1 00:13:46.384 --rc genhtml_function_coverage=1 00:13:46.384 --rc genhtml_legend=1 00:13:46.384 --rc geninfo_all_blocks=1 00:13:46.384 --rc geninfo_unexecuted_blocks=1 00:13:46.384 00:13:46.384 ' 00:13:46.384 08:21:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:46.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.384 --rc genhtml_branch_coverage=1 00:13:46.384 --rc genhtml_function_coverage=1 00:13:46.384 --rc genhtml_legend=1 00:13:46.384 --rc geninfo_all_blocks=1 00:13:46.384 --rc geninfo_unexecuted_blocks=1 00:13:46.384 00:13:46.384 ' 00:13:46.384 08:21:32 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.384 08:21:32 -- nvmf/common.sh@7 -- # uname -s 00:13:46.384 08:21:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.384 08:21:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.384 08:21:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.384 08:21:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.384 08:21:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.384 08:21:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.384 08:21:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.384 08:21:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.384 08:21:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.384 08:21:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.384 08:21:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.384 08:21:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.384 08:21:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.384 08:21:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.384 08:21:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.384 08:21:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.384 08:21:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.384 08:21:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.384 08:21:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.384 08:21:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.384 08:21:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.384 08:21:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.384 08:21:32 -- paths/export.sh@5 -- # export PATH 00:13:46.384 08:21:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.384 08:21:32 -- nvmf/common.sh@46 -- # : 0 00:13:46.384 08:21:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.384 08:21:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.384 08:21:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.384 08:21:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.384 08:21:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.384 08:21:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.384 08:21:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.384 08:21:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.384 08:21:32 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:46.384 08:21:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.384 08:21:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.384 08:21:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.384 08:21:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.384 08:21:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.384 08:21:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.384 08:21:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.384 08:21:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.384 08:21:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.384 08:21:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.384 08:21:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.384 08:21:32 -- common/autotest_common.sh@10 -- # set +x 00:13:48.287 08:21:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.287 08:21:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.287 08:21:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.287 08:21:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.287 08:21:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.287 08:21:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.287 08:21:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.287 08:21:34 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.287 08:21:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.287 08:21:34 -- nvmf/common.sh@295 -- # e810=() 00:13:48.287 08:21:34 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.287 08:21:34 -- nvmf/common.sh@296 -- # x722=() 00:13:48.287 08:21:34 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.287 08:21:34 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.287 08:21:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.287 08:21:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.287 08:21:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.287 08:21:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.287 08:21:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.287 08:21:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.287 08:21:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.287 08:21:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.287 08:21:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.287 08:21:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.287 08:21:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.287 08:21:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.287 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.287 08:21:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.287 08:21:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.287 08:21:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.287 08:21:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.287 08:21:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.287 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.287 08:21:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.287 08:21:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.287 08:21:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.287 08:21:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.287 08:21:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.287 08:21:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.287 08:21:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.287 08:21:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.287 08:21:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.287 08:21:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.287 08:21:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.287 08:21:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.287 08:21:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.287 08:21:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.287 08:21:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.287 08:21:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.287 08:21:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.288 08:21:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.288 08:21:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.547 08:21:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.547 08:21:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.547 08:21:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.547 08:21:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.547 08:21:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.547 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.547 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:13:48.547 00:13:48.547 --- 10.0.0.2 ping statistics --- 00:13:48.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.547 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:13:48.547 08:21:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.547 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.547 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:13:48.547 00:13:48.547 --- 10.0.0.1 ping statistics --- 00:13:48.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.547 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:13:48.547 08:21:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.547 08:21:34 -- nvmf/common.sh@410 -- # return 0 00:13:48.547 08:21:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.547 08:21:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.547 08:21:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.547 08:21:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.547 08:21:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.547 08:21:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.547 08:21:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.547 08:21:34 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:48.547 08:21:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.547 08:21:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.547 08:21:34 -- common/autotest_common.sh@10 -- # set +x 00:13:48.547 08:21:34 -- nvmf/common.sh@469 -- # nvmfpid=928311 00:13:48.547 08:21:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:48.547 08:21:34 -- nvmf/common.sh@470 -- # waitforlisten 928311 00:13:48.547 08:21:34 -- common/autotest_common.sh@829 -- # '[' -z 928311 ']' 00:13:48.547 08:21:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.547 08:21:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.547 08:21:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.547 08:21:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.547 08:21:34 -- common/autotest_common.sh@10 -- # set +x 00:13:48.547 [2024-11-26 08:21:34.390926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.547 [2024-11-26 08:21:34.391012] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.806 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.806 [2024-11-26 08:21:34.461828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:48.806 [2024-11-26 08:21:34.574770] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:48.806 [2024-11-26 08:21:34.574950] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:48.806 [2024-11-26 08:21:34.574970] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:48.806 [2024-11-26 08:21:34.574984] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:48.806 [2024-11-26 08:21:34.575036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.740 08:21:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.740 08:21:35 -- common/autotest_common.sh@862 -- # return 0 00:13:49.740 08:21:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.740 08:21:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 08:21:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.740 08:21:35 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 [2024-11-26 08:21:35.382543] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 [2024-11-26 08:21:35.398769] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 NULL1 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:49.740 08:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.740 08:21:35 -- common/autotest_common.sh@10 -- # set +x 00:13:49.740 08:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.740 08:21:35 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:49.740 [2024-11-26 08:21:35.443356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:49.740 [2024-11-26 08:21:35.443398] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid928470 ] 00:13:49.740 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.998 Attached to nqn.2016-06.io.spdk:cnode1 00:13:49.998 Namespace ID: 1 size: 1GB 00:13:49.998 fused_ordering(0) 00:13:49.998 fused_ordering(1) 00:13:49.998 fused_ordering(2) 00:13:49.998 fused_ordering(3) 00:13:49.998 fused_ordering(4) 00:13:49.998 fused_ordering(5) 00:13:49.998 fused_ordering(6) 00:13:49.998 fused_ordering(7) 00:13:49.998 fused_ordering(8) 00:13:49.998 fused_ordering(9) 00:13:49.998 fused_ordering(10) 00:13:49.998 fused_ordering(11) 00:13:49.998 fused_ordering(12) 00:13:49.998 fused_ordering(13) 00:13:49.998 fused_ordering(14) 00:13:49.998 fused_ordering(15) 00:13:49.998 fused_ordering(16) 00:13:49.998 fused_ordering(17) 00:13:49.998 fused_ordering(18) 00:13:49.998 fused_ordering(19) 00:13:49.998 fused_ordering(20) 00:13:49.998 fused_ordering(21) 00:13:49.998 fused_ordering(22) 00:13:49.998 fused_ordering(23) 00:13:49.998 fused_ordering(24) 00:13:49.998 fused_ordering(25) 00:13:49.998 fused_ordering(26) 00:13:49.998 fused_ordering(27) 00:13:49.998 fused_ordering(28) 00:13:49.998 fused_ordering(29) 00:13:49.998 fused_ordering(30) 00:13:49.998 fused_ordering(31) 00:13:49.998 fused_ordering(32) 00:13:49.998 fused_ordering(33) 00:13:49.998 fused_ordering(34) 00:13:49.998 fused_ordering(35) 00:13:49.998 fused_ordering(36) 00:13:49.998 fused_ordering(37) 00:13:49.998 fused_ordering(38) 00:13:49.998 fused_ordering(39) 00:13:49.998 fused_ordering(40) 00:13:49.998 fused_ordering(41) 00:13:49.998 fused_ordering(42) 00:13:49.998 fused_ordering(43) 00:13:49.998 fused_ordering(44) 00:13:49.998 fused_ordering(45) 00:13:49.998 fused_ordering(46) 00:13:49.998 fused_ordering(47) 00:13:49.998 fused_ordering(48) 00:13:49.998 fused_ordering(49) 00:13:49.998 fused_ordering(50) 00:13:49.998 fused_ordering(51) 00:13:49.998 fused_ordering(52) 00:13:49.998 fused_ordering(53) 00:13:49.998 fused_ordering(54) 00:13:49.998 fused_ordering(55) 00:13:49.998 fused_ordering(56) 00:13:49.998 fused_ordering(57) 00:13:49.998 fused_ordering(58) 00:13:49.998 fused_ordering(59) 00:13:49.998 fused_ordering(60) 00:13:49.998 fused_ordering(61) 00:13:49.998 fused_ordering(62) 00:13:49.998 fused_ordering(63) 00:13:49.998 fused_ordering(64) 00:13:49.998 fused_ordering(65) 00:13:49.998 fused_ordering(66) 00:13:49.998 fused_ordering(67) 00:13:49.998 fused_ordering(68) 00:13:49.998 fused_ordering(69) 00:13:49.998 fused_ordering(70) 00:13:49.998 fused_ordering(71) 00:13:49.998 fused_ordering(72) 00:13:49.998 fused_ordering(73) 00:13:49.998 fused_ordering(74) 00:13:49.998 fused_ordering(75) 00:13:49.998 fused_ordering(76) 00:13:49.998 fused_ordering(77) 00:13:49.998 fused_ordering(78) 00:13:49.998 fused_ordering(79) 00:13:49.998 fused_ordering(80) 00:13:49.998 fused_ordering(81) 00:13:49.998 fused_ordering(82) 00:13:49.998 fused_ordering(83) 00:13:49.998 fused_ordering(84) 00:13:49.998 fused_ordering(85) 00:13:49.998 fused_ordering(86) 00:13:49.998 fused_ordering(87) 00:13:49.998 fused_ordering(88) 00:13:49.998 fused_ordering(89) 00:13:49.998 fused_ordering(90) 00:13:49.998 fused_ordering(91) 00:13:49.998 fused_ordering(92) 00:13:49.998 fused_ordering(93) 00:13:49.998 fused_ordering(94) 00:13:49.998 fused_ordering(95) 00:13:49.998 fused_ordering(96) 00:13:49.998 fused_ordering(97) 00:13:49.998 fused_ordering(98) 00:13:49.998 fused_ordering(99) 00:13:49.998 fused_ordering(100) 00:13:49.998 fused_ordering(101) 00:13:49.998 fused_ordering(102) 00:13:49.998 fused_ordering(103) 00:13:49.998 fused_ordering(104) 00:13:49.998 fused_ordering(105) 00:13:49.998 fused_ordering(106) 00:13:49.998 fused_ordering(107) 00:13:49.998 fused_ordering(108) 00:13:49.998 fused_ordering(109) 00:13:49.998 fused_ordering(110) 00:13:49.998 fused_ordering(111) 00:13:49.998 fused_ordering(112) 00:13:49.998 fused_ordering(113) 00:13:49.998 fused_ordering(114) 00:13:49.998 fused_ordering(115) 00:13:49.998 fused_ordering(116) 00:13:49.998 fused_ordering(117) 00:13:49.998 fused_ordering(118) 00:13:49.998 fused_ordering(119) 00:13:49.998 fused_ordering(120) 00:13:49.998 fused_ordering(121) 00:13:49.998 fused_ordering(122) 00:13:49.998 fused_ordering(123) 00:13:49.998 fused_ordering(124) 00:13:49.998 fused_ordering(125) 00:13:49.998 fused_ordering(126) 00:13:49.998 fused_ordering(127) 00:13:49.998 fused_ordering(128) 00:13:49.998 fused_ordering(129) 00:13:49.998 fused_ordering(130) 00:13:49.998 fused_ordering(131) 00:13:49.998 fused_ordering(132) 00:13:49.998 fused_ordering(133) 00:13:49.998 fused_ordering(134) 00:13:49.998 fused_ordering(135) 00:13:49.998 fused_ordering(136) 00:13:49.998 fused_ordering(137) 00:13:49.998 fused_ordering(138) 00:13:49.998 fused_ordering(139) 00:13:49.998 fused_ordering(140) 00:13:49.998 fused_ordering(141) 00:13:49.998 fused_ordering(142) 00:13:49.998 fused_ordering(143) 00:13:49.998 fused_ordering(144) 00:13:49.998 fused_ordering(145) 00:13:49.998 fused_ordering(146) 00:13:49.998 fused_ordering(147) 00:13:49.998 fused_ordering(148) 00:13:49.998 fused_ordering(149) 00:13:49.998 fused_ordering(150) 00:13:49.998 fused_ordering(151) 00:13:49.998 fused_ordering(152) 00:13:49.998 fused_ordering(153) 00:13:49.998 fused_ordering(154) 00:13:49.998 fused_ordering(155) 00:13:49.998 fused_ordering(156) 00:13:49.998 fused_ordering(157) 00:13:49.998 fused_ordering(158) 00:13:49.998 fused_ordering(159) 00:13:49.999 fused_ordering(160) 00:13:49.999 fused_ordering(161) 00:13:49.999 fused_ordering(162) 00:13:49.999 fused_ordering(163) 00:13:49.999 fused_ordering(164) 00:13:49.999 fused_ordering(165) 00:13:49.999 fused_ordering(166) 00:13:49.999 fused_ordering(167) 00:13:49.999 fused_ordering(168) 00:13:49.999 fused_ordering(169) 00:13:49.999 fused_ordering(170) 00:13:49.999 fused_ordering(171) 00:13:49.999 fused_ordering(172) 00:13:49.999 fused_ordering(173) 00:13:49.999 fused_ordering(174) 00:13:49.999 fused_ordering(175) 00:13:49.999 fused_ordering(176) 00:13:49.999 fused_ordering(177) 00:13:49.999 fused_ordering(178) 00:13:49.999 fused_ordering(179) 00:13:49.999 fused_ordering(180) 00:13:49.999 fused_ordering(181) 00:13:49.999 fused_ordering(182) 00:13:49.999 fused_ordering(183) 00:13:49.999 fused_ordering(184) 00:13:49.999 fused_ordering(185) 00:13:49.999 fused_ordering(186) 00:13:49.999 fused_ordering(187) 00:13:49.999 fused_ordering(188) 00:13:49.999 fused_ordering(189) 00:13:49.999 fused_ordering(190) 00:13:49.999 fused_ordering(191) 00:13:49.999 fused_ordering(192) 00:13:49.999 fused_ordering(193) 00:13:49.999 fused_ordering(194) 00:13:49.999 fused_ordering(195) 00:13:49.999 fused_ordering(196) 00:13:49.999 fused_ordering(197) 00:13:49.999 fused_ordering(198) 00:13:49.999 fused_ordering(199) 00:13:49.999 fused_ordering(200) 00:13:49.999 fused_ordering(201) 00:13:49.999 fused_ordering(202) 00:13:49.999 fused_ordering(203) 00:13:49.999 fused_ordering(204) 00:13:49.999 fused_ordering(205) 00:13:50.564 fused_ordering(206) 00:13:50.564 fused_ordering(207) 00:13:50.564 fused_ordering(208) 00:13:50.564 fused_ordering(209) 00:13:50.564 fused_ordering(210) 00:13:50.564 fused_ordering(211) 00:13:50.564 fused_ordering(212) 00:13:50.564 fused_ordering(213) 00:13:50.564 fused_ordering(214) 00:13:50.564 fused_ordering(215) 00:13:50.564 fused_ordering(216) 00:13:50.564 fused_ordering(217) 00:13:50.564 fused_ordering(218) 00:13:50.564 fused_ordering(219) 00:13:50.564 fused_ordering(220) 00:13:50.564 fused_ordering(221) 00:13:50.564 fused_ordering(222) 00:13:50.564 fused_ordering(223) 00:13:50.564 fused_ordering(224) 00:13:50.564 fused_ordering(225) 00:13:50.564 fused_ordering(226) 00:13:50.564 fused_ordering(227) 00:13:50.564 fused_ordering(228) 00:13:50.564 fused_ordering(229) 00:13:50.564 fused_ordering(230) 00:13:50.564 fused_ordering(231) 00:13:50.564 fused_ordering(232) 00:13:50.564 fused_ordering(233) 00:13:50.564 fused_ordering(234) 00:13:50.564 fused_ordering(235) 00:13:50.564 fused_ordering(236) 00:13:50.564 fused_ordering(237) 00:13:50.564 fused_ordering(238) 00:13:50.564 fused_ordering(239) 00:13:50.564 fused_ordering(240) 00:13:50.564 fused_ordering(241) 00:13:50.564 fused_ordering(242) 00:13:50.564 fused_ordering(243) 00:13:50.564 fused_ordering(244) 00:13:50.564 fused_ordering(245) 00:13:50.564 fused_ordering(246) 00:13:50.564 fused_ordering(247) 00:13:50.564 fused_ordering(248) 00:13:50.564 fused_ordering(249) 00:13:50.564 fused_ordering(250) 00:13:50.564 fused_ordering(251) 00:13:50.564 fused_ordering(252) 00:13:50.564 fused_ordering(253) 00:13:50.564 fused_ordering(254) 00:13:50.564 fused_ordering(255) 00:13:50.564 fused_ordering(256) 00:13:50.564 fused_ordering(257) 00:13:50.564 fused_ordering(258) 00:13:50.564 fused_ordering(259) 00:13:50.564 fused_ordering(260) 00:13:50.564 fused_ordering(261) 00:13:50.564 fused_ordering(262) 00:13:50.564 fused_ordering(263) 00:13:50.564 fused_ordering(264) 00:13:50.564 fused_ordering(265) 00:13:50.564 fused_ordering(266) 00:13:50.564 fused_ordering(267) 00:13:50.564 fused_ordering(268) 00:13:50.564 fused_ordering(269) 00:13:50.564 fused_ordering(270) 00:13:50.564 fused_ordering(271) 00:13:50.564 fused_ordering(272) 00:13:50.564 fused_ordering(273) 00:13:50.564 fused_ordering(274) 00:13:50.564 fused_ordering(275) 00:13:50.564 fused_ordering(276) 00:13:50.564 fused_ordering(277) 00:13:50.564 fused_ordering(278) 00:13:50.564 fused_ordering(279) 00:13:50.564 fused_ordering(280) 00:13:50.564 fused_ordering(281) 00:13:50.564 fused_ordering(282) 00:13:50.564 fused_ordering(283) 00:13:50.564 fused_ordering(284) 00:13:50.564 fused_ordering(285) 00:13:50.564 fused_ordering(286) 00:13:50.564 fused_ordering(287) 00:13:50.564 fused_ordering(288) 00:13:50.564 fused_ordering(289) 00:13:50.564 fused_ordering(290) 00:13:50.564 fused_ordering(291) 00:13:50.564 fused_ordering(292) 00:13:50.564 fused_ordering(293) 00:13:50.564 fused_ordering(294) 00:13:50.564 fused_ordering(295) 00:13:50.564 fused_ordering(296) 00:13:50.564 fused_ordering(297) 00:13:50.564 fused_ordering(298) 00:13:50.564 fused_ordering(299) 00:13:50.564 fused_ordering(300) 00:13:50.564 fused_ordering(301) 00:13:50.564 fused_ordering(302) 00:13:50.564 fused_ordering(303) 00:13:50.564 fused_ordering(304) 00:13:50.564 fused_ordering(305) 00:13:50.564 fused_ordering(306) 00:13:50.564 fused_ordering(307) 00:13:50.564 fused_ordering(308) 00:13:50.564 fused_ordering(309) 00:13:50.564 fused_ordering(310) 00:13:50.564 fused_ordering(311) 00:13:50.564 fused_ordering(312) 00:13:50.564 fused_ordering(313) 00:13:50.564 fused_ordering(314) 00:13:50.564 fused_ordering(315) 00:13:50.564 fused_ordering(316) 00:13:50.564 fused_ordering(317) 00:13:50.564 fused_ordering(318) 00:13:50.564 fused_ordering(319) 00:13:50.564 fused_ordering(320) 00:13:50.564 fused_ordering(321) 00:13:50.565 fused_ordering(322) 00:13:50.565 fused_ordering(323) 00:13:50.565 fused_ordering(324) 00:13:50.565 fused_ordering(325) 00:13:50.565 fused_ordering(326) 00:13:50.565 fused_ordering(327) 00:13:50.565 fused_ordering(328) 00:13:50.565 fused_ordering(329) 00:13:50.565 fused_ordering(330) 00:13:50.565 fused_ordering(331) 00:13:50.565 fused_ordering(332) 00:13:50.565 fused_ordering(333) 00:13:50.565 fused_ordering(334) 00:13:50.565 fused_ordering(335) 00:13:50.565 fused_ordering(336) 00:13:50.565 fused_ordering(337) 00:13:50.565 fused_ordering(338) 00:13:50.565 fused_ordering(339) 00:13:50.565 fused_ordering(340) 00:13:50.565 fused_ordering(341) 00:13:50.565 fused_ordering(342) 00:13:50.565 fused_ordering(343) 00:13:50.565 fused_ordering(344) 00:13:50.565 fused_ordering(345) 00:13:50.565 fused_ordering(346) 00:13:50.565 fused_ordering(347) 00:13:50.565 fused_ordering(348) 00:13:50.565 fused_ordering(349) 00:13:50.565 fused_ordering(350) 00:13:50.565 fused_ordering(351) 00:13:50.565 fused_ordering(352) 00:13:50.565 fused_ordering(353) 00:13:50.565 fused_ordering(354) 00:13:50.565 fused_ordering(355) 00:13:50.565 fused_ordering(356) 00:13:50.565 fused_ordering(357) 00:13:50.565 fused_ordering(358) 00:13:50.565 fused_ordering(359) 00:13:50.565 fused_ordering(360) 00:13:50.565 fused_ordering(361) 00:13:50.565 fused_ordering(362) 00:13:50.565 fused_ordering(363) 00:13:50.565 fused_ordering(364) 00:13:50.565 fused_ordering(365) 00:13:50.565 fused_ordering(366) 00:13:50.565 fused_ordering(367) 00:13:50.565 fused_ordering(368) 00:13:50.565 fused_ordering(369) 00:13:50.565 fused_ordering(370) 00:13:50.565 fused_ordering(371) 00:13:50.565 fused_ordering(372) 00:13:50.565 fused_ordering(373) 00:13:50.565 fused_ordering(374) 00:13:50.565 fused_ordering(375) 00:13:50.565 fused_ordering(376) 00:13:50.565 fused_ordering(377) 00:13:50.565 fused_ordering(378) 00:13:50.565 fused_ordering(379) 00:13:50.565 fused_ordering(380) 00:13:50.565 fused_ordering(381) 00:13:50.565 fused_ordering(382) 00:13:50.565 fused_ordering(383) 00:13:50.565 fused_ordering(384) 00:13:50.565 fused_ordering(385) 00:13:50.565 fused_ordering(386) 00:13:50.565 fused_ordering(387) 00:13:50.565 fused_ordering(388) 00:13:50.565 fused_ordering(389) 00:13:50.565 fused_ordering(390) 00:13:50.565 fused_ordering(391) 00:13:50.565 fused_ordering(392) 00:13:50.565 fused_ordering(393) 00:13:50.565 fused_ordering(394) 00:13:50.565 fused_ordering(395) 00:13:50.565 fused_ordering(396) 00:13:50.565 fused_ordering(397) 00:13:50.565 fused_ordering(398) 00:13:50.565 fused_ordering(399) 00:13:50.565 fused_ordering(400) 00:13:50.565 fused_ordering(401) 00:13:50.565 fused_ordering(402) 00:13:50.565 fused_ordering(403) 00:13:50.565 fused_ordering(404) 00:13:50.565 fused_ordering(405) 00:13:50.565 fused_ordering(406) 00:13:50.565 fused_ordering(407) 00:13:50.565 fused_ordering(408) 00:13:50.565 fused_ordering(409) 00:13:50.565 fused_ordering(410) 00:13:51.130 fused_ordering(411) 00:13:51.130 fused_ordering(412) 00:13:51.130 fused_ordering(413) 00:13:51.130 fused_ordering(414) 00:13:51.130 fused_ordering(415) 00:13:51.130 fused_ordering(416) 00:13:51.130 fused_ordering(417) 00:13:51.130 fused_ordering(418) 00:13:51.130 fused_ordering(419) 00:13:51.130 fused_ordering(420) 00:13:51.130 fused_ordering(421) 00:13:51.130 fused_ordering(422) 00:13:51.130 fused_ordering(423) 00:13:51.130 fused_ordering(424) 00:13:51.130 fused_ordering(425) 00:13:51.130 fused_ordering(426) 00:13:51.130 fused_ordering(427) 00:13:51.130 fused_ordering(428) 00:13:51.130 fused_ordering(429) 00:13:51.130 fused_ordering(430) 00:13:51.130 fused_ordering(431) 00:13:51.130 fused_ordering(432) 00:13:51.130 fused_ordering(433) 00:13:51.130 fused_ordering(434) 00:13:51.130 fused_ordering(435) 00:13:51.130 fused_ordering(436) 00:13:51.130 fused_ordering(437) 00:13:51.130 fused_ordering(438) 00:13:51.130 fused_ordering(439) 00:13:51.130 fused_ordering(440) 00:13:51.130 fused_ordering(441) 00:13:51.130 fused_ordering(442) 00:13:51.130 fused_ordering(443) 00:13:51.130 fused_ordering(444) 00:13:51.130 fused_ordering(445) 00:13:51.130 fused_ordering(446) 00:13:51.130 fused_ordering(447) 00:13:51.130 fused_ordering(448) 00:13:51.130 fused_ordering(449) 00:13:51.130 fused_ordering(450) 00:13:51.130 fused_ordering(451) 00:13:51.130 fused_ordering(452) 00:13:51.130 fused_ordering(453) 00:13:51.130 fused_ordering(454) 00:13:51.130 fused_ordering(455) 00:13:51.130 fused_ordering(456) 00:13:51.130 fused_ordering(457) 00:13:51.130 fused_ordering(458) 00:13:51.130 fused_ordering(459) 00:13:51.130 fused_ordering(460) 00:13:51.130 fused_ordering(461) 00:13:51.130 fused_ordering(462) 00:13:51.130 fused_ordering(463) 00:13:51.130 fused_ordering(464) 00:13:51.130 fused_ordering(465) 00:13:51.130 fused_ordering(466) 00:13:51.130 fused_ordering(467) 00:13:51.130 fused_ordering(468) 00:13:51.130 fused_ordering(469) 00:13:51.130 fused_ordering(470) 00:13:51.130 fused_ordering(471) 00:13:51.130 fused_ordering(472) 00:13:51.130 fused_ordering(473) 00:13:51.130 fused_ordering(474) 00:13:51.130 fused_ordering(475) 00:13:51.130 fused_ordering(476) 00:13:51.130 fused_ordering(477) 00:13:51.130 fused_ordering(478) 00:13:51.130 fused_ordering(479) 00:13:51.130 fused_ordering(480) 00:13:51.130 fused_ordering(481) 00:13:51.130 fused_ordering(482) 00:13:51.130 fused_ordering(483) 00:13:51.130 fused_ordering(484) 00:13:51.130 fused_ordering(485) 00:13:51.130 fused_ordering(486) 00:13:51.130 fused_ordering(487) 00:13:51.130 fused_ordering(488) 00:13:51.130 fused_ordering(489) 00:13:51.130 fused_ordering(490) 00:13:51.130 fused_ordering(491) 00:13:51.130 fused_ordering(492) 00:13:51.130 fused_ordering(493) 00:13:51.130 fused_ordering(494) 00:13:51.130 fused_ordering(495) 00:13:51.130 fused_ordering(496) 00:13:51.130 fused_ordering(497) 00:13:51.130 fused_ordering(498) 00:13:51.130 fused_ordering(499) 00:13:51.130 fused_ordering(500) 00:13:51.130 fused_ordering(501) 00:13:51.130 fused_ordering(502) 00:13:51.130 fused_ordering(503) 00:13:51.130 fused_ordering(504) 00:13:51.131 fused_ordering(505) 00:13:51.131 fused_ordering(506) 00:13:51.131 fused_ordering(507) 00:13:51.131 fused_ordering(508) 00:13:51.131 fused_ordering(509) 00:13:51.131 fused_ordering(510) 00:13:51.131 fused_ordering(511) 00:13:51.131 fused_ordering(512) 00:13:51.131 fused_ordering(513) 00:13:51.131 fused_ordering(514) 00:13:51.131 fused_ordering(515) 00:13:51.131 fused_ordering(516) 00:13:51.131 fused_ordering(517) 00:13:51.131 fused_ordering(518) 00:13:51.131 fused_ordering(519) 00:13:51.131 fused_ordering(520) 00:13:51.131 fused_ordering(521) 00:13:51.131 fused_ordering(522) 00:13:51.131 fused_ordering(523) 00:13:51.131 fused_ordering(524) 00:13:51.131 fused_ordering(525) 00:13:51.131 fused_ordering(526) 00:13:51.131 fused_ordering(527) 00:13:51.131 fused_ordering(528) 00:13:51.131 fused_ordering(529) 00:13:51.131 fused_ordering(530) 00:13:51.131 fused_ordering(531) 00:13:51.131 fused_ordering(532) 00:13:51.131 fused_ordering(533) 00:13:51.131 fused_ordering(534) 00:13:51.131 fused_ordering(535) 00:13:51.131 fused_ordering(536) 00:13:51.131 fused_ordering(537) 00:13:51.131 fused_ordering(538) 00:13:51.131 fused_ordering(539) 00:13:51.131 fused_ordering(540) 00:13:51.131 fused_ordering(541) 00:13:51.131 fused_ordering(542) 00:13:51.131 fused_ordering(543) 00:13:51.131 fused_ordering(544) 00:13:51.131 fused_ordering(545) 00:13:51.131 fused_ordering(546) 00:13:51.131 fused_ordering(547) 00:13:51.131 fused_ordering(548) 00:13:51.131 fused_ordering(549) 00:13:51.131 fused_ordering(550) 00:13:51.131 fused_ordering(551) 00:13:51.131 fused_ordering(552) 00:13:51.131 fused_ordering(553) 00:13:51.131 fused_ordering(554) 00:13:51.131 fused_ordering(555) 00:13:51.131 fused_ordering(556) 00:13:51.131 fused_ordering(557) 00:13:51.131 fused_ordering(558) 00:13:51.131 fused_ordering(559) 00:13:51.131 fused_ordering(560) 00:13:51.131 fused_ordering(561) 00:13:51.131 fused_ordering(562) 00:13:51.131 fused_ordering(563) 00:13:51.131 fused_ordering(564) 00:13:51.131 fused_ordering(565) 00:13:51.131 fused_ordering(566) 00:13:51.131 fused_ordering(567) 00:13:51.131 fused_ordering(568) 00:13:51.131 fused_ordering(569) 00:13:51.131 fused_ordering(570) 00:13:51.131 fused_ordering(571) 00:13:51.131 fused_ordering(572) 00:13:51.131 fused_ordering(573) 00:13:51.131 fused_ordering(574) 00:13:51.131 fused_ordering(575) 00:13:51.131 fused_ordering(576) 00:13:51.131 fused_ordering(577) 00:13:51.131 fused_ordering(578) 00:13:51.131 fused_ordering(579) 00:13:51.131 fused_ordering(580) 00:13:51.131 fused_ordering(581) 00:13:51.131 fused_ordering(582) 00:13:51.131 fused_ordering(583) 00:13:51.131 fused_ordering(584) 00:13:51.131 fused_ordering(585) 00:13:51.131 fused_ordering(586) 00:13:51.131 fused_ordering(587) 00:13:51.131 fused_ordering(588) 00:13:51.131 fused_ordering(589) 00:13:51.131 fused_ordering(590) 00:13:51.131 fused_ordering(591) 00:13:51.131 fused_ordering(592) 00:13:51.131 fused_ordering(593) 00:13:51.131 fused_ordering(594) 00:13:51.131 fused_ordering(595) 00:13:51.131 fused_ordering(596) 00:13:51.131 fused_ordering(597) 00:13:51.131 fused_ordering(598) 00:13:51.131 fused_ordering(599) 00:13:51.131 fused_ordering(600) 00:13:51.131 fused_ordering(601) 00:13:51.131 fused_ordering(602) 00:13:51.131 fused_ordering(603) 00:13:51.131 fused_ordering(604) 00:13:51.131 fused_ordering(605) 00:13:51.131 fused_ordering(606) 00:13:51.131 fused_ordering(607) 00:13:51.131 fused_ordering(608) 00:13:51.131 fused_ordering(609) 00:13:51.131 fused_ordering(610) 00:13:51.131 fused_ordering(611) 00:13:51.131 fused_ordering(612) 00:13:51.131 fused_ordering(613) 00:13:51.131 fused_ordering(614) 00:13:51.131 fused_ordering(615) 00:13:51.697 fused_ordering(616) 00:13:51.697 fused_ordering(617) 00:13:51.697 fused_ordering(618) 00:13:51.697 fused_ordering(619) 00:13:51.697 fused_ordering(620) 00:13:51.697 fused_ordering(621) 00:13:51.697 fused_ordering(622) 00:13:51.697 fused_ordering(623) 00:13:51.697 fused_ordering(624) 00:13:51.697 fused_ordering(625) 00:13:51.697 fused_ordering(626) 00:13:51.697 fused_ordering(627) 00:13:51.697 fused_ordering(628) 00:13:51.697 fused_ordering(629) 00:13:51.697 fused_ordering(630) 00:13:51.697 fused_ordering(631) 00:13:51.697 fused_ordering(632) 00:13:51.697 fused_ordering(633) 00:13:51.697 fused_ordering(634) 00:13:51.697 fused_ordering(635) 00:13:51.697 fused_ordering(636) 00:13:51.697 fused_ordering(637) 00:13:51.697 fused_ordering(638) 00:13:51.697 fused_ordering(639) 00:13:51.697 fused_ordering(640) 00:13:51.697 fused_ordering(641) 00:13:51.697 fused_ordering(642) 00:13:51.697 fused_ordering(643) 00:13:51.697 fused_ordering(644) 00:13:51.697 fused_ordering(645) 00:13:51.697 fused_ordering(646) 00:13:51.697 fused_ordering(647) 00:13:51.697 fused_ordering(648) 00:13:51.697 fused_ordering(649) 00:13:51.697 fused_ordering(650) 00:13:51.697 fused_ordering(651) 00:13:51.697 fused_ordering(652) 00:13:51.697 fused_ordering(653) 00:13:51.697 fused_ordering(654) 00:13:51.697 fused_ordering(655) 00:13:51.697 fused_ordering(656) 00:13:51.697 fused_ordering(657) 00:13:51.697 fused_ordering(658) 00:13:51.697 fused_ordering(659) 00:13:51.697 fused_ordering(660) 00:13:51.697 fused_ordering(661) 00:13:51.697 fused_ordering(662) 00:13:51.697 fused_ordering(663) 00:13:51.697 fused_ordering(664) 00:13:51.697 fused_ordering(665) 00:13:51.697 fused_ordering(666) 00:13:51.697 fused_ordering(667) 00:13:51.697 fused_ordering(668) 00:13:51.697 fused_ordering(669) 00:13:51.697 fused_ordering(670) 00:13:51.697 fused_ordering(671) 00:13:51.697 fused_ordering(672) 00:13:51.697 fused_ordering(673) 00:13:51.697 fused_ordering(674) 00:13:51.697 fused_ordering(675) 00:13:51.697 fused_ordering(676) 00:13:51.697 fused_ordering(677) 00:13:51.697 fused_ordering(678) 00:13:51.697 fused_ordering(679) 00:13:51.697 fused_ordering(680) 00:13:51.697 fused_ordering(681) 00:13:51.697 fused_ordering(682) 00:13:51.697 fused_ordering(683) 00:13:51.697 fused_ordering(684) 00:13:51.697 fused_ordering(685) 00:13:51.697 fused_ordering(686) 00:13:51.697 fused_ordering(687) 00:13:51.697 fused_ordering(688) 00:13:51.697 fused_ordering(689) 00:13:51.697 fused_ordering(690) 00:13:51.697 fused_ordering(691) 00:13:51.697 fused_ordering(692) 00:13:51.697 fused_ordering(693) 00:13:51.697 fused_ordering(694) 00:13:51.697 fused_ordering(695) 00:13:51.697 fused_ordering(696) 00:13:51.697 fused_ordering(697) 00:13:51.697 fused_ordering(698) 00:13:51.697 fused_ordering(699) 00:13:51.697 fused_ordering(700) 00:13:51.697 fused_ordering(701) 00:13:51.697 fused_ordering(702) 00:13:51.697 fused_ordering(703) 00:13:51.697 fused_ordering(704) 00:13:51.697 fused_ordering(705) 00:13:51.697 fused_ordering(706) 00:13:51.697 fused_ordering(707) 00:13:51.697 fused_ordering(708) 00:13:51.697 fused_ordering(709) 00:13:51.697 fused_ordering(710) 00:13:51.697 fused_ordering(711) 00:13:51.697 fused_ordering(712) 00:13:51.697 fused_ordering(713) 00:13:51.697 fused_ordering(714) 00:13:51.697 fused_ordering(715) 00:13:51.697 fused_ordering(716) 00:13:51.697 fused_ordering(717) 00:13:51.697 fused_ordering(718) 00:13:51.697 fused_ordering(719) 00:13:51.697 fused_ordering(720) 00:13:51.697 fused_ordering(721) 00:13:51.697 fused_ordering(722) 00:13:51.697 fused_ordering(723) 00:13:51.697 fused_ordering(724) 00:13:51.697 fused_ordering(725) 00:13:51.697 fused_ordering(726) 00:13:51.697 fused_ordering(727) 00:13:51.697 fused_ordering(728) 00:13:51.697 fused_ordering(729) 00:13:51.697 fused_ordering(730) 00:13:51.697 fused_ordering(731) 00:13:51.697 fused_ordering(732) 00:13:51.697 fused_ordering(733) 00:13:51.697 fused_ordering(734) 00:13:51.697 fused_ordering(735) 00:13:51.697 fused_ordering(736) 00:13:51.697 fused_ordering(737) 00:13:51.697 fused_ordering(738) 00:13:51.697 fused_ordering(739) 00:13:51.697 fused_ordering(740) 00:13:51.697 fused_ordering(741) 00:13:51.697 fused_ordering(742) 00:13:51.697 fused_ordering(743) 00:13:51.697 fused_ordering(744) 00:13:51.697 fused_ordering(745) 00:13:51.697 fused_ordering(746) 00:13:51.697 fused_ordering(747) 00:13:51.697 fused_ordering(748) 00:13:51.697 fused_ordering(749) 00:13:51.697 fused_ordering(750) 00:13:51.697 fused_ordering(751) 00:13:51.697 fused_ordering(752) 00:13:51.697 fused_ordering(753) 00:13:51.697 fused_ordering(754) 00:13:51.697 fused_ordering(755) 00:13:51.697 fused_ordering(756) 00:13:51.697 fused_ordering(757) 00:13:51.697 fused_ordering(758) 00:13:51.697 fused_ordering(759) 00:13:51.697 fused_ordering(760) 00:13:51.697 fused_ordering(761) 00:13:51.697 fused_ordering(762) 00:13:51.697 fused_ordering(763) 00:13:51.697 fused_ordering(764) 00:13:51.697 fused_ordering(765) 00:13:51.697 fused_ordering(766) 00:13:51.698 fused_ordering(767) 00:13:51.698 fused_ordering(768) 00:13:51.698 fused_ordering(769) 00:13:51.698 fused_ordering(770) 00:13:51.698 fused_ordering(771) 00:13:51.698 fused_ordering(772) 00:13:51.698 fused_ordering(773) 00:13:51.698 fused_ordering(774) 00:13:51.698 fused_ordering(775) 00:13:51.698 fused_ordering(776) 00:13:51.698 fused_ordering(777) 00:13:51.698 fused_ordering(778) 00:13:51.698 fused_ordering(779) 00:13:51.698 fused_ordering(780) 00:13:51.698 fused_ordering(781) 00:13:51.698 fused_ordering(782) 00:13:51.698 fused_ordering(783) 00:13:51.698 fused_ordering(784) 00:13:51.698 fused_ordering(785) 00:13:51.698 fused_ordering(786) 00:13:51.698 fused_ordering(787) 00:13:51.698 fused_ordering(788) 00:13:51.698 fused_ordering(789) 00:13:51.698 fused_ordering(790) 00:13:51.698 fused_ordering(791) 00:13:51.698 fused_ordering(792) 00:13:51.698 fused_ordering(793) 00:13:51.698 fused_ordering(794) 00:13:51.698 fused_ordering(795) 00:13:51.698 fused_ordering(796) 00:13:51.698 fused_ordering(797) 00:13:51.698 fused_ordering(798) 00:13:51.698 fused_ordering(799) 00:13:51.698 fused_ordering(800) 00:13:51.698 fused_ordering(801) 00:13:51.698 fused_ordering(802) 00:13:51.698 fused_ordering(803) 00:13:51.698 fused_ordering(804) 00:13:51.698 fused_ordering(805) 00:13:51.698 fused_ordering(806) 00:13:51.698 fused_ordering(807) 00:13:51.698 fused_ordering(808) 00:13:51.698 fused_ordering(809) 00:13:51.698 fused_ordering(810) 00:13:51.698 fused_ordering(811) 00:13:51.698 fused_ordering(812) 00:13:51.698 fused_ordering(813) 00:13:51.698 fused_ordering(814) 00:13:51.698 fused_ordering(815) 00:13:51.698 fused_ordering(816) 00:13:51.698 fused_ordering(817) 00:13:51.698 fused_ordering(818) 00:13:51.698 fused_ordering(819) 00:13:51.698 fused_ordering(820) 00:13:52.263 fused_ordering(821) 00:13:52.263 fused_ordering(822) 00:13:52.263 fused_ordering(823) 00:13:52.263 fused_ordering(824) 00:13:52.263 fused_ordering(825) 00:13:52.263 fused_ordering(826) 00:13:52.263 fused_ordering(827) 00:13:52.263 fused_ordering(828) 00:13:52.263 fused_ordering(829) 00:13:52.263 fused_ordering(830) 00:13:52.263 fused_ordering(831) 00:13:52.263 fused_ordering(832) 00:13:52.263 fused_ordering(833) 00:13:52.263 fused_ordering(834) 00:13:52.263 fused_ordering(835) 00:13:52.263 fused_ordering(836) 00:13:52.263 fused_ordering(837) 00:13:52.263 fused_ordering(838) 00:13:52.263 fused_ordering(839) 00:13:52.263 fused_ordering(840) 00:13:52.263 fused_ordering(841) 00:13:52.263 fused_ordering(842) 00:13:52.263 fused_ordering(843) 00:13:52.263 fused_ordering(844) 00:13:52.263 fused_ordering(845) 00:13:52.263 fused_ordering(846) 00:13:52.263 fused_ordering(847) 00:13:52.263 fused_ordering(848) 00:13:52.263 fused_ordering(849) 00:13:52.263 fused_ordering(850) 00:13:52.263 fused_ordering(851) 00:13:52.263 fused_ordering(852) 00:13:52.263 fused_ordering(853) 00:13:52.263 fused_ordering(854) 00:13:52.263 fused_ordering(855) 00:13:52.263 fused_ordering(856) 00:13:52.263 fused_ordering(857) 00:13:52.263 fused_ordering(858) 00:13:52.263 fused_ordering(859) 00:13:52.263 fused_ordering(860) 00:13:52.263 fused_ordering(861) 00:13:52.263 fused_ordering(862) 00:13:52.263 fused_ordering(863) 00:13:52.263 fused_ordering(864) 00:13:52.263 fused_ordering(865) 00:13:52.263 fused_ordering(866) 00:13:52.263 fused_ordering(867) 00:13:52.263 fused_ordering(868) 00:13:52.263 fused_ordering(869) 00:13:52.263 fused_ordering(870) 00:13:52.263 fused_ordering(871) 00:13:52.263 fused_ordering(872) 00:13:52.263 fused_ordering(873) 00:13:52.263 fused_ordering(874) 00:13:52.263 fused_ordering(875) 00:13:52.263 fused_ordering(876) 00:13:52.263 fused_ordering(877) 00:13:52.263 fused_ordering(878) 00:13:52.263 fused_ordering(879) 00:13:52.263 fused_ordering(880) 00:13:52.263 fused_ordering(881) 00:13:52.263 fused_ordering(882) 00:13:52.263 fused_ordering(883) 00:13:52.263 fused_ordering(884) 00:13:52.263 fused_ordering(885) 00:13:52.263 fused_ordering(886) 00:13:52.263 fused_ordering(887) 00:13:52.263 fused_ordering(888) 00:13:52.263 fused_ordering(889) 00:13:52.263 fused_ordering(890) 00:13:52.263 fused_ordering(891) 00:13:52.263 fused_ordering(892) 00:13:52.263 fused_ordering(893) 00:13:52.263 fused_ordering(894) 00:13:52.263 fused_ordering(895) 00:13:52.263 fused_ordering(896) 00:13:52.263 fused_ordering(897) 00:13:52.263 fused_ordering(898) 00:13:52.263 fused_ordering(899) 00:13:52.263 fused_ordering(900) 00:13:52.263 fused_ordering(901) 00:13:52.263 fused_ordering(902) 00:13:52.263 fused_ordering(903) 00:13:52.263 fused_ordering(904) 00:13:52.263 fused_ordering(905) 00:13:52.263 fused_ordering(906) 00:13:52.263 fused_ordering(907) 00:13:52.263 fused_ordering(908) 00:13:52.263 fused_ordering(909) 00:13:52.263 fused_ordering(910) 00:13:52.263 fused_ordering(911) 00:13:52.263 fused_ordering(912) 00:13:52.263 fused_ordering(913) 00:13:52.263 fused_ordering(914) 00:13:52.263 fused_ordering(915) 00:13:52.263 fused_ordering(916) 00:13:52.263 fused_ordering(917) 00:13:52.263 fused_ordering(918) 00:13:52.263 fused_ordering(919) 00:13:52.263 fused_ordering(920) 00:13:52.263 fused_ordering(921) 00:13:52.263 fused_ordering(922) 00:13:52.263 fused_ordering(923) 00:13:52.263 fused_ordering(924) 00:13:52.263 fused_ordering(925) 00:13:52.263 fused_ordering(926) 00:13:52.264 fused_ordering(927) 00:13:52.264 fused_ordering(928) 00:13:52.264 fused_ordering(929) 00:13:52.264 fused_ordering(930) 00:13:52.264 fused_ordering(931) 00:13:52.264 fused_ordering(932) 00:13:52.264 fused_ordering(933) 00:13:52.264 fused_ordering(934) 00:13:52.264 fused_ordering(935) 00:13:52.264 fused_ordering(936) 00:13:52.264 fused_ordering(937) 00:13:52.264 fused_ordering(938) 00:13:52.264 fused_ordering(939) 00:13:52.264 fused_ordering(940) 00:13:52.264 fused_ordering(941) 00:13:52.264 fused_ordering(942) 00:13:52.264 fused_ordering(943) 00:13:52.264 fused_ordering(944) 00:13:52.264 fused_ordering(945) 00:13:52.264 fused_ordering(946) 00:13:52.264 fused_ordering(947) 00:13:52.264 fused_ordering(948) 00:13:52.264 fused_ordering(949) 00:13:52.264 fused_ordering(950) 00:13:52.264 fused_ordering(951) 00:13:52.264 fused_ordering(952) 00:13:52.264 fused_ordering(953) 00:13:52.264 fused_ordering(954) 00:13:52.264 fused_ordering(955) 00:13:52.264 fused_ordering(956) 00:13:52.264 fused_ordering(957) 00:13:52.264 fused_ordering(958) 00:13:52.264 fused_ordering(959) 00:13:52.264 fused_ordering(960) 00:13:52.264 fused_ordering(961) 00:13:52.264 fused_ordering(962) 00:13:52.264 fused_ordering(963) 00:13:52.264 fused_ordering(964) 00:13:52.264 fused_ordering(965) 00:13:52.264 fused_ordering(966) 00:13:52.264 fused_ordering(967) 00:13:52.264 fused_ordering(968) 00:13:52.264 fused_ordering(969) 00:13:52.264 fused_ordering(970) 00:13:52.264 fused_ordering(971) 00:13:52.264 fused_ordering(972) 00:13:52.264 fused_ordering(973) 00:13:52.264 fused_ordering(974) 00:13:52.264 fused_ordering(975) 00:13:52.264 fused_ordering(976) 00:13:52.264 fused_ordering(977) 00:13:52.264 fused_ordering(978) 00:13:52.264 fused_ordering(979) 00:13:52.264 fused_ordering(980) 00:13:52.264 fused_ordering(981) 00:13:52.264 fused_ordering(982) 00:13:52.264 fused_ordering(983) 00:13:52.264 fused_ordering(984) 00:13:52.264 fused_ordering(985) 00:13:52.264 fused_ordering(986) 00:13:52.264 fused_ordering(987) 00:13:52.264 fused_ordering(988) 00:13:52.264 fused_ordering(989) 00:13:52.264 fused_ordering(990) 00:13:52.264 fused_ordering(991) 00:13:52.264 fused_ordering(992) 00:13:52.264 fused_ordering(993) 00:13:52.264 fused_ordering(994) 00:13:52.264 fused_ordering(995) 00:13:52.264 fused_ordering(996) 00:13:52.264 fused_ordering(997) 00:13:52.264 fused_ordering(998) 00:13:52.264 fused_ordering(999) 00:13:52.264 fused_ordering(1000) 00:13:52.264 fused_ordering(1001) 00:13:52.264 fused_ordering(1002) 00:13:52.264 fused_ordering(1003) 00:13:52.264 fused_ordering(1004) 00:13:52.264 fused_ordering(1005) 00:13:52.264 fused_ordering(1006) 00:13:52.264 fused_ordering(1007) 00:13:52.264 fused_ordering(1008) 00:13:52.264 fused_ordering(1009) 00:13:52.264 fused_ordering(1010) 00:13:52.264 fused_ordering(1011) 00:13:52.264 fused_ordering(1012) 00:13:52.264 fused_ordering(1013) 00:13:52.264 fused_ordering(1014) 00:13:52.264 fused_ordering(1015) 00:13:52.264 fused_ordering(1016) 00:13:52.264 fused_ordering(1017) 00:13:52.264 fused_ordering(1018) 00:13:52.264 fused_ordering(1019) 00:13:52.264 fused_ordering(1020) 00:13:52.264 fused_ordering(1021) 00:13:52.264 fused_ordering(1022) 00:13:52.264 fused_ordering(1023) 00:13:52.264 08:21:38 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:52.264 08:21:38 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:52.264 08:21:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.264 08:21:38 -- nvmf/common.sh@116 -- # sync 00:13:52.264 08:21:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.264 08:21:38 -- nvmf/common.sh@119 -- # set +e 00:13:52.264 08:21:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.264 08:21:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.264 rmmod nvme_tcp 00:13:52.264 rmmod nvme_fabrics 00:13:52.264 rmmod nvme_keyring 00:13:52.264 08:21:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.264 08:21:38 -- nvmf/common.sh@123 -- # set -e 00:13:52.264 08:21:38 -- nvmf/common.sh@124 -- # return 0 00:13:52.264 08:21:38 -- nvmf/common.sh@477 -- # '[' -n 928311 ']' 00:13:52.264 08:21:38 -- nvmf/common.sh@478 -- # killprocess 928311 00:13:52.264 08:21:38 -- common/autotest_common.sh@936 -- # '[' -z 928311 ']' 00:13:52.264 08:21:38 -- common/autotest_common.sh@940 -- # kill -0 928311 00:13:52.264 08:21:38 -- common/autotest_common.sh@941 -- # uname 00:13:52.264 08:21:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.264 08:21:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 928311 00:13:52.522 08:21:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.522 08:21:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.522 08:21:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 928311' 00:13:52.522 killing process with pid 928311 00:13:52.522 08:21:38 -- common/autotest_common.sh@955 -- # kill 928311 00:13:52.522 08:21:38 -- common/autotest_common.sh@960 -- # wait 928311 00:13:52.782 08:21:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.782 08:21:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.782 08:21:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.782 08:21:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.782 08:21:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.782 08:21:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.782 08:21:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.782 08:21:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.688 08:21:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:54.688 00:13:54.688 real 0m8.424s 00:13:54.688 user 0m6.159s 00:13:54.688 sys 0m3.322s 00:13:54.688 08:21:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:54.688 08:21:40 -- common/autotest_common.sh@10 -- # set +x 00:13:54.688 ************************************ 00:13:54.688 END TEST nvmf_fused_ordering 00:13:54.688 ************************************ 00:13:54.688 08:21:40 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:54.688 08:21:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:54.688 08:21:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:54.688 08:21:40 -- common/autotest_common.sh@10 -- # set +x 00:13:54.688 ************************************ 00:13:54.688 START TEST nvmf_delete_subsystem 00:13:54.688 ************************************ 00:13:54.688 08:21:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:54.688 * Looking for test storage... 00:13:54.688 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:54.688 08:21:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:54.688 08:21:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:54.688 08:21:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:54.947 08:21:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:54.947 08:21:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:54.947 08:21:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:54.947 08:21:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:54.947 08:21:40 -- scripts/common.sh@335 -- # IFS=.-: 00:13:54.947 08:21:40 -- scripts/common.sh@335 -- # read -ra ver1 00:13:54.947 08:21:40 -- scripts/common.sh@336 -- # IFS=.-: 00:13:54.947 08:21:40 -- scripts/common.sh@336 -- # read -ra ver2 00:13:54.947 08:21:40 -- scripts/common.sh@337 -- # local 'op=<' 00:13:54.947 08:21:40 -- scripts/common.sh@339 -- # ver1_l=2 00:13:54.947 08:21:40 -- scripts/common.sh@340 -- # ver2_l=1 00:13:54.947 08:21:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:54.947 08:21:40 -- scripts/common.sh@343 -- # case "$op" in 00:13:54.947 08:21:40 -- scripts/common.sh@344 -- # : 1 00:13:54.947 08:21:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:54.947 08:21:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:54.947 08:21:40 -- scripts/common.sh@364 -- # decimal 1 00:13:54.947 08:21:40 -- scripts/common.sh@352 -- # local d=1 00:13:54.947 08:21:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:54.947 08:21:40 -- scripts/common.sh@354 -- # echo 1 00:13:54.947 08:21:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:54.947 08:21:40 -- scripts/common.sh@365 -- # decimal 2 00:13:54.947 08:21:40 -- scripts/common.sh@352 -- # local d=2 00:13:54.947 08:21:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:54.947 08:21:40 -- scripts/common.sh@354 -- # echo 2 00:13:54.947 08:21:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:54.947 08:21:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:54.947 08:21:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:54.947 08:21:40 -- scripts/common.sh@367 -- # return 0 00:13:54.947 08:21:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:54.947 08:21:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:54.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.947 --rc genhtml_branch_coverage=1 00:13:54.947 --rc genhtml_function_coverage=1 00:13:54.947 --rc genhtml_legend=1 00:13:54.947 --rc geninfo_all_blocks=1 00:13:54.947 --rc geninfo_unexecuted_blocks=1 00:13:54.947 00:13:54.947 ' 00:13:54.947 08:21:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:54.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.947 --rc genhtml_branch_coverage=1 00:13:54.947 --rc genhtml_function_coverage=1 00:13:54.947 --rc genhtml_legend=1 00:13:54.947 --rc geninfo_all_blocks=1 00:13:54.947 --rc geninfo_unexecuted_blocks=1 00:13:54.947 00:13:54.947 ' 00:13:54.947 08:21:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:54.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.947 --rc genhtml_branch_coverage=1 00:13:54.947 --rc genhtml_function_coverage=1 00:13:54.947 --rc genhtml_legend=1 00:13:54.947 --rc geninfo_all_blocks=1 00:13:54.947 --rc geninfo_unexecuted_blocks=1 00:13:54.947 00:13:54.947 ' 00:13:54.947 08:21:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:54.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.947 --rc genhtml_branch_coverage=1 00:13:54.947 --rc genhtml_function_coverage=1 00:13:54.947 --rc genhtml_legend=1 00:13:54.947 --rc geninfo_all_blocks=1 00:13:54.947 --rc geninfo_unexecuted_blocks=1 00:13:54.947 00:13:54.947 ' 00:13:54.947 08:21:40 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:54.947 08:21:40 -- nvmf/common.sh@7 -- # uname -s 00:13:54.947 08:21:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:54.947 08:21:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:54.947 08:21:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:54.947 08:21:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:54.947 08:21:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:54.947 08:21:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:54.947 08:21:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:54.947 08:21:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:54.947 08:21:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:54.947 08:21:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:54.947 08:21:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:54.947 08:21:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:54.947 08:21:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:54.947 08:21:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:54.947 08:21:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:54.947 08:21:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:54.947 08:21:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:54.947 08:21:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:54.947 08:21:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:54.948 08:21:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.948 08:21:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.948 08:21:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.948 08:21:40 -- paths/export.sh@5 -- # export PATH 00:13:54.948 08:21:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.948 08:21:40 -- nvmf/common.sh@46 -- # : 0 00:13:54.948 08:21:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:54.948 08:21:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:54.948 08:21:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:54.948 08:21:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:54.948 08:21:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:54.948 08:21:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:54.948 08:21:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:54.948 08:21:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:54.948 08:21:40 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:54.948 08:21:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:54.948 08:21:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:54.948 08:21:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:54.948 08:21:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:54.948 08:21:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:54.948 08:21:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:54.948 08:21:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:54.948 08:21:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.948 08:21:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:54.948 08:21:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:54.948 08:21:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:54.948 08:21:40 -- common/autotest_common.sh@10 -- # set +x 00:13:56.851 08:21:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:56.851 08:21:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:56.851 08:21:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:56.851 08:21:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:56.851 08:21:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:56.851 08:21:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:56.851 08:21:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:56.851 08:21:42 -- nvmf/common.sh@294 -- # net_devs=() 00:13:56.851 08:21:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:56.851 08:21:42 -- nvmf/common.sh@295 -- # e810=() 00:13:56.851 08:21:42 -- nvmf/common.sh@295 -- # local -ga e810 00:13:56.851 08:21:42 -- nvmf/common.sh@296 -- # x722=() 00:13:56.851 08:21:42 -- nvmf/common.sh@296 -- # local -ga x722 00:13:56.851 08:21:42 -- nvmf/common.sh@297 -- # mlx=() 00:13:56.851 08:21:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:56.851 08:21:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:56.851 08:21:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:56.851 08:21:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:56.851 08:21:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:56.851 08:21:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.851 08:21:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:56.851 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:56.851 08:21:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.851 08:21:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:56.851 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:56.851 08:21:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:56.851 08:21:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:56.851 08:21:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.851 08:21:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.851 08:21:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.851 08:21:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.851 08:21:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:56.851 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:56.851 08:21:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.851 08:21:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.851 08:21:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.851 08:21:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.852 08:21:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.852 08:21:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:56.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:56.852 08:21:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.852 08:21:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:56.852 08:21:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:56.852 08:21:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:56.852 08:21:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:56.852 08:21:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:56.852 08:21:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:56.852 08:21:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:56.852 08:21:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:56.852 08:21:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:56.852 08:21:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:56.852 08:21:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:56.852 08:21:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:56.852 08:21:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:56.852 08:21:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:56.852 08:21:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:56.852 08:21:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:56.852 08:21:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:56.852 08:21:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:56.852 08:21:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:56.852 08:21:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:56.852 08:21:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:56.852 08:21:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:56.852 08:21:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:56.852 08:21:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:56.852 08:21:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:56.852 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:56.852 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:13:56.852 00:13:56.852 --- 10.0.0.2 ping statistics --- 00:13:56.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.852 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:13:56.852 08:21:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:56.852 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:56.852 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:13:56.852 00:13:56.852 --- 10.0.0.1 ping statistics --- 00:13:56.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.852 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:13:56.852 08:21:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:56.852 08:21:42 -- nvmf/common.sh@410 -- # return 0 00:13:56.852 08:21:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:56.852 08:21:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:56.852 08:21:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:56.852 08:21:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:56.852 08:21:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:56.852 08:21:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:56.852 08:21:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.111 08:21:42 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:57.111 08:21:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.111 08:21:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.111 08:21:42 -- common/autotest_common.sh@10 -- # set +x 00:13:57.111 08:21:42 -- nvmf/common.sh@469 -- # nvmfpid=930693 00:13:57.111 08:21:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:57.111 08:21:42 -- nvmf/common.sh@470 -- # waitforlisten 930693 00:13:57.111 08:21:42 -- common/autotest_common.sh@829 -- # '[' -z 930693 ']' 00:13:57.111 08:21:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.111 08:21:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.111 08:21:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.111 08:21:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.111 08:21:42 -- common/autotest_common.sh@10 -- # set +x 00:13:57.111 [2024-11-26 08:21:42.779904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:57.111 [2024-11-26 08:21:42.779987] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.111 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.111 [2024-11-26 08:21:42.843525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:57.111 [2024-11-26 08:21:42.949080] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.111 [2024-11-26 08:21:42.949257] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.111 [2024-11-26 08:21:42.949289] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.111 [2024-11-26 08:21:42.949302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.111 [2024-11-26 08:21:42.949374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:57.111 [2024-11-26 08:21:42.949379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.046 08:21:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.046 08:21:43 -- common/autotest_common.sh@862 -- # return 0 00:13:58.046 08:21:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.046 08:21:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 08:21:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 [2024-11-26 08:21:43.780891] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 [2024-11-26 08:21:43.797124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 NULL1 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 Delay0 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.046 08:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.046 08:21:43 -- common/autotest_common.sh@10 -- # set +x 00:13:58.046 08:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@28 -- # perf_pid=930850 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:58.046 08:21:43 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:58.046 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.046 [2024-11-26 08:21:43.871774] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:59.995 08:21:45 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:59.995 08:21:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.995 08:21:45 -- common/autotest_common.sh@10 -- # set +x 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 [2024-11-26 08:21:46.122739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x55e770 is same with the state(5) to be set 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 Write completed with error (sct=0, sc=8) 00:14:00.567 starting I/O failed: -6 00:14:00.567 Read completed with error (sct=0, sc=8) 00:14:00.567 [2024-11-26 08:21:46.123649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9354000c00 is same with the state(5) to be set 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:00.568 Write completed with error (sct=0, sc=8) 00:14:00.568 Read completed with error (sct=0, sc=8) 00:14:01.507 [2024-11-26 08:21:47.091986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x577960 is same with the state(5) to be set 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 [2024-11-26 08:21:47.118871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f935400c480 is same with the state(5) to be set 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 [2024-11-26 08:21:47.121816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f935400bf20 is same with the state(5) to be set 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 [2024-11-26 08:21:47.122423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x55e4c0 is same with the state(5) to be set 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 Write completed with error (sct=0, sc=8) 00:14:01.507 Read completed with error (sct=0, sc=8) 00:14:01.507 [2024-11-26 08:21:47.122588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x55ea20 is same with the state(5) to be set 00:14:01.507 [2024-11-26 08:21:47.123474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x577960 (9): Bad file descriptor 00:14:01.507 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:01.507 08:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.507 08:21:47 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:01.508 08:21:47 -- target/delete_subsystem.sh@35 -- # kill -0 930850 00:14:01.508 08:21:47 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:01.508 Initializing NVMe Controllers 00:14:01.508 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:01.508 Controller IO queue size 128, less than required. 00:14:01.508 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:01.508 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:01.508 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:01.508 Initialization complete. Launching workers. 00:14:01.508 ======================================================== 00:14:01.508 Latency(us) 00:14:01.508 Device Information : IOPS MiB/s Average min max 00:14:01.508 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 165.80 0.08 903363.44 393.78 1011251.84 00:14:01.508 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 154.88 0.08 970131.61 368.23 1996961.69 00:14:01.508 ======================================================== 00:14:01.508 Total : 320.68 0.16 935610.60 368.23 1996961.69 00:14:01.508 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@35 -- # kill -0 930850 00:14:02.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (930850) - No such process 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@45 -- # NOT wait 930850 00:14:02.077 08:21:47 -- common/autotest_common.sh@650 -- # local es=0 00:14:02.077 08:21:47 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 930850 00:14:02.077 08:21:47 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:02.077 08:21:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:02.077 08:21:47 -- common/autotest_common.sh@642 -- # type -t wait 00:14:02.077 08:21:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:02.077 08:21:47 -- common/autotest_common.sh@653 -- # wait 930850 00:14:02.077 08:21:47 -- common/autotest_common.sh@653 -- # es=1 00:14:02.077 08:21:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:02.077 08:21:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:02.077 08:21:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:02.077 08:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.077 08:21:47 -- common/autotest_common.sh@10 -- # set +x 00:14:02.077 08:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:02.077 08:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.077 08:21:47 -- common/autotest_common.sh@10 -- # set +x 00:14:02.077 [2024-11-26 08:21:47.643391] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:02.077 08:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.077 08:21:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.077 08:21:47 -- common/autotest_common.sh@10 -- # set +x 00:14:02.077 08:21:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@54 -- # perf_pid=931337 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:02.077 08:21:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.077 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.077 [2024-11-26 08:21:47.704093] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:02.336 08:21:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.336 08:21:48 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:02.336 08:21:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.904 08:21:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.904 08:21:48 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:02.904 08:21:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.474 08:21:49 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.474 08:21:49 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:03.474 08:21:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.041 08:21:49 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.041 08:21:49 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:04.041 08:21:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.611 08:21:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.612 08:21:50 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:04.612 08:21:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.871 08:21:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.871 08:21:50 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:04.871 08:21:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:05.130 Initializing NVMe Controllers 00:14:05.130 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:05.130 Controller IO queue size 128, less than required. 00:14:05.130 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:05.130 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:05.130 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:05.130 Initialization complete. Launching workers. 00:14:05.130 ======================================================== 00:14:05.130 Latency(us) 00:14:05.130 Device Information : IOPS MiB/s Average min max 00:14:05.130 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003557.75 1000202.37 1014670.74 00:14:05.130 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1006936.41 1000219.83 1046142.70 00:14:05.130 ======================================================== 00:14:05.130 Total : 256.00 0.12 1005247.08 1000202.37 1046142.70 00:14:05.130 00:14:05.389 08:21:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:05.389 08:21:51 -- target/delete_subsystem.sh@57 -- # kill -0 931337 00:14:05.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (931337) - No such process 00:14:05.389 08:21:51 -- target/delete_subsystem.sh@67 -- # wait 931337 00:14:05.389 08:21:51 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:05.389 08:21:51 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:05.389 08:21:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:05.389 08:21:51 -- nvmf/common.sh@116 -- # sync 00:14:05.389 08:21:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:05.389 08:21:51 -- nvmf/common.sh@119 -- # set +e 00:14:05.389 08:21:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:05.389 08:21:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:05.389 rmmod nvme_tcp 00:14:05.389 rmmod nvme_fabrics 00:14:05.389 rmmod nvme_keyring 00:14:05.389 08:21:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:05.389 08:21:51 -- nvmf/common.sh@123 -- # set -e 00:14:05.389 08:21:51 -- nvmf/common.sh@124 -- # return 0 00:14:05.389 08:21:51 -- nvmf/common.sh@477 -- # '[' -n 930693 ']' 00:14:05.389 08:21:51 -- nvmf/common.sh@478 -- # killprocess 930693 00:14:05.389 08:21:51 -- common/autotest_common.sh@936 -- # '[' -z 930693 ']' 00:14:05.389 08:21:51 -- common/autotest_common.sh@940 -- # kill -0 930693 00:14:05.389 08:21:51 -- common/autotest_common.sh@941 -- # uname 00:14:05.389 08:21:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:05.389 08:21:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 930693 00:14:05.649 08:21:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:05.649 08:21:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:05.649 08:21:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 930693' 00:14:05.649 killing process with pid 930693 00:14:05.649 08:21:51 -- common/autotest_common.sh@955 -- # kill 930693 00:14:05.649 08:21:51 -- common/autotest_common.sh@960 -- # wait 930693 00:14:05.910 08:21:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:05.910 08:21:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:05.910 08:21:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:05.910 08:21:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:05.910 08:21:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:05.910 08:21:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.910 08:21:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.910 08:21:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.815 08:21:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:07.815 00:14:07.815 real 0m13.130s 00:14:07.815 user 0m29.794s 00:14:07.815 sys 0m2.989s 00:14:07.815 08:21:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:07.815 08:21:53 -- common/autotest_common.sh@10 -- # set +x 00:14:07.815 ************************************ 00:14:07.815 END TEST nvmf_delete_subsystem 00:14:07.815 ************************************ 00:14:07.815 08:21:53 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:07.815 08:21:53 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:07.815 08:21:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:07.815 08:21:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:07.815 08:21:53 -- common/autotest_common.sh@10 -- # set +x 00:14:07.815 ************************************ 00:14:07.815 START TEST nvmf_nvme_cli 00:14:07.815 ************************************ 00:14:07.815 08:21:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:08.074 * Looking for test storage... 00:14:08.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:08.074 08:21:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:08.074 08:21:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:08.074 08:21:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:08.074 08:21:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:08.075 08:21:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:08.075 08:21:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:08.075 08:21:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:08.075 08:21:53 -- scripts/common.sh@335 -- # IFS=.-: 00:14:08.075 08:21:53 -- scripts/common.sh@335 -- # read -ra ver1 00:14:08.075 08:21:53 -- scripts/common.sh@336 -- # IFS=.-: 00:14:08.075 08:21:53 -- scripts/common.sh@336 -- # read -ra ver2 00:14:08.075 08:21:53 -- scripts/common.sh@337 -- # local 'op=<' 00:14:08.075 08:21:53 -- scripts/common.sh@339 -- # ver1_l=2 00:14:08.075 08:21:53 -- scripts/common.sh@340 -- # ver2_l=1 00:14:08.075 08:21:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:08.075 08:21:53 -- scripts/common.sh@343 -- # case "$op" in 00:14:08.075 08:21:53 -- scripts/common.sh@344 -- # : 1 00:14:08.075 08:21:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:08.075 08:21:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:08.075 08:21:53 -- scripts/common.sh@364 -- # decimal 1 00:14:08.075 08:21:53 -- scripts/common.sh@352 -- # local d=1 00:14:08.075 08:21:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:08.075 08:21:53 -- scripts/common.sh@354 -- # echo 1 00:14:08.075 08:21:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:08.075 08:21:53 -- scripts/common.sh@365 -- # decimal 2 00:14:08.075 08:21:53 -- scripts/common.sh@352 -- # local d=2 00:14:08.075 08:21:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:08.075 08:21:53 -- scripts/common.sh@354 -- # echo 2 00:14:08.075 08:21:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:08.075 08:21:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:08.075 08:21:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:08.075 08:21:53 -- scripts/common.sh@367 -- # return 0 00:14:08.075 08:21:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:08.075 08:21:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:08.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.075 --rc genhtml_branch_coverage=1 00:14:08.075 --rc genhtml_function_coverage=1 00:14:08.075 --rc genhtml_legend=1 00:14:08.075 --rc geninfo_all_blocks=1 00:14:08.075 --rc geninfo_unexecuted_blocks=1 00:14:08.075 00:14:08.075 ' 00:14:08.075 08:21:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:08.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.075 --rc genhtml_branch_coverage=1 00:14:08.075 --rc genhtml_function_coverage=1 00:14:08.075 --rc genhtml_legend=1 00:14:08.075 --rc geninfo_all_blocks=1 00:14:08.075 --rc geninfo_unexecuted_blocks=1 00:14:08.075 00:14:08.075 ' 00:14:08.075 08:21:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:08.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.075 --rc genhtml_branch_coverage=1 00:14:08.075 --rc genhtml_function_coverage=1 00:14:08.075 --rc genhtml_legend=1 00:14:08.075 --rc geninfo_all_blocks=1 00:14:08.075 --rc geninfo_unexecuted_blocks=1 00:14:08.075 00:14:08.075 ' 00:14:08.075 08:21:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:08.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.075 --rc genhtml_branch_coverage=1 00:14:08.075 --rc genhtml_function_coverage=1 00:14:08.075 --rc genhtml_legend=1 00:14:08.075 --rc geninfo_all_blocks=1 00:14:08.075 --rc geninfo_unexecuted_blocks=1 00:14:08.075 00:14:08.075 ' 00:14:08.075 08:21:53 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:08.075 08:21:53 -- nvmf/common.sh@7 -- # uname -s 00:14:08.075 08:21:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:08.075 08:21:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:08.075 08:21:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:08.075 08:21:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:08.075 08:21:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:08.075 08:21:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:08.075 08:21:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:08.075 08:21:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:08.075 08:21:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:08.075 08:21:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:08.075 08:21:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.075 08:21:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.075 08:21:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:08.075 08:21:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:08.075 08:21:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:08.075 08:21:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:08.075 08:21:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:08.075 08:21:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:08.075 08:21:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:08.075 08:21:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.075 08:21:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.075 08:21:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.075 08:21:53 -- paths/export.sh@5 -- # export PATH 00:14:08.075 08:21:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.075 08:21:53 -- nvmf/common.sh@46 -- # : 0 00:14:08.075 08:21:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:08.075 08:21:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:08.075 08:21:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:08.075 08:21:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:08.075 08:21:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:08.075 08:21:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:08.075 08:21:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:08.075 08:21:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:08.075 08:21:53 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:08.075 08:21:53 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:08.075 08:21:53 -- target/nvme_cli.sh@14 -- # devs=() 00:14:08.075 08:21:53 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:08.075 08:21:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:08.075 08:21:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:08.075 08:21:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:08.075 08:21:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:08.075 08:21:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:08.075 08:21:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.075 08:21:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.075 08:21:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.075 08:21:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:08.075 08:21:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:08.075 08:21:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:08.075 08:21:53 -- common/autotest_common.sh@10 -- # set +x 00:14:09.982 08:21:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:09.982 08:21:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:09.982 08:21:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:09.982 08:21:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:09.982 08:21:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:09.982 08:21:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:09.982 08:21:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:09.982 08:21:55 -- nvmf/common.sh@294 -- # net_devs=() 00:14:09.982 08:21:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:09.982 08:21:55 -- nvmf/common.sh@295 -- # e810=() 00:14:09.982 08:21:55 -- nvmf/common.sh@295 -- # local -ga e810 00:14:09.982 08:21:55 -- nvmf/common.sh@296 -- # x722=() 00:14:09.982 08:21:55 -- nvmf/common.sh@296 -- # local -ga x722 00:14:09.982 08:21:55 -- nvmf/common.sh@297 -- # mlx=() 00:14:09.982 08:21:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:09.982 08:21:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:09.982 08:21:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:09.982 08:21:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:09.982 08:21:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.982 08:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:09.982 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:09.982 08:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.982 08:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:09.982 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:09.982 08:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.982 08:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.982 08:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.982 08:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:09.982 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:09.982 08:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.982 08:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.982 08:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.982 08:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.982 08:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:09.982 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:09.982 08:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.982 08:21:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:09.982 08:21:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:09.982 08:21:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:09.982 08:21:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:09.982 08:21:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:09.982 08:21:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:09.982 08:21:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:09.982 08:21:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:09.982 08:21:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:09.982 08:21:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:09.982 08:21:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:09.982 08:21:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:09.982 08:21:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:09.982 08:21:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:09.982 08:21:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:09.982 08:21:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:10.243 08:21:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:10.243 08:21:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:10.243 08:21:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:10.243 08:21:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:10.243 08:21:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:10.243 08:21:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:10.243 08:21:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:10.243 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:10.243 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:14:10.243 00:14:10.243 --- 10.0.0.2 ping statistics --- 00:14:10.243 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.243 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:14:10.244 08:21:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:10.244 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:10.244 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:14:10.244 00:14:10.244 --- 10.0.0.1 ping statistics --- 00:14:10.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.244 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:14:10.244 08:21:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:10.244 08:21:55 -- nvmf/common.sh@410 -- # return 0 00:14:10.244 08:21:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:10.244 08:21:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:10.244 08:21:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:10.244 08:21:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:10.244 08:21:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:10.244 08:21:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:10.244 08:21:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:10.244 08:21:55 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:10.244 08:21:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:10.244 08:21:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:10.244 08:21:55 -- common/autotest_common.sh@10 -- # set +x 00:14:10.244 08:21:55 -- nvmf/common.sh@469 -- # nvmfpid=933763 00:14:10.244 08:21:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:10.244 08:21:55 -- nvmf/common.sh@470 -- # waitforlisten 933763 00:14:10.244 08:21:55 -- common/autotest_common.sh@829 -- # '[' -z 933763 ']' 00:14:10.244 08:21:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:10.244 08:21:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:10.244 08:21:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:10.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:10.244 08:21:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:10.244 08:21:55 -- common/autotest_common.sh@10 -- # set +x 00:14:10.244 [2024-11-26 08:21:55.977260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:10.244 [2024-11-26 08:21:55.977343] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:10.244 EAL: No free 2048 kB hugepages reported on node 1 00:14:10.244 [2024-11-26 08:21:56.041414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:10.504 [2024-11-26 08:21:56.152377] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:10.504 [2024-11-26 08:21:56.152547] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:10.504 [2024-11-26 08:21:56.152565] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:10.504 [2024-11-26 08:21:56.152577] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:10.504 [2024-11-26 08:21:56.152647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:10.504 [2024-11-26 08:21:56.152707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:10.504 [2024-11-26 08:21:56.152768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:10.504 [2024-11-26 08:21:56.152771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.442 08:21:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:11.442 08:21:56 -- common/autotest_common.sh@862 -- # return 0 00:14:11.442 08:21:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:11.442 08:21:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.442 08:21:56 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 08:21:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.442 08:21:56 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:11.442 08:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:56 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 [2024-11-26 08:21:56.982332] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:11.442 08:21:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:56 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:11.442 08:21:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:56 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 Malloc0 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 Malloc1 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 [2024-11-26 08:21:57.066227] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:11.442 08:21:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.442 08:21:57 -- common/autotest_common.sh@10 -- # set +x 00:14:11.442 08:21:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.442 08:21:57 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:11.442 00:14:11.442 Discovery Log Number of Records 2, Generation counter 2 00:14:11.442 =====Discovery Log Entry 0====== 00:14:11.442 trtype: tcp 00:14:11.442 adrfam: ipv4 00:14:11.442 subtype: current discovery subsystem 00:14:11.442 treq: not required 00:14:11.442 portid: 0 00:14:11.442 trsvcid: 4420 00:14:11.442 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:11.442 traddr: 10.0.0.2 00:14:11.442 eflags: explicit discovery connections, duplicate discovery information 00:14:11.442 sectype: none 00:14:11.442 =====Discovery Log Entry 1====== 00:14:11.442 trtype: tcp 00:14:11.442 adrfam: ipv4 00:14:11.442 subtype: nvme subsystem 00:14:11.442 treq: not required 00:14:11.442 portid: 0 00:14:11.442 trsvcid: 4420 00:14:11.442 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:11.442 traddr: 10.0.0.2 00:14:11.442 eflags: none 00:14:11.442 sectype: none 00:14:11.442 08:21:57 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:11.442 08:21:57 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:11.442 08:21:57 -- nvmf/common.sh@510 -- # local dev _ 00:14:11.442 08:21:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 08:21:57 -- nvmf/common.sh@509 -- # nvme list 00:14:11.442 08:21:57 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:11.442 08:21:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 08:21:57 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:11.442 08:21:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 08:21:57 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:11.442 08:21:57 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:12.380 08:21:57 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:12.380 08:21:57 -- common/autotest_common.sh@1187 -- # local i=0 00:14:12.380 08:21:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:12.380 08:21:57 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:12.380 08:21:57 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:12.380 08:21:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:14.289 08:21:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:14.289 08:21:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:14.289 08:21:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:14.289 08:21:59 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:14.289 08:21:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:14.289 08:21:59 -- common/autotest_common.sh@1197 -- # return 0 00:14:14.289 08:21:59 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:14.289 08:21:59 -- nvmf/common.sh@510 -- # local dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@509 -- # nvme list 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:14.289 /dev/nvme0n2 ]] 00:14:14.289 08:21:59 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:14.289 08:21:59 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:14.289 08:21:59 -- nvmf/common.sh@510 -- # local dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@509 -- # nvme list 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.289 08:21:59 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.289 08:21:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.289 08:21:59 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:14.289 08:21:59 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:14.289 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:14.289 08:22:00 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:14.289 08:22:00 -- common/autotest_common.sh@1208 -- # local i=0 00:14:14.289 08:22:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:14.289 08:22:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.289 08:22:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:14.289 08:22:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.289 08:22:00 -- common/autotest_common.sh@1220 -- # return 0 00:14:14.289 08:22:00 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:14.289 08:22:00 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:14.289 08:22:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.289 08:22:00 -- common/autotest_common.sh@10 -- # set +x 00:14:14.289 08:22:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.289 08:22:00 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:14.289 08:22:00 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:14.289 08:22:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:14.289 08:22:00 -- nvmf/common.sh@116 -- # sync 00:14:14.289 08:22:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:14.289 08:22:00 -- nvmf/common.sh@119 -- # set +e 00:14:14.289 08:22:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:14.289 08:22:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:14.289 rmmod nvme_tcp 00:14:14.289 rmmod nvme_fabrics 00:14:14.289 rmmod nvme_keyring 00:14:14.550 08:22:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:14.550 08:22:00 -- nvmf/common.sh@123 -- # set -e 00:14:14.550 08:22:00 -- nvmf/common.sh@124 -- # return 0 00:14:14.550 08:22:00 -- nvmf/common.sh@477 -- # '[' -n 933763 ']' 00:14:14.550 08:22:00 -- nvmf/common.sh@478 -- # killprocess 933763 00:14:14.550 08:22:00 -- common/autotest_common.sh@936 -- # '[' -z 933763 ']' 00:14:14.550 08:22:00 -- common/autotest_common.sh@940 -- # kill -0 933763 00:14:14.550 08:22:00 -- common/autotest_common.sh@941 -- # uname 00:14:14.550 08:22:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:14.550 08:22:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 933763 00:14:14.550 08:22:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:14.550 08:22:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:14.550 08:22:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 933763' 00:14:14.550 killing process with pid 933763 00:14:14.550 08:22:00 -- common/autotest_common.sh@955 -- # kill 933763 00:14:14.550 08:22:00 -- common/autotest_common.sh@960 -- # wait 933763 00:14:14.811 08:22:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:14.811 08:22:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:14.811 08:22:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:14.811 08:22:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:14.811 08:22:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:14.811 08:22:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.811 08:22:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.811 08:22:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.351 08:22:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:17.351 00:14:17.351 real 0m8.957s 00:14:17.351 user 0m18.132s 00:14:17.351 sys 0m2.200s 00:14:17.351 08:22:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:17.351 08:22:02 -- common/autotest_common.sh@10 -- # set +x 00:14:17.351 ************************************ 00:14:17.351 END TEST nvmf_nvme_cli 00:14:17.351 ************************************ 00:14:17.351 08:22:02 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:17.351 08:22:02 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.351 08:22:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:17.351 08:22:02 -- common/autotest_common.sh@10 -- # set +x 00:14:17.351 ************************************ 00:14:17.351 START TEST nvmf_host_management 00:14:17.351 ************************************ 00:14:17.351 08:22:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.351 * Looking for test storage... 00:14:17.351 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:17.351 08:22:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:17.351 08:22:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:17.351 08:22:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:17.351 08:22:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:17.351 08:22:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:17.351 08:22:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:17.351 08:22:02 -- scripts/common.sh@335 -- # IFS=.-: 00:14:17.351 08:22:02 -- scripts/common.sh@335 -- # read -ra ver1 00:14:17.351 08:22:02 -- scripts/common.sh@336 -- # IFS=.-: 00:14:17.351 08:22:02 -- scripts/common.sh@336 -- # read -ra ver2 00:14:17.351 08:22:02 -- scripts/common.sh@337 -- # local 'op=<' 00:14:17.351 08:22:02 -- scripts/common.sh@339 -- # ver1_l=2 00:14:17.351 08:22:02 -- scripts/common.sh@340 -- # ver2_l=1 00:14:17.351 08:22:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:17.351 08:22:02 -- scripts/common.sh@343 -- # case "$op" in 00:14:17.351 08:22:02 -- scripts/common.sh@344 -- # : 1 00:14:17.351 08:22:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:17.351 08:22:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:17.351 08:22:02 -- scripts/common.sh@364 -- # decimal 1 00:14:17.351 08:22:02 -- scripts/common.sh@352 -- # local d=1 00:14:17.351 08:22:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:17.351 08:22:02 -- scripts/common.sh@354 -- # echo 1 00:14:17.351 08:22:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:17.351 08:22:02 -- scripts/common.sh@365 -- # decimal 2 00:14:17.351 08:22:02 -- scripts/common.sh@352 -- # local d=2 00:14:17.351 08:22:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:17.351 08:22:02 -- scripts/common.sh@354 -- # echo 2 00:14:17.351 08:22:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:17.351 08:22:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:17.351 08:22:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:17.351 08:22:02 -- scripts/common.sh@367 -- # return 0 00:14:17.351 08:22:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:17.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.351 --rc genhtml_branch_coverage=1 00:14:17.351 --rc genhtml_function_coverage=1 00:14:17.351 --rc genhtml_legend=1 00:14:17.351 --rc geninfo_all_blocks=1 00:14:17.351 --rc geninfo_unexecuted_blocks=1 00:14:17.351 00:14:17.351 ' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:17.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.351 --rc genhtml_branch_coverage=1 00:14:17.351 --rc genhtml_function_coverage=1 00:14:17.351 --rc genhtml_legend=1 00:14:17.351 --rc geninfo_all_blocks=1 00:14:17.351 --rc geninfo_unexecuted_blocks=1 00:14:17.351 00:14:17.351 ' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:17.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.351 --rc genhtml_branch_coverage=1 00:14:17.351 --rc genhtml_function_coverage=1 00:14:17.351 --rc genhtml_legend=1 00:14:17.351 --rc geninfo_all_blocks=1 00:14:17.351 --rc geninfo_unexecuted_blocks=1 00:14:17.351 00:14:17.351 ' 00:14:17.351 08:22:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:17.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.351 --rc genhtml_branch_coverage=1 00:14:17.351 --rc genhtml_function_coverage=1 00:14:17.351 --rc genhtml_legend=1 00:14:17.351 --rc geninfo_all_blocks=1 00:14:17.351 --rc geninfo_unexecuted_blocks=1 00:14:17.351 00:14:17.351 ' 00:14:17.351 08:22:02 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:17.351 08:22:02 -- nvmf/common.sh@7 -- # uname -s 00:14:17.351 08:22:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:17.351 08:22:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:17.351 08:22:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:17.351 08:22:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:17.351 08:22:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:17.351 08:22:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:17.351 08:22:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:17.351 08:22:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:17.351 08:22:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:17.351 08:22:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:17.351 08:22:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.351 08:22:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.351 08:22:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:17.351 08:22:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:17.351 08:22:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:17.351 08:22:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:17.351 08:22:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:17.351 08:22:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:17.351 08:22:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:17.351 08:22:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.351 08:22:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.351 08:22:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.351 08:22:02 -- paths/export.sh@5 -- # export PATH 00:14:17.351 08:22:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.351 08:22:02 -- nvmf/common.sh@46 -- # : 0 00:14:17.351 08:22:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:17.351 08:22:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:17.351 08:22:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:17.351 08:22:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:17.351 08:22:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:17.351 08:22:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:17.351 08:22:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:17.351 08:22:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:17.351 08:22:02 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:17.351 08:22:02 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:17.351 08:22:02 -- target/host_management.sh@104 -- # nvmftestinit 00:14:17.351 08:22:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:17.351 08:22:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:17.351 08:22:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:17.351 08:22:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:17.351 08:22:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:17.351 08:22:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.351 08:22:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.351 08:22:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.351 08:22:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:17.351 08:22:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:17.351 08:22:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:17.351 08:22:02 -- common/autotest_common.sh@10 -- # set +x 00:14:19.254 08:22:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:19.254 08:22:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:19.254 08:22:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:19.254 08:22:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:19.254 08:22:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:19.254 08:22:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:19.254 08:22:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:19.254 08:22:04 -- nvmf/common.sh@294 -- # net_devs=() 00:14:19.254 08:22:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:19.254 08:22:04 -- nvmf/common.sh@295 -- # e810=() 00:14:19.254 08:22:04 -- nvmf/common.sh@295 -- # local -ga e810 00:14:19.254 08:22:04 -- nvmf/common.sh@296 -- # x722=() 00:14:19.254 08:22:04 -- nvmf/common.sh@296 -- # local -ga x722 00:14:19.254 08:22:04 -- nvmf/common.sh@297 -- # mlx=() 00:14:19.254 08:22:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:19.254 08:22:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:19.254 08:22:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:19.254 08:22:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:19.255 08:22:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.255 08:22:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:19.255 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:19.255 08:22:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.255 08:22:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:19.255 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:19.255 08:22:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.255 08:22:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.255 08:22:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.255 08:22:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:19.255 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:19.255 08:22:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.255 08:22:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.255 08:22:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.255 08:22:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.255 08:22:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:19.255 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:19.255 08:22:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.255 08:22:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:19.255 08:22:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:19.255 08:22:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:19.255 08:22:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:19.255 08:22:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:19.255 08:22:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:19.255 08:22:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:19.255 08:22:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:19.255 08:22:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:19.255 08:22:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:19.255 08:22:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:19.255 08:22:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:19.255 08:22:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:19.255 08:22:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:19.255 08:22:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:19.255 08:22:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:19.255 08:22:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:19.255 08:22:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:19.255 08:22:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:19.255 08:22:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:19.255 08:22:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:19.255 08:22:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:19.255 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:19.255 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:14:19.255 00:14:19.255 --- 10.0.0.2 ping statistics --- 00:14:19.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.255 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:14:19.255 08:22:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:19.255 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:19.255 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:14:19.255 00:14:19.255 --- 10.0.0.1 ping statistics --- 00:14:19.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.255 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:14:19.255 08:22:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:19.255 08:22:04 -- nvmf/common.sh@410 -- # return 0 00:14:19.255 08:22:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:19.255 08:22:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:19.255 08:22:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:19.255 08:22:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:19.255 08:22:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:19.255 08:22:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:19.255 08:22:04 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:19.255 08:22:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:19.255 08:22:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:19.255 08:22:04 -- common/autotest_common.sh@10 -- # set +x 00:14:19.255 ************************************ 00:14:19.255 START TEST nvmf_host_management 00:14:19.255 ************************************ 00:14:19.255 08:22:04 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:19.255 08:22:04 -- target/host_management.sh@69 -- # starttarget 00:14:19.255 08:22:04 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:19.255 08:22:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:19.255 08:22:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:19.255 08:22:04 -- common/autotest_common.sh@10 -- # set +x 00:14:19.255 08:22:04 -- nvmf/common.sh@469 -- # nvmfpid=936306 00:14:19.255 08:22:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:19.255 08:22:04 -- nvmf/common.sh@470 -- # waitforlisten 936306 00:14:19.255 08:22:04 -- common/autotest_common.sh@829 -- # '[' -z 936306 ']' 00:14:19.255 08:22:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:19.255 08:22:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:19.255 08:22:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:19.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:19.255 08:22:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:19.255 08:22:04 -- common/autotest_common.sh@10 -- # set +x 00:14:19.255 [2024-11-26 08:22:04.901325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:19.255 [2024-11-26 08:22:04.901426] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:19.255 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.255 [2024-11-26 08:22:04.964580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:19.255 [2024-11-26 08:22:05.073932] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:19.255 [2024-11-26 08:22:05.074101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:19.255 [2024-11-26 08:22:05.074117] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:19.255 [2024-11-26 08:22:05.074130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:19.255 [2024-11-26 08:22:05.074217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:19.255 [2024-11-26 08:22:05.074262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:19.255 [2024-11-26 08:22:05.074547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:19.255 [2024-11-26 08:22:05.074551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.192 08:22:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:20.192 08:22:05 -- common/autotest_common.sh@862 -- # return 0 00:14:20.192 08:22:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:20.192 08:22:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:20.192 08:22:05 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 08:22:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:20.192 08:22:05 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:20.192 08:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.192 08:22:05 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 [2024-11-26 08:22:05.937408] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:20.192 08:22:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.192 08:22:05 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:20.192 08:22:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:20.192 08:22:05 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 08:22:05 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:20.192 08:22:05 -- target/host_management.sh@23 -- # cat 00:14:20.192 08:22:05 -- target/host_management.sh@30 -- # rpc_cmd 00:14:20.192 08:22:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.192 08:22:05 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 Malloc0 00:14:20.192 [2024-11-26 08:22:05.998535] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:20.192 08:22:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.192 08:22:06 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:20.192 08:22:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:20.192 08:22:06 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 08:22:06 -- target/host_management.sh@73 -- # perfpid=936487 00:14:20.192 08:22:06 -- target/host_management.sh@74 -- # waitforlisten 936487 /var/tmp/bdevperf.sock 00:14:20.192 08:22:06 -- common/autotest_common.sh@829 -- # '[' -z 936487 ']' 00:14:20.192 08:22:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:20.192 08:22:06 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:20.192 08:22:06 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:20.192 08:22:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:20.192 08:22:06 -- nvmf/common.sh@520 -- # config=() 00:14:20.192 08:22:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:20.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:20.192 08:22:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:20.192 08:22:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:20.192 08:22:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:20.192 08:22:06 -- common/autotest_common.sh@10 -- # set +x 00:14:20.192 08:22:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:20.192 { 00:14:20.192 "params": { 00:14:20.192 "name": "Nvme$subsystem", 00:14:20.192 "trtype": "$TEST_TRANSPORT", 00:14:20.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:20.192 "adrfam": "ipv4", 00:14:20.192 "trsvcid": "$NVMF_PORT", 00:14:20.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:20.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:20.192 "hdgst": ${hdgst:-false}, 00:14:20.192 "ddgst": ${ddgst:-false} 00:14:20.192 }, 00:14:20.192 "method": "bdev_nvme_attach_controller" 00:14:20.192 } 00:14:20.192 EOF 00:14:20.192 )") 00:14:20.192 08:22:06 -- nvmf/common.sh@542 -- # cat 00:14:20.192 08:22:06 -- nvmf/common.sh@544 -- # jq . 00:14:20.192 08:22:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:20.192 08:22:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:20.192 "params": { 00:14:20.192 "name": "Nvme0", 00:14:20.192 "trtype": "tcp", 00:14:20.192 "traddr": "10.0.0.2", 00:14:20.192 "adrfam": "ipv4", 00:14:20.192 "trsvcid": "4420", 00:14:20.192 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:20.192 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:20.192 "hdgst": false, 00:14:20.192 "ddgst": false 00:14:20.192 }, 00:14:20.192 "method": "bdev_nvme_attach_controller" 00:14:20.192 }' 00:14:20.453 [2024-11-26 08:22:06.075508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:20.453 [2024-11-26 08:22:06.075578] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936487 ] 00:14:20.453 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.453 [2024-11-26 08:22:06.137387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:20.453 [2024-11-26 08:22:06.244746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.713 Running I/O for 10 seconds... 00:14:21.284 08:22:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:21.284 08:22:07 -- common/autotest_common.sh@862 -- # return 0 00:14:21.284 08:22:07 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:21.284 08:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.284 08:22:07 -- common/autotest_common.sh@10 -- # set +x 00:14:21.284 08:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.284 08:22:07 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:21.284 08:22:07 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:21.284 08:22:07 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:21.284 08:22:07 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:21.284 08:22:07 -- target/host_management.sh@52 -- # local ret=1 00:14:21.284 08:22:07 -- target/host_management.sh@53 -- # local i 00:14:21.284 08:22:07 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:21.284 08:22:07 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:21.284 08:22:07 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:21.284 08:22:07 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:21.284 08:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.284 08:22:07 -- common/autotest_common.sh@10 -- # set +x 00:14:21.284 08:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.284 08:22:07 -- target/host_management.sh@55 -- # read_io_count=2539 00:14:21.284 08:22:07 -- target/host_management.sh@58 -- # '[' 2539 -ge 100 ']' 00:14:21.284 08:22:07 -- target/host_management.sh@59 -- # ret=0 00:14:21.284 08:22:07 -- target/host_management.sh@60 -- # break 00:14:21.284 08:22:07 -- target/host_management.sh@64 -- # return 0 00:14:21.284 08:22:07 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:21.284 08:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.284 08:22:07 -- common/autotest_common.sh@10 -- # set +x 00:14:21.284 [2024-11-26 08:22:07.110818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.110994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.111146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec5e60 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.113225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.284 [2024-11-26 08:22:07.113270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113288] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.284 [2024-11-26 08:22:07.113302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.284 [2024-11-26 08:22:07.113329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.284 [2024-11-26 08:22:07.113355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94d160 is same with the state(5) to be set 00:14:21.284 [2024-11-26 08:22:07.113629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:82176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:82304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:82432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:82560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:82688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:82816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:82944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:83072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.113972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.113986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:83200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:83328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:83456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:83584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:83712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:83840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:83968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.284 [2024-11-26 08:22:07.114167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.284 [2024-11-26 08:22:07.114181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:84096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:84224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:84352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:84480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:84608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:84736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:84864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:84992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:85120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:85248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:85376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:85504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:85632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:85760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:85888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:86016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:86144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:86272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:86400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:86528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:86656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:86784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.114984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.114999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:86912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:87040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:87168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:87296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 [2024-11-26 08:22:07.115268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.285 [2024-11-26 08:22:07.115281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.285 08:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.286 [2024-11-26 08:22:07.115300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 08:22:07 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:21.286 [2024-11-26 08:22:07.115455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 [2024-11-26 08:22:07.115470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.286 [2024-11-26 08:22:07.115483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.286 08:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.286 [2024-11-26 08:22:07.115585] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x94b030 was disconnected and freed. reset controller. 00:14:21.286 08:22:07 -- common/autotest_common.sh@10 -- # set +x 00:14:21.286 [2024-11-26 08:22:07.116716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:21.286 task offset: 81920 on job bdev=Nvme0n1 fails 00:14:21.286 00:14:21.286 Latency(us) 00:14:21.286 [2024-11-26T07:22:07.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:21.286 [2024-11-26T07:22:07.146Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:21.286 [2024-11-26T07:22:07.146Z] Job: Nvme0n1 ended in about 0.69 seconds with error 00:14:21.286 Verification LBA range: start 0x0 length 0x400 00:14:21.286 Nvme0n1 : 0.69 3851.83 240.74 92.43 0.00 15990.04 2305.90 24175.50 00:14:21.286 [2024-11-26T07:22:07.146Z] =================================================================================================================== 00:14:21.286 [2024-11-26T07:22:07.146Z] Total : 3851.83 240.74 92.43 0.00 15990.04 2305.90 24175.50 00:14:21.286 [2024-11-26 08:22:07.118592] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:21.286 [2024-11-26 08:22:07.118636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x94d160 (9): Bad file descriptor 00:14:21.286 08:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.286 08:22:07 -- target/host_management.sh@87 -- # sleep 1 00:14:21.549 [2024-11-26 08:22:07.210837] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:22.487 08:22:08 -- target/host_management.sh@91 -- # kill -9 936487 00:14:22.487 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (936487) - No such process 00:14:22.487 08:22:08 -- target/host_management.sh@91 -- # true 00:14:22.487 08:22:08 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:22.487 08:22:08 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:22.487 08:22:08 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:22.487 08:22:08 -- nvmf/common.sh@520 -- # config=() 00:14:22.487 08:22:08 -- nvmf/common.sh@520 -- # local subsystem config 00:14:22.487 08:22:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:22.487 08:22:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:22.487 { 00:14:22.487 "params": { 00:14:22.487 "name": "Nvme$subsystem", 00:14:22.487 "trtype": "$TEST_TRANSPORT", 00:14:22.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:22.487 "adrfam": "ipv4", 00:14:22.487 "trsvcid": "$NVMF_PORT", 00:14:22.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:22.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:22.487 "hdgst": ${hdgst:-false}, 00:14:22.487 "ddgst": ${ddgst:-false} 00:14:22.487 }, 00:14:22.487 "method": "bdev_nvme_attach_controller" 00:14:22.487 } 00:14:22.487 EOF 00:14:22.487 )") 00:14:22.487 08:22:08 -- nvmf/common.sh@542 -- # cat 00:14:22.487 08:22:08 -- nvmf/common.sh@544 -- # jq . 00:14:22.487 08:22:08 -- nvmf/common.sh@545 -- # IFS=, 00:14:22.487 08:22:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:22.487 "params": { 00:14:22.487 "name": "Nvme0", 00:14:22.487 "trtype": "tcp", 00:14:22.487 "traddr": "10.0.0.2", 00:14:22.487 "adrfam": "ipv4", 00:14:22.487 "trsvcid": "4420", 00:14:22.487 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:22.487 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:22.487 "hdgst": false, 00:14:22.487 "ddgst": false 00:14:22.487 }, 00:14:22.487 "method": "bdev_nvme_attach_controller" 00:14:22.487 }' 00:14:22.487 [2024-11-26 08:22:08.166007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.487 [2024-11-26 08:22:08.166112] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936774 ] 00:14:22.487 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.487 [2024-11-26 08:22:08.225658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.487 [2024-11-26 08:22:08.331232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:22.746 Running I/O for 1 seconds... 00:14:24.125 00:14:24.125 Latency(us) 00:14:24.125 [2024-11-26T07:22:09.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:24.125 [2024-11-26T07:22:09.985Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:24.125 Verification LBA range: start 0x0 length 0x400 00:14:24.125 Nvme0n1 : 1.01 3974.38 248.40 0.00 0.00 15844.19 1280.38 21651.15 00:14:24.125 [2024-11-26T07:22:09.985Z] =================================================================================================================== 00:14:24.125 [2024-11-26T07:22:09.985Z] Total : 3974.38 248.40 0.00 0.00 15844.19 1280.38 21651.15 00:14:24.125 08:22:09 -- target/host_management.sh@101 -- # stoptarget 00:14:24.125 08:22:09 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:24.125 08:22:09 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:24.125 08:22:09 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:24.125 08:22:09 -- target/host_management.sh@40 -- # nvmftestfini 00:14:24.125 08:22:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:24.125 08:22:09 -- nvmf/common.sh@116 -- # sync 00:14:24.125 08:22:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:24.125 08:22:09 -- nvmf/common.sh@119 -- # set +e 00:14:24.125 08:22:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:24.125 08:22:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:24.125 rmmod nvme_tcp 00:14:24.125 rmmod nvme_fabrics 00:14:24.125 rmmod nvme_keyring 00:14:24.125 08:22:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:24.125 08:22:09 -- nvmf/common.sh@123 -- # set -e 00:14:24.125 08:22:09 -- nvmf/common.sh@124 -- # return 0 00:14:24.125 08:22:09 -- nvmf/common.sh@477 -- # '[' -n 936306 ']' 00:14:24.125 08:22:09 -- nvmf/common.sh@478 -- # killprocess 936306 00:14:24.125 08:22:09 -- common/autotest_common.sh@936 -- # '[' -z 936306 ']' 00:14:24.125 08:22:09 -- common/autotest_common.sh@940 -- # kill -0 936306 00:14:24.125 08:22:09 -- common/autotest_common.sh@941 -- # uname 00:14:24.125 08:22:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:24.125 08:22:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 936306 00:14:24.125 08:22:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:24.125 08:22:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:24.125 08:22:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 936306' 00:14:24.125 killing process with pid 936306 00:14:24.125 08:22:09 -- common/autotest_common.sh@955 -- # kill 936306 00:14:24.125 08:22:09 -- common/autotest_common.sh@960 -- # wait 936306 00:14:24.384 [2024-11-26 08:22:10.188896] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:24.384 08:22:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:24.384 08:22:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:24.384 08:22:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:24.384 08:22:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:24.384 08:22:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:24.384 08:22:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.384 08:22:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.384 08:22:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:26.925 08:22:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:26.925 00:14:26.925 real 0m7.404s 00:14:26.925 user 0m22.835s 00:14:26.925 sys 0m1.489s 00:14:26.925 08:22:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:26.925 08:22:12 -- common/autotest_common.sh@10 -- # set +x 00:14:26.925 ************************************ 00:14:26.925 END TEST nvmf_host_management 00:14:26.925 ************************************ 00:14:26.925 08:22:12 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:26.925 00:14:26.925 real 0m9.675s 00:14:26.925 user 0m23.700s 00:14:26.925 sys 0m2.891s 00:14:26.925 08:22:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:26.925 08:22:12 -- common/autotest_common.sh@10 -- # set +x 00:14:26.925 ************************************ 00:14:26.925 END TEST nvmf_host_management 00:14:26.925 ************************************ 00:14:26.925 08:22:12 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:26.925 08:22:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:26.925 08:22:12 -- common/autotest_common.sh@10 -- # set +x 00:14:26.925 ************************************ 00:14:26.925 START TEST nvmf_lvol 00:14:26.925 ************************************ 00:14:26.925 08:22:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:26.925 * Looking for test storage... 00:14:26.925 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:26.925 08:22:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:26.925 08:22:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:26.925 08:22:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:26.925 08:22:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:26.925 08:22:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:26.925 08:22:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:26.925 08:22:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:26.925 08:22:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:26.925 08:22:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:26.925 08:22:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:26.925 08:22:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:26.925 08:22:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:26.925 08:22:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:26.925 08:22:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:26.925 08:22:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:26.925 08:22:12 -- scripts/common.sh@344 -- # : 1 00:14:26.925 08:22:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:26.925 08:22:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:26.925 08:22:12 -- scripts/common.sh@364 -- # decimal 1 00:14:26.925 08:22:12 -- scripts/common.sh@352 -- # local d=1 00:14:26.925 08:22:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:26.925 08:22:12 -- scripts/common.sh@354 -- # echo 1 00:14:26.925 08:22:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:26.925 08:22:12 -- scripts/common.sh@365 -- # decimal 2 00:14:26.925 08:22:12 -- scripts/common.sh@352 -- # local d=2 00:14:26.925 08:22:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:26.925 08:22:12 -- scripts/common.sh@354 -- # echo 2 00:14:26.925 08:22:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:26.925 08:22:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:26.925 08:22:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:26.925 08:22:12 -- scripts/common.sh@367 -- # return 0 00:14:26.925 08:22:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:26.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.925 --rc genhtml_branch_coverage=1 00:14:26.925 --rc genhtml_function_coverage=1 00:14:26.925 --rc genhtml_legend=1 00:14:26.925 --rc geninfo_all_blocks=1 00:14:26.925 --rc geninfo_unexecuted_blocks=1 00:14:26.925 00:14:26.925 ' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:26.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.925 --rc genhtml_branch_coverage=1 00:14:26.925 --rc genhtml_function_coverage=1 00:14:26.925 --rc genhtml_legend=1 00:14:26.925 --rc geninfo_all_blocks=1 00:14:26.925 --rc geninfo_unexecuted_blocks=1 00:14:26.925 00:14:26.925 ' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:26.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.925 --rc genhtml_branch_coverage=1 00:14:26.925 --rc genhtml_function_coverage=1 00:14:26.925 --rc genhtml_legend=1 00:14:26.925 --rc geninfo_all_blocks=1 00:14:26.925 --rc geninfo_unexecuted_blocks=1 00:14:26.925 00:14:26.925 ' 00:14:26.925 08:22:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:26.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.925 --rc genhtml_branch_coverage=1 00:14:26.925 --rc genhtml_function_coverage=1 00:14:26.925 --rc genhtml_legend=1 00:14:26.925 --rc geninfo_all_blocks=1 00:14:26.925 --rc geninfo_unexecuted_blocks=1 00:14:26.925 00:14:26.925 ' 00:14:26.925 08:22:12 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:26.925 08:22:12 -- nvmf/common.sh@7 -- # uname -s 00:14:26.925 08:22:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:26.925 08:22:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:26.925 08:22:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:26.925 08:22:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:26.925 08:22:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:26.925 08:22:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:26.925 08:22:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:26.925 08:22:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:26.925 08:22:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:26.925 08:22:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:26.925 08:22:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.925 08:22:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.925 08:22:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:26.925 08:22:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:26.925 08:22:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:26.925 08:22:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:26.925 08:22:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:26.925 08:22:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:26.925 08:22:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:26.925 08:22:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.925 08:22:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.925 08:22:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.925 08:22:12 -- paths/export.sh@5 -- # export PATH 00:14:26.926 08:22:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.926 08:22:12 -- nvmf/common.sh@46 -- # : 0 00:14:26.926 08:22:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:26.926 08:22:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:26.926 08:22:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:26.926 08:22:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:26.926 08:22:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:26.926 08:22:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:26.926 08:22:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:26.926 08:22:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:26.926 08:22:12 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:26.926 08:22:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:26.926 08:22:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:26.926 08:22:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:26.926 08:22:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:26.926 08:22:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:26.926 08:22:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:26.926 08:22:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:26.926 08:22:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:26.926 08:22:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:26.926 08:22:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:26.926 08:22:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:26.926 08:22:12 -- common/autotest_common.sh@10 -- # set +x 00:14:28.835 08:22:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:28.836 08:22:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:28.836 08:22:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:28.836 08:22:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:28.836 08:22:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:28.836 08:22:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:28.836 08:22:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:28.836 08:22:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:28.836 08:22:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:28.836 08:22:14 -- nvmf/common.sh@295 -- # e810=() 00:14:28.836 08:22:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:28.836 08:22:14 -- nvmf/common.sh@296 -- # x722=() 00:14:28.836 08:22:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:28.836 08:22:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:28.836 08:22:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:28.836 08:22:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:28.836 08:22:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.836 08:22:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:28.836 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:28.836 08:22:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.836 08:22:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:28.836 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:28.836 08:22:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.836 08:22:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.836 08:22:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.836 08:22:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:28.836 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:28.836 08:22:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.836 08:22:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.836 08:22:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.836 08:22:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:28.836 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:28.836 08:22:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:28.836 08:22:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:28.836 08:22:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:28.836 08:22:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:28.836 08:22:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:28.836 08:22:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:28.836 08:22:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:28.836 08:22:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:28.836 08:22:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:28.836 08:22:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:28.836 08:22:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:28.836 08:22:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:28.836 08:22:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:28.836 08:22:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:28.836 08:22:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:28.836 08:22:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:28.836 08:22:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:28.836 08:22:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:28.836 08:22:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:28.836 08:22:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:28.836 08:22:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:28.836 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:28.836 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:14:28.836 00:14:28.836 --- 10.0.0.2 ping statistics --- 00:14:28.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.836 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:14:28.836 08:22:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:28.836 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:28.836 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:14:28.836 00:14:28.836 --- 10.0.0.1 ping statistics --- 00:14:28.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.836 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:14:28.836 08:22:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:28.836 08:22:14 -- nvmf/common.sh@410 -- # return 0 00:14:28.836 08:22:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:28.836 08:22:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:28.836 08:22:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:28.836 08:22:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:28.836 08:22:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:28.836 08:22:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:28.836 08:22:14 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:28.836 08:22:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:28.836 08:22:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:28.836 08:22:14 -- common/autotest_common.sh@10 -- # set +x 00:14:28.836 08:22:14 -- nvmf/common.sh@469 -- # nvmfpid=938886 00:14:28.836 08:22:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:28.836 08:22:14 -- nvmf/common.sh@470 -- # waitforlisten 938886 00:14:28.836 08:22:14 -- common/autotest_common.sh@829 -- # '[' -z 938886 ']' 00:14:28.836 08:22:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:28.836 08:22:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:28.836 08:22:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:28.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:28.836 08:22:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:28.836 08:22:14 -- common/autotest_common.sh@10 -- # set +x 00:14:28.836 [2024-11-26 08:22:14.506599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:28.836 [2024-11-26 08:22:14.506706] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:28.836 EAL: No free 2048 kB hugepages reported on node 1 00:14:28.836 [2024-11-26 08:22:14.570552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:28.836 [2024-11-26 08:22:14.678680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:28.836 [2024-11-26 08:22:14.678860] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:28.836 [2024-11-26 08:22:14.678877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:28.836 [2024-11-26 08:22:14.678899] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:28.836 [2024-11-26 08:22:14.678953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:28.836 [2024-11-26 08:22:14.679012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:28.836 [2024-11-26 08:22:14.679016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:29.773 08:22:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:29.773 08:22:15 -- common/autotest_common.sh@862 -- # return 0 00:14:29.773 08:22:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:29.773 08:22:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:29.773 08:22:15 -- common/autotest_common.sh@10 -- # set +x 00:14:29.773 08:22:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:29.773 08:22:15 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:30.031 [2024-11-26 08:22:15.736370] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:30.031 08:22:15 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:30.290 08:22:16 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:30.290 08:22:16 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:30.548 08:22:16 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:30.548 08:22:16 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:30.806 08:22:16 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:31.064 08:22:16 -- target/nvmf_lvol.sh@29 -- # lvs=8fd390e2-0d32-4b0b-9152-9e95a821c820 00:14:31.064 08:22:16 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8fd390e2-0d32-4b0b-9152-9e95a821c820 lvol 20 00:14:31.322 08:22:17 -- target/nvmf_lvol.sh@32 -- # lvol=246c70eb-ec09-4923-af83-753ef36224b3 00:14:31.322 08:22:17 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:31.580 08:22:17 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 246c70eb-ec09-4923-af83-753ef36224b3 00:14:31.838 08:22:17 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:32.096 [2024-11-26 08:22:17.876989] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:32.096 08:22:17 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:32.354 08:22:18 -- target/nvmf_lvol.sh@42 -- # perf_pid=939405 00:14:32.354 08:22:18 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:32.354 08:22:18 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:32.354 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.309 08:22:19 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 246c70eb-ec09-4923-af83-753ef36224b3 MY_SNAPSHOT 00:14:33.903 08:22:19 -- target/nvmf_lvol.sh@47 -- # snapshot=a988b5ec-8745-4abf-aa92-2adb8be9e854 00:14:33.903 08:22:19 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 246c70eb-ec09-4923-af83-753ef36224b3 30 00:14:33.903 08:22:19 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone a988b5ec-8745-4abf-aa92-2adb8be9e854 MY_CLONE 00:14:34.470 08:22:20 -- target/nvmf_lvol.sh@49 -- # clone=23d983c8-260e-41c0-9a85-dee947acc479 00:14:34.470 08:22:20 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 23d983c8-260e-41c0-9a85-dee947acc479 00:14:35.040 08:22:20 -- target/nvmf_lvol.sh@53 -- # wait 939405 00:14:43.161 Initializing NVMe Controllers 00:14:43.161 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:43.161 Controller IO queue size 128, less than required. 00:14:43.161 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:43.161 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:43.161 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:43.161 Initialization complete. Launching workers. 00:14:43.161 ======================================================== 00:14:43.161 Latency(us) 00:14:43.161 Device Information : IOPS MiB/s Average min max 00:14:43.161 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10865.40 42.44 11786.77 1862.99 65369.86 00:14:43.161 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10489.10 40.97 12205.71 2368.57 72649.41 00:14:43.161 ======================================================== 00:14:43.161 Total : 21354.50 83.42 11992.55 1862.99 72649.41 00:14:43.161 00:14:43.161 08:22:28 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:43.161 08:22:28 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 246c70eb-ec09-4923-af83-753ef36224b3 00:14:43.418 08:22:29 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8fd390e2-0d32-4b0b-9152-9e95a821c820 00:14:43.677 08:22:29 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:43.677 08:22:29 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:43.677 08:22:29 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:43.677 08:22:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:43.677 08:22:29 -- nvmf/common.sh@116 -- # sync 00:14:43.677 08:22:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:43.677 08:22:29 -- nvmf/common.sh@119 -- # set +e 00:14:43.677 08:22:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:43.677 08:22:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:43.677 rmmod nvme_tcp 00:14:43.677 rmmod nvme_fabrics 00:14:43.677 rmmod nvme_keyring 00:14:43.677 08:22:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:43.677 08:22:29 -- nvmf/common.sh@123 -- # set -e 00:14:43.677 08:22:29 -- nvmf/common.sh@124 -- # return 0 00:14:43.677 08:22:29 -- nvmf/common.sh@477 -- # '[' -n 938886 ']' 00:14:43.677 08:22:29 -- nvmf/common.sh@478 -- # killprocess 938886 00:14:43.677 08:22:29 -- common/autotest_common.sh@936 -- # '[' -z 938886 ']' 00:14:43.677 08:22:29 -- common/autotest_common.sh@940 -- # kill -0 938886 00:14:43.677 08:22:29 -- common/autotest_common.sh@941 -- # uname 00:14:43.677 08:22:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:43.677 08:22:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 938886 00:14:43.677 08:22:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:43.677 08:22:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:43.677 08:22:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 938886' 00:14:43.677 killing process with pid 938886 00:14:43.677 08:22:29 -- common/autotest_common.sh@955 -- # kill 938886 00:14:43.677 08:22:29 -- common/autotest_common.sh@960 -- # wait 938886 00:14:44.244 08:22:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:44.244 08:22:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:44.244 08:22:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:44.244 08:22:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:44.244 08:22:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:44.244 08:22:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.244 08:22:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.244 08:22:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.152 08:22:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:46.152 00:14:46.152 real 0m19.522s 00:14:46.152 user 1m6.819s 00:14:46.152 sys 0m5.451s 00:14:46.152 08:22:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:46.152 08:22:31 -- common/autotest_common.sh@10 -- # set +x 00:14:46.152 ************************************ 00:14:46.152 END TEST nvmf_lvol 00:14:46.152 ************************************ 00:14:46.152 08:22:31 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.152 08:22:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:46.152 08:22:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:46.152 08:22:31 -- common/autotest_common.sh@10 -- # set +x 00:14:46.152 ************************************ 00:14:46.152 START TEST nvmf_lvs_grow 00:14:46.152 ************************************ 00:14:46.152 08:22:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.152 * Looking for test storage... 00:14:46.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:46.152 08:22:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:46.152 08:22:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:46.152 08:22:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:46.152 08:22:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:46.152 08:22:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:46.152 08:22:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:46.152 08:22:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:46.152 08:22:32 -- scripts/common.sh@335 -- # IFS=.-: 00:14:46.152 08:22:32 -- scripts/common.sh@335 -- # read -ra ver1 00:14:46.152 08:22:32 -- scripts/common.sh@336 -- # IFS=.-: 00:14:46.152 08:22:32 -- scripts/common.sh@336 -- # read -ra ver2 00:14:46.152 08:22:32 -- scripts/common.sh@337 -- # local 'op=<' 00:14:46.152 08:22:32 -- scripts/common.sh@339 -- # ver1_l=2 00:14:46.152 08:22:32 -- scripts/common.sh@340 -- # ver2_l=1 00:14:46.152 08:22:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:46.152 08:22:32 -- scripts/common.sh@343 -- # case "$op" in 00:14:46.152 08:22:32 -- scripts/common.sh@344 -- # : 1 00:14:46.152 08:22:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:46.152 08:22:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:46.152 08:22:32 -- scripts/common.sh@364 -- # decimal 1 00:14:46.152 08:22:32 -- scripts/common.sh@352 -- # local d=1 00:14:46.152 08:22:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:46.152 08:22:32 -- scripts/common.sh@354 -- # echo 1 00:14:46.152 08:22:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:46.413 08:22:32 -- scripts/common.sh@365 -- # decimal 2 00:14:46.413 08:22:32 -- scripts/common.sh@352 -- # local d=2 00:14:46.413 08:22:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:46.413 08:22:32 -- scripts/common.sh@354 -- # echo 2 00:14:46.413 08:22:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:46.413 08:22:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:46.413 08:22:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:46.413 08:22:32 -- scripts/common.sh@367 -- # return 0 00:14:46.413 08:22:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:46.413 08:22:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:46.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.413 --rc genhtml_branch_coverage=1 00:14:46.413 --rc genhtml_function_coverage=1 00:14:46.413 --rc genhtml_legend=1 00:14:46.413 --rc geninfo_all_blocks=1 00:14:46.413 --rc geninfo_unexecuted_blocks=1 00:14:46.413 00:14:46.413 ' 00:14:46.413 08:22:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:46.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.413 --rc genhtml_branch_coverage=1 00:14:46.413 --rc genhtml_function_coverage=1 00:14:46.413 --rc genhtml_legend=1 00:14:46.413 --rc geninfo_all_blocks=1 00:14:46.413 --rc geninfo_unexecuted_blocks=1 00:14:46.413 00:14:46.413 ' 00:14:46.413 08:22:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:46.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.413 --rc genhtml_branch_coverage=1 00:14:46.413 --rc genhtml_function_coverage=1 00:14:46.413 --rc genhtml_legend=1 00:14:46.413 --rc geninfo_all_blocks=1 00:14:46.413 --rc geninfo_unexecuted_blocks=1 00:14:46.413 00:14:46.413 ' 00:14:46.413 08:22:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:46.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:46.413 --rc genhtml_branch_coverage=1 00:14:46.413 --rc genhtml_function_coverage=1 00:14:46.413 --rc genhtml_legend=1 00:14:46.413 --rc geninfo_all_blocks=1 00:14:46.413 --rc geninfo_unexecuted_blocks=1 00:14:46.413 00:14:46.413 ' 00:14:46.413 08:22:32 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:46.413 08:22:32 -- nvmf/common.sh@7 -- # uname -s 00:14:46.413 08:22:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:46.413 08:22:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:46.413 08:22:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:46.413 08:22:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:46.413 08:22:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:46.413 08:22:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:46.413 08:22:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:46.413 08:22:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:46.413 08:22:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:46.413 08:22:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:46.413 08:22:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:46.413 08:22:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:46.413 08:22:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:46.413 08:22:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:46.413 08:22:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:46.413 08:22:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:46.413 08:22:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:46.413 08:22:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:46.413 08:22:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:46.413 08:22:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.413 08:22:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.413 08:22:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.413 08:22:32 -- paths/export.sh@5 -- # export PATH 00:14:46.413 08:22:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:46.413 08:22:32 -- nvmf/common.sh@46 -- # : 0 00:14:46.413 08:22:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:46.413 08:22:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:46.413 08:22:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:46.413 08:22:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:46.413 08:22:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:46.413 08:22:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:46.413 08:22:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:46.413 08:22:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:46.413 08:22:32 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:46.413 08:22:32 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:46.413 08:22:32 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:46.413 08:22:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:46.413 08:22:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:46.413 08:22:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:46.413 08:22:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:46.413 08:22:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:46.413 08:22:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:46.413 08:22:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:46.413 08:22:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.413 08:22:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:46.413 08:22:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:46.413 08:22:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:46.413 08:22:32 -- common/autotest_common.sh@10 -- # set +x 00:14:48.318 08:22:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:48.318 08:22:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:48.319 08:22:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:48.319 08:22:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:48.319 08:22:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:48.319 08:22:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:48.319 08:22:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:48.319 08:22:34 -- nvmf/common.sh@294 -- # net_devs=() 00:14:48.319 08:22:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:48.319 08:22:34 -- nvmf/common.sh@295 -- # e810=() 00:14:48.319 08:22:34 -- nvmf/common.sh@295 -- # local -ga e810 00:14:48.319 08:22:34 -- nvmf/common.sh@296 -- # x722=() 00:14:48.319 08:22:34 -- nvmf/common.sh@296 -- # local -ga x722 00:14:48.319 08:22:34 -- nvmf/common.sh@297 -- # mlx=() 00:14:48.319 08:22:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:48.319 08:22:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:48.319 08:22:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.319 08:22:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:48.319 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:48.319 08:22:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.319 08:22:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:48.319 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:48.319 08:22:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.319 08:22:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.319 08:22:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.319 08:22:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:48.319 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:48.319 08:22:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.319 08:22:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.319 08:22:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.319 08:22:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:48.319 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:48.319 08:22:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:48.319 08:22:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:48.319 08:22:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:48.319 08:22:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:48.319 08:22:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:48.319 08:22:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:48.319 08:22:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:48.319 08:22:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:48.319 08:22:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:48.319 08:22:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:48.319 08:22:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:48.319 08:22:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:48.319 08:22:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:48.319 08:22:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:48.319 08:22:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:48.319 08:22:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:48.319 08:22:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:48.319 08:22:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:48.319 08:22:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:48.319 08:22:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:48.319 08:22:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:48.319 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:48.319 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.325 ms 00:14:48.319 00:14:48.319 --- 10.0.0.2 ping statistics --- 00:14:48.319 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.319 rtt min/avg/max/mdev = 0.325/0.325/0.325/0.000 ms 00:14:48.319 08:22:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:48.319 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:48.319 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:14:48.319 00:14:48.319 --- 10.0.0.1 ping statistics --- 00:14:48.319 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.319 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:14:48.319 08:22:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:48.319 08:22:34 -- nvmf/common.sh@410 -- # return 0 00:14:48.319 08:22:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:48.319 08:22:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:48.319 08:22:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:48.319 08:22:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:48.319 08:22:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:48.319 08:22:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:48.319 08:22:34 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:48.319 08:22:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:48.319 08:22:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:48.319 08:22:34 -- common/autotest_common.sh@10 -- # set +x 00:14:48.319 08:22:34 -- nvmf/common.sh@469 -- # nvmfpid=942772 00:14:48.319 08:22:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:48.578 08:22:34 -- nvmf/common.sh@470 -- # waitforlisten 942772 00:14:48.578 08:22:34 -- common/autotest_common.sh@829 -- # '[' -z 942772 ']' 00:14:48.578 08:22:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:48.578 08:22:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.578 08:22:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:48.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:48.578 08:22:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.578 08:22:34 -- common/autotest_common.sh@10 -- # set +x 00:14:48.578 [2024-11-26 08:22:34.215295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:48.578 [2024-11-26 08:22:34.215360] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:48.578 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.578 [2024-11-26 08:22:34.278763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:48.578 [2024-11-26 08:22:34.383792] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:48.578 [2024-11-26 08:22:34.383939] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:48.578 [2024-11-26 08:22:34.383956] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:48.578 [2024-11-26 08:22:34.383968] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:48.578 [2024-11-26 08:22:34.384013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.517 08:22:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:49.517 08:22:35 -- common/autotest_common.sh@862 -- # return 0 00:14:49.517 08:22:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:49.517 08:22:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:49.517 08:22:35 -- common/autotest_common.sh@10 -- # set +x 00:14:49.517 08:22:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:49.517 08:22:35 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:49.775 [2024-11-26 08:22:35.486428] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:49.775 08:22:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:49.775 08:22:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:49.775 08:22:35 -- common/autotest_common.sh@10 -- # set +x 00:14:49.775 ************************************ 00:14:49.775 START TEST lvs_grow_clean 00:14:49.775 ************************************ 00:14:49.775 08:22:35 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:49.775 08:22:35 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:50.033 08:22:35 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:50.034 08:22:35 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:50.293 08:22:36 -- target/nvmf_lvs_grow.sh@28 -- # lvs=49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:14:50.293 08:22:36 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:14:50.293 08:22:36 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:50.552 08:22:36 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:50.552 08:22:36 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:50.552 08:22:36 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 lvol 150 00:14:50.812 08:22:36 -- target/nvmf_lvs_grow.sh@33 -- # lvol=01a0c76b-a998-471a-9bed-11d27be4d8e9 00:14:50.812 08:22:36 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.812 08:22:36 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:51.073 [2024-11-26 08:22:36.843165] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:51.073 [2024-11-26 08:22:36.843265] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:51.073 true 00:14:51.073 08:22:36 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:14:51.073 08:22:36 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:51.331 08:22:37 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:51.331 08:22:37 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:51.589 08:22:37 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 01a0c76b-a998-471a-9bed-11d27be4d8e9 00:14:51.848 08:22:37 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:52.108 [2024-11-26 08:22:37.862379] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.108 08:22:37 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:52.367 08:22:38 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=943238 00:14:52.367 08:22:38 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:52.367 08:22:38 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 943238 /var/tmp/bdevperf.sock 00:14:52.367 08:22:38 -- common/autotest_common.sh@829 -- # '[' -z 943238 ']' 00:14:52.367 08:22:38 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:52.367 08:22:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:52.367 08:22:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:52.367 08:22:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:52.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:52.367 08:22:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:52.367 08:22:38 -- common/autotest_common.sh@10 -- # set +x 00:14:52.367 [2024-11-26 08:22:38.170355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:52.367 [2024-11-26 08:22:38.170427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943238 ] 00:14:52.367 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.625 [2024-11-26 08:22:38.236701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:52.625 [2024-11-26 08:22:38.350608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:53.575 08:22:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:53.575 08:22:39 -- common/autotest_common.sh@862 -- # return 0 00:14:53.575 08:22:39 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:53.836 Nvme0n1 00:14:53.836 08:22:39 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:54.097 [ 00:14:54.097 { 00:14:54.097 "name": "Nvme0n1", 00:14:54.097 "aliases": [ 00:14:54.097 "01a0c76b-a998-471a-9bed-11d27be4d8e9" 00:14:54.097 ], 00:14:54.097 "product_name": "NVMe disk", 00:14:54.097 "block_size": 4096, 00:14:54.097 "num_blocks": 38912, 00:14:54.097 "uuid": "01a0c76b-a998-471a-9bed-11d27be4d8e9", 00:14:54.097 "assigned_rate_limits": { 00:14:54.097 "rw_ios_per_sec": 0, 00:14:54.097 "rw_mbytes_per_sec": 0, 00:14:54.097 "r_mbytes_per_sec": 0, 00:14:54.097 "w_mbytes_per_sec": 0 00:14:54.097 }, 00:14:54.097 "claimed": false, 00:14:54.097 "zoned": false, 00:14:54.097 "supported_io_types": { 00:14:54.097 "read": true, 00:14:54.097 "write": true, 00:14:54.097 "unmap": true, 00:14:54.097 "write_zeroes": true, 00:14:54.097 "flush": true, 00:14:54.097 "reset": true, 00:14:54.097 "compare": true, 00:14:54.097 "compare_and_write": true, 00:14:54.097 "abort": true, 00:14:54.097 "nvme_admin": true, 00:14:54.097 "nvme_io": true 00:14:54.097 }, 00:14:54.097 "driver_specific": { 00:14:54.097 "nvme": [ 00:14:54.097 { 00:14:54.097 "trid": { 00:14:54.097 "trtype": "TCP", 00:14:54.097 "adrfam": "IPv4", 00:14:54.097 "traddr": "10.0.0.2", 00:14:54.097 "trsvcid": "4420", 00:14:54.097 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:54.097 }, 00:14:54.097 "ctrlr_data": { 00:14:54.097 "cntlid": 1, 00:14:54.097 "vendor_id": "0x8086", 00:14:54.097 "model_number": "SPDK bdev Controller", 00:14:54.097 "serial_number": "SPDK0", 00:14:54.097 "firmware_revision": "24.01.1", 00:14:54.097 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:54.097 "oacs": { 00:14:54.097 "security": 0, 00:14:54.097 "format": 0, 00:14:54.097 "firmware": 0, 00:14:54.097 "ns_manage": 0 00:14:54.097 }, 00:14:54.097 "multi_ctrlr": true, 00:14:54.097 "ana_reporting": false 00:14:54.097 }, 00:14:54.097 "vs": { 00:14:54.097 "nvme_version": "1.3" 00:14:54.097 }, 00:14:54.097 "ns_data": { 00:14:54.097 "id": 1, 00:14:54.097 "can_share": true 00:14:54.097 } 00:14:54.097 } 00:14:54.097 ], 00:14:54.097 "mp_policy": "active_passive" 00:14:54.097 } 00:14:54.097 } 00:14:54.097 ] 00:14:54.097 08:22:39 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=943499 00:14:54.097 08:22:39 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:54.097 08:22:39 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:54.097 Running I/O for 10 seconds... 00:14:55.036 Latency(us) 00:14:55.036 [2024-11-26T07:22:40.896Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:55.036 [2024-11-26T07:22:40.896Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.036 Nvme0n1 : 1.00 14655.00 57.25 0.00 0.00 0.00 0.00 0.00 00:14:55.036 [2024-11-26T07:22:40.896Z] =================================================================================================================== 00:14:55.036 [2024-11-26T07:22:40.896Z] Total : 14655.00 57.25 0.00 0.00 0.00 0.00 0.00 00:14:55.036 00:14:55.974 08:22:41 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:14:56.232 [2024-11-26T07:22:42.092Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.232 Nvme0n1 : 2.00 14849.50 58.01 0.00 0.00 0.00 0.00 0.00 00:14:56.232 [2024-11-26T07:22:42.092Z] =================================================================================================================== 00:14:56.232 [2024-11-26T07:22:42.092Z] Total : 14849.50 58.01 0.00 0.00 0.00 0.00 0.00 00:14:56.232 00:14:56.232 true 00:14:56.232 08:22:42 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:14:56.232 08:22:42 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:56.492 08:22:42 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:56.492 08:22:42 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:56.492 08:22:42 -- target/nvmf_lvs_grow.sh@65 -- # wait 943499 00:14:57.062 [2024-11-26T07:22:42.922Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.062 Nvme0n1 : 3.00 14944.67 58.38 0.00 0.00 0.00 0.00 0.00 00:14:57.062 [2024-11-26T07:22:42.922Z] =================================================================================================================== 00:14:57.062 [2024-11-26T07:22:42.922Z] Total : 14944.67 58.38 0.00 0.00 0.00 0.00 0.00 00:14:57.062 00:14:58.442 [2024-11-26T07:22:44.302Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.442 Nvme0n1 : 4.00 15040.25 58.75 0.00 0.00 0.00 0.00 0.00 00:14:58.442 [2024-11-26T07:22:44.302Z] =================================================================================================================== 00:14:58.442 [2024-11-26T07:22:44.302Z] Total : 15040.25 58.75 0.00 0.00 0.00 0.00 0.00 00:14:58.442 00:14:59.382 [2024-11-26T07:22:45.242Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.382 Nvme0n1 : 5.00 15162.20 59.23 0.00 0.00 0.00 0.00 0.00 00:14:59.382 [2024-11-26T07:22:45.242Z] =================================================================================================================== 00:14:59.382 [2024-11-26T07:22:45.242Z] Total : 15162.20 59.23 0.00 0.00 0.00 0.00 0.00 00:14:59.382 00:15:00.324 [2024-11-26T07:22:46.184Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.324 Nvme0n1 : 6.00 15202.83 59.39 0.00 0.00 0.00 0.00 0.00 00:15:00.324 [2024-11-26T07:22:46.184Z] =================================================================================================================== 00:15:00.324 [2024-11-26T07:22:46.184Z] Total : 15202.83 59.39 0.00 0.00 0.00 0.00 0.00 00:15:00.324 00:15:01.263 [2024-11-26T07:22:47.123Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.263 Nvme0n1 : 7.00 15304.57 59.78 0.00 0.00 0.00 0.00 0.00 00:15:01.263 [2024-11-26T07:22:47.123Z] =================================================================================================================== 00:15:01.263 [2024-11-26T07:22:47.123Z] Total : 15304.57 59.78 0.00 0.00 0.00 0.00 0.00 00:15:01.263 00:15:02.201 [2024-11-26T07:22:48.061Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.201 Nvme0n1 : 8.00 15338.00 59.91 0.00 0.00 0.00 0.00 0.00 00:15:02.201 [2024-11-26T07:22:48.061Z] =================================================================================================================== 00:15:02.201 [2024-11-26T07:22:48.061Z] Total : 15338.00 59.91 0.00 0.00 0.00 0.00 0.00 00:15:02.201 00:15:03.138 [2024-11-26T07:22:48.998Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.138 Nvme0n1 : 9.00 15364.33 60.02 0.00 0.00 0.00 0.00 0.00 00:15:03.138 [2024-11-26T07:22:48.998Z] =================================================================================================================== 00:15:03.138 [2024-11-26T07:22:48.998Z] Total : 15364.33 60.02 0.00 0.00 0.00 0.00 0.00 00:15:03.138 00:15:04.073 [2024-11-26T07:22:49.933Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.073 Nvme0n1 : 10.00 15388.50 60.11 0.00 0.00 0.00 0.00 0.00 00:15:04.073 [2024-11-26T07:22:49.933Z] =================================================================================================================== 00:15:04.073 [2024-11-26T07:22:49.933Z] Total : 15388.50 60.11 0.00 0.00 0.00 0.00 0.00 00:15:04.073 00:15:04.073 00:15:04.073 Latency(us) 00:15:04.073 [2024-11-26T07:22:49.933Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.073 [2024-11-26T07:22:49.933Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.073 Nvme0n1 : 10.01 15389.68 60.12 0.00 0.00 8312.59 2354.44 16602.45 00:15:04.073 [2024-11-26T07:22:49.933Z] =================================================================================================================== 00:15:04.073 [2024-11-26T07:22:49.933Z] Total : 15389.68 60.12 0.00 0.00 8312.59 2354.44 16602.45 00:15:04.073 0 00:15:04.073 08:22:49 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 943238 00:15:04.073 08:22:49 -- common/autotest_common.sh@936 -- # '[' -z 943238 ']' 00:15:04.073 08:22:49 -- common/autotest_common.sh@940 -- # kill -0 943238 00:15:04.073 08:22:49 -- common/autotest_common.sh@941 -- # uname 00:15:04.073 08:22:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:04.073 08:22:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 943238 00:15:04.332 08:22:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:04.332 08:22:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:04.332 08:22:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 943238' 00:15:04.332 killing process with pid 943238 00:15:04.332 08:22:49 -- common/autotest_common.sh@955 -- # kill 943238 00:15:04.332 Received shutdown signal, test time was about 10.000000 seconds 00:15:04.332 00:15:04.332 Latency(us) 00:15:04.332 [2024-11-26T07:22:50.192Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.332 [2024-11-26T07:22:50.192Z] =================================================================================================================== 00:15:04.332 [2024-11-26T07:22:50.192Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:04.332 08:22:49 -- common/autotest_common.sh@960 -- # wait 943238 00:15:04.591 08:22:50 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:04.849 08:22:50 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:04.849 08:22:50 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:05.107 08:22:50 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:05.107 08:22:50 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:05.107 08:22:50 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:05.365 [2024-11-26 08:22:51.025514] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:05.365 08:22:51 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:05.365 08:22:51 -- common/autotest_common.sh@650 -- # local es=0 00:15:05.365 08:22:51 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:05.365 08:22:51 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.365 08:22:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.365 08:22:51 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.365 08:22:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.365 08:22:51 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.365 08:22:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.365 08:22:51 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.365 08:22:51 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:05.365 08:22:51 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:05.625 request: 00:15:05.625 { 00:15:05.625 "uuid": "49de38a3-f084-48a9-9c25-8627fc2d8fd4", 00:15:05.625 "method": "bdev_lvol_get_lvstores", 00:15:05.625 "req_id": 1 00:15:05.625 } 00:15:05.625 Got JSON-RPC error response 00:15:05.625 response: 00:15:05.625 { 00:15:05.625 "code": -19, 00:15:05.625 "message": "No such device" 00:15:05.625 } 00:15:05.625 08:22:51 -- common/autotest_common.sh@653 -- # es=1 00:15:05.625 08:22:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:05.625 08:22:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:05.625 08:22:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:05.625 08:22:51 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:05.884 aio_bdev 00:15:05.884 08:22:51 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 01a0c76b-a998-471a-9bed-11d27be4d8e9 00:15:05.884 08:22:51 -- common/autotest_common.sh@897 -- # local bdev_name=01a0c76b-a998-471a-9bed-11d27be4d8e9 00:15:05.884 08:22:51 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:05.884 08:22:51 -- common/autotest_common.sh@899 -- # local i 00:15:05.884 08:22:51 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:05.884 08:22:51 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:05.884 08:22:51 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:06.142 08:22:51 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 01a0c76b-a998-471a-9bed-11d27be4d8e9 -t 2000 00:15:06.402 [ 00:15:06.402 { 00:15:06.402 "name": "01a0c76b-a998-471a-9bed-11d27be4d8e9", 00:15:06.402 "aliases": [ 00:15:06.402 "lvs/lvol" 00:15:06.402 ], 00:15:06.402 "product_name": "Logical Volume", 00:15:06.402 "block_size": 4096, 00:15:06.402 "num_blocks": 38912, 00:15:06.402 "uuid": "01a0c76b-a998-471a-9bed-11d27be4d8e9", 00:15:06.402 "assigned_rate_limits": { 00:15:06.402 "rw_ios_per_sec": 0, 00:15:06.402 "rw_mbytes_per_sec": 0, 00:15:06.402 "r_mbytes_per_sec": 0, 00:15:06.402 "w_mbytes_per_sec": 0 00:15:06.402 }, 00:15:06.402 "claimed": false, 00:15:06.402 "zoned": false, 00:15:06.402 "supported_io_types": { 00:15:06.402 "read": true, 00:15:06.402 "write": true, 00:15:06.402 "unmap": true, 00:15:06.402 "write_zeroes": true, 00:15:06.402 "flush": false, 00:15:06.402 "reset": true, 00:15:06.402 "compare": false, 00:15:06.402 "compare_and_write": false, 00:15:06.402 "abort": false, 00:15:06.402 "nvme_admin": false, 00:15:06.402 "nvme_io": false 00:15:06.402 }, 00:15:06.402 "driver_specific": { 00:15:06.402 "lvol": { 00:15:06.402 "lvol_store_uuid": "49de38a3-f084-48a9-9c25-8627fc2d8fd4", 00:15:06.402 "base_bdev": "aio_bdev", 00:15:06.402 "thin_provision": false, 00:15:06.402 "snapshot": false, 00:15:06.402 "clone": false, 00:15:06.402 "esnap_clone": false 00:15:06.402 } 00:15:06.402 } 00:15:06.402 } 00:15:06.402 ] 00:15:06.402 08:22:52 -- common/autotest_common.sh@905 -- # return 0 00:15:06.402 08:22:52 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:06.402 08:22:52 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:06.662 08:22:52 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:06.662 08:22:52 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:06.662 08:22:52 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:06.923 08:22:52 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:06.923 08:22:52 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 01a0c76b-a998-471a-9bed-11d27be4d8e9 00:15:07.183 08:22:52 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 49de38a3-f084-48a9-9c25-8627fc2d8fd4 00:15:07.442 08:22:53 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:07.699 08:22:53 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.699 00:15:07.699 real 0m17.903s 00:15:07.699 user 0m17.776s 00:15:07.699 sys 0m1.720s 00:15:07.699 08:22:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:07.699 08:22:53 -- common/autotest_common.sh@10 -- # set +x 00:15:07.699 ************************************ 00:15:07.699 END TEST lvs_grow_clean 00:15:07.699 ************************************ 00:15:07.699 08:22:53 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:07.699 08:22:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:07.699 08:22:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:07.699 08:22:53 -- common/autotest_common.sh@10 -- # set +x 00:15:07.699 ************************************ 00:15:07.699 START TEST lvs_grow_dirty 00:15:07.699 ************************************ 00:15:07.699 08:22:53 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:07.699 08:22:53 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:07.699 08:22:53 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:07.700 08:22:53 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:07.959 08:22:53 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:07.959 08:22:53 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:08.218 08:22:53 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:08.218 08:22:53 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:08.218 08:22:53 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:08.476 08:22:54 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:08.476 08:22:54 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:08.476 08:22:54 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 lvol 150 00:15:08.736 08:22:54 -- target/nvmf_lvs_grow.sh@33 -- # lvol=3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:08.736 08:22:54 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.736 08:22:54 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:08.995 [2024-11-26 08:22:54.715003] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:08.995 [2024-11-26 08:22:54.715101] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:08.995 true 00:15:08.995 08:22:54 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:08.995 08:22:54 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:09.255 08:22:54 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:09.255 08:22:54 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:09.542 08:22:55 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:09.815 08:22:55 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:10.081 08:22:55 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:10.340 08:22:56 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=945472 00:15:10.340 08:22:56 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:10.340 08:22:56 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:10.340 08:22:56 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 945472 /var/tmp/bdevperf.sock 00:15:10.340 08:22:56 -- common/autotest_common.sh@829 -- # '[' -z 945472 ']' 00:15:10.340 08:22:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:10.340 08:22:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:10.340 08:22:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:10.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:10.340 08:22:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:10.340 08:22:56 -- common/autotest_common.sh@10 -- # set +x 00:15:10.340 [2024-11-26 08:22:56.087874] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:10.340 [2024-11-26 08:22:56.087966] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid945472 ] 00:15:10.340 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.340 [2024-11-26 08:22:56.147912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.600 [2024-11-26 08:22:56.254384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:11.536 08:22:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:11.537 08:22:57 -- common/autotest_common.sh@862 -- # return 0 00:15:11.537 08:22:57 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:11.796 Nvme0n1 00:15:11.796 08:22:57 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:12.054 [ 00:15:12.054 { 00:15:12.054 "name": "Nvme0n1", 00:15:12.054 "aliases": [ 00:15:12.054 "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0" 00:15:12.054 ], 00:15:12.054 "product_name": "NVMe disk", 00:15:12.054 "block_size": 4096, 00:15:12.054 "num_blocks": 38912, 00:15:12.054 "uuid": "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0", 00:15:12.054 "assigned_rate_limits": { 00:15:12.054 "rw_ios_per_sec": 0, 00:15:12.054 "rw_mbytes_per_sec": 0, 00:15:12.054 "r_mbytes_per_sec": 0, 00:15:12.054 "w_mbytes_per_sec": 0 00:15:12.054 }, 00:15:12.054 "claimed": false, 00:15:12.054 "zoned": false, 00:15:12.054 "supported_io_types": { 00:15:12.054 "read": true, 00:15:12.054 "write": true, 00:15:12.054 "unmap": true, 00:15:12.054 "write_zeroes": true, 00:15:12.054 "flush": true, 00:15:12.054 "reset": true, 00:15:12.054 "compare": true, 00:15:12.054 "compare_and_write": true, 00:15:12.054 "abort": true, 00:15:12.054 "nvme_admin": true, 00:15:12.054 "nvme_io": true 00:15:12.054 }, 00:15:12.054 "driver_specific": { 00:15:12.054 "nvme": [ 00:15:12.054 { 00:15:12.054 "trid": { 00:15:12.054 "trtype": "TCP", 00:15:12.054 "adrfam": "IPv4", 00:15:12.054 "traddr": "10.0.0.2", 00:15:12.054 "trsvcid": "4420", 00:15:12.054 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:12.054 }, 00:15:12.054 "ctrlr_data": { 00:15:12.054 "cntlid": 1, 00:15:12.054 "vendor_id": "0x8086", 00:15:12.054 "model_number": "SPDK bdev Controller", 00:15:12.054 "serial_number": "SPDK0", 00:15:12.054 "firmware_revision": "24.01.1", 00:15:12.054 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:12.054 "oacs": { 00:15:12.054 "security": 0, 00:15:12.054 "format": 0, 00:15:12.054 "firmware": 0, 00:15:12.054 "ns_manage": 0 00:15:12.054 }, 00:15:12.054 "multi_ctrlr": true, 00:15:12.054 "ana_reporting": false 00:15:12.054 }, 00:15:12.054 "vs": { 00:15:12.054 "nvme_version": "1.3" 00:15:12.054 }, 00:15:12.054 "ns_data": { 00:15:12.054 "id": 1, 00:15:12.054 "can_share": true 00:15:12.054 } 00:15:12.054 } 00:15:12.054 ], 00:15:12.054 "mp_policy": "active_passive" 00:15:12.054 } 00:15:12.054 } 00:15:12.054 ] 00:15:12.054 08:22:57 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=945653 00:15:12.054 08:22:57 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:12.054 08:22:57 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:12.054 Running I/O for 10 seconds... 00:15:13.456 Latency(us) 00:15:13.456 [2024-11-26T07:22:59.316Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:13.456 [2024-11-26T07:22:59.316Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.456 Nvme0n1 : 1.00 14765.00 57.68 0.00 0.00 0.00 0.00 0.00 00:15:13.456 [2024-11-26T07:22:59.316Z] =================================================================================================================== 00:15:13.456 [2024-11-26T07:22:59.316Z] Total : 14765.00 57.68 0.00 0.00 0.00 0.00 0.00 00:15:13.456 00:15:14.027 08:22:59 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:14.285 [2024-11-26T07:23:00.145Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.285 Nvme0n1 : 2.00 15108.50 59.02 0.00 0.00 0.00 0.00 0.00 00:15:14.285 [2024-11-26T07:23:00.145Z] =================================================================================================================== 00:15:14.285 [2024-11-26T07:23:00.145Z] Total : 15108.50 59.02 0.00 0.00 0.00 0.00 0.00 00:15:14.285 00:15:14.285 true 00:15:14.285 08:23:00 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:14.285 08:23:00 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:14.545 08:23:00 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:14.545 08:23:00 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:14.545 08:23:00 -- target/nvmf_lvs_grow.sh@65 -- # wait 945653 00:15:15.112 [2024-11-26T07:23:00.972Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.112 Nvme0n1 : 3.00 15200.33 59.38 0.00 0.00 0.00 0.00 0.00 00:15:15.112 [2024-11-26T07:23:00.972Z] =================================================================================================================== 00:15:15.112 [2024-11-26T07:23:00.972Z] Total : 15200.33 59.38 0.00 0.00 0.00 0.00 0.00 00:15:15.112 00:15:16.051 [2024-11-26T07:23:01.911Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.051 Nvme0n1 : 4.00 15248.00 59.56 0.00 0.00 0.00 0.00 0.00 00:15:16.051 [2024-11-26T07:23:01.911Z] =================================================================================================================== 00:15:16.051 [2024-11-26T07:23:01.911Z] Total : 15248.00 59.56 0.00 0.00 0.00 0.00 0.00 00:15:16.051 00:15:17.430 [2024-11-26T07:23:03.290Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.430 Nvme0n1 : 5.00 15288.40 59.72 0.00 0.00 0.00 0.00 0.00 00:15:17.430 [2024-11-26T07:23:03.290Z] =================================================================================================================== 00:15:17.430 [2024-11-26T07:23:03.290Z] Total : 15288.40 59.72 0.00 0.00 0.00 0.00 0.00 00:15:17.430 00:15:18.366 [2024-11-26T07:23:04.226Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.366 Nvme0n1 : 6.00 15327.00 59.87 0.00 0.00 0.00 0.00 0.00 00:15:18.366 [2024-11-26T07:23:04.226Z] =================================================================================================================== 00:15:18.366 [2024-11-26T07:23:04.226Z] Total : 15327.00 59.87 0.00 0.00 0.00 0.00 0.00 00:15:18.366 00:15:19.304 [2024-11-26T07:23:05.164Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.304 Nvme0n1 : 7.00 15369.71 60.04 0.00 0.00 0.00 0.00 0.00 00:15:19.304 [2024-11-26T07:23:05.164Z] =================================================================================================================== 00:15:19.304 [2024-11-26T07:23:05.164Z] Total : 15369.71 60.04 0.00 0.00 0.00 0.00 0.00 00:15:19.304 00:15:20.240 [2024-11-26T07:23:06.100Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.240 Nvme0n1 : 8.00 15403.88 60.17 0.00 0.00 0.00 0.00 0.00 00:15:20.240 [2024-11-26T07:23:06.100Z] =================================================================================================================== 00:15:20.240 [2024-11-26T07:23:06.100Z] Total : 15403.88 60.17 0.00 0.00 0.00 0.00 0.00 00:15:20.240 00:15:21.178 [2024-11-26T07:23:07.038Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.178 Nvme0n1 : 9.00 15421.00 60.24 0.00 0.00 0.00 0.00 0.00 00:15:21.178 [2024-11-26T07:23:07.038Z] =================================================================================================================== 00:15:21.178 [2024-11-26T07:23:07.038Z] Total : 15421.00 60.24 0.00 0.00 0.00 0.00 0.00 00:15:21.178 00:15:22.117 [2024-11-26T07:23:07.977Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.117 Nvme0n1 : 10.00 15430.00 60.27 0.00 0.00 0.00 0.00 0.00 00:15:22.117 [2024-11-26T07:23:07.977Z] =================================================================================================================== 00:15:22.117 [2024-11-26T07:23:07.977Z] Total : 15430.00 60.27 0.00 0.00 0.00 0.00 0.00 00:15:22.117 00:15:22.117 00:15:22.117 Latency(us) 00:15:22.117 [2024-11-26T07:23:07.977Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.117 [2024-11-26T07:23:07.977Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.117 Nvme0n1 : 10.01 15434.06 60.29 0.00 0.00 8288.23 2961.26 16214.09 00:15:22.117 [2024-11-26T07:23:07.977Z] =================================================================================================================== 00:15:22.117 [2024-11-26T07:23:07.977Z] Total : 15434.06 60.29 0.00 0.00 8288.23 2961.26 16214.09 00:15:22.117 0 00:15:22.117 08:23:07 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 945472 00:15:22.117 08:23:07 -- common/autotest_common.sh@936 -- # '[' -z 945472 ']' 00:15:22.117 08:23:07 -- common/autotest_common.sh@940 -- # kill -0 945472 00:15:22.117 08:23:07 -- common/autotest_common.sh@941 -- # uname 00:15:22.117 08:23:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.117 08:23:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 945472 00:15:22.117 08:23:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:22.117 08:23:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:22.117 08:23:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 945472' 00:15:22.117 killing process with pid 945472 00:15:22.117 08:23:07 -- common/autotest_common.sh@955 -- # kill 945472 00:15:22.117 Received shutdown signal, test time was about 10.000000 seconds 00:15:22.117 00:15:22.117 Latency(us) 00:15:22.117 [2024-11-26T07:23:07.977Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.117 [2024-11-26T07:23:07.977Z] =================================================================================================================== 00:15:22.117 [2024-11-26T07:23:07.977Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:22.117 08:23:07 -- common/autotest_common.sh@960 -- # wait 945472 00:15:22.375 08:23:08 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 942772 00:15:22.940 08:23:08 -- target/nvmf_lvs_grow.sh@74 -- # wait 942772 00:15:23.198 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 942772 Killed "${NVMF_APP[@]}" "$@" 00:15:23.198 08:23:08 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:23.198 08:23:08 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:23.198 08:23:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:23.198 08:23:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:23.198 08:23:08 -- common/autotest_common.sh@10 -- # set +x 00:15:23.198 08:23:08 -- nvmf/common.sh@469 -- # nvmfpid=947005 00:15:23.198 08:23:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:23.198 08:23:08 -- nvmf/common.sh@470 -- # waitforlisten 947005 00:15:23.198 08:23:08 -- common/autotest_common.sh@829 -- # '[' -z 947005 ']' 00:15:23.198 08:23:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:23.198 08:23:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:23.198 08:23:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:23.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:23.198 08:23:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:23.198 08:23:08 -- common/autotest_common.sh@10 -- # set +x 00:15:23.198 [2024-11-26 08:23:08.846247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:23.198 [2024-11-26 08:23:08.846352] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:23.198 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.198 [2024-11-26 08:23:08.911695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.198 [2024-11-26 08:23:09.017474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:23.198 [2024-11-26 08:23:09.017630] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.198 [2024-11-26 08:23:09.017647] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.198 [2024-11-26 08:23:09.017659] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.198 [2024-11-26 08:23:09.017710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:24.135 08:23:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:24.135 08:23:09 -- common/autotest_common.sh@862 -- # return 0 00:15:24.135 08:23:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:24.135 08:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:24.135 08:23:09 -- common/autotest_common.sh@10 -- # set +x 00:15:24.135 08:23:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:24.135 08:23:09 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.395 [2024-11-26 08:23:10.081246] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:24.395 [2024-11-26 08:23:10.081418] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:24.395 [2024-11-26 08:23:10.081468] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:24.395 08:23:10 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:24.395 08:23:10 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:24.395 08:23:10 -- common/autotest_common.sh@897 -- # local bdev_name=3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:24.395 08:23:10 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:24.395 08:23:10 -- common/autotest_common.sh@899 -- # local i 00:15:24.395 08:23:10 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:24.395 08:23:10 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:24.395 08:23:10 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:24.654 08:23:10 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 -t 2000 00:15:24.914 [ 00:15:24.914 { 00:15:24.914 "name": "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0", 00:15:24.914 "aliases": [ 00:15:24.914 "lvs/lvol" 00:15:24.914 ], 00:15:24.914 "product_name": "Logical Volume", 00:15:24.914 "block_size": 4096, 00:15:24.914 "num_blocks": 38912, 00:15:24.914 "uuid": "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0", 00:15:24.914 "assigned_rate_limits": { 00:15:24.914 "rw_ios_per_sec": 0, 00:15:24.914 "rw_mbytes_per_sec": 0, 00:15:24.914 "r_mbytes_per_sec": 0, 00:15:24.914 "w_mbytes_per_sec": 0 00:15:24.914 }, 00:15:24.914 "claimed": false, 00:15:24.914 "zoned": false, 00:15:24.914 "supported_io_types": { 00:15:24.914 "read": true, 00:15:24.914 "write": true, 00:15:24.915 "unmap": true, 00:15:24.915 "write_zeroes": true, 00:15:24.915 "flush": false, 00:15:24.915 "reset": true, 00:15:24.915 "compare": false, 00:15:24.915 "compare_and_write": false, 00:15:24.915 "abort": false, 00:15:24.915 "nvme_admin": false, 00:15:24.915 "nvme_io": false 00:15:24.915 }, 00:15:24.915 "driver_specific": { 00:15:24.915 "lvol": { 00:15:24.915 "lvol_store_uuid": "d3f2db35-adbc-4f16-bfba-61cd84cb1e19", 00:15:24.915 "base_bdev": "aio_bdev", 00:15:24.915 "thin_provision": false, 00:15:24.915 "snapshot": false, 00:15:24.915 "clone": false, 00:15:24.915 "esnap_clone": false 00:15:24.915 } 00:15:24.915 } 00:15:24.915 } 00:15:24.915 ] 00:15:24.915 08:23:10 -- common/autotest_common.sh@905 -- # return 0 00:15:24.915 08:23:10 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:24.915 08:23:10 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:25.174 08:23:10 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:25.174 08:23:10 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:25.174 08:23:10 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:25.434 08:23:11 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:25.434 08:23:11 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:25.693 [2024-11-26 08:23:11.410339] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:25.693 08:23:11 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:25.693 08:23:11 -- common/autotest_common.sh@650 -- # local es=0 00:15:25.693 08:23:11 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:25.693 08:23:11 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.693 08:23:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.693 08:23:11 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.693 08:23:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.693 08:23:11 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.693 08:23:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:25.693 08:23:11 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.693 08:23:11 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:25.693 08:23:11 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:25.953 request: 00:15:25.953 { 00:15:25.953 "uuid": "d3f2db35-adbc-4f16-bfba-61cd84cb1e19", 00:15:25.953 "method": "bdev_lvol_get_lvstores", 00:15:25.953 "req_id": 1 00:15:25.953 } 00:15:25.953 Got JSON-RPC error response 00:15:25.953 response: 00:15:25.953 { 00:15:25.953 "code": -19, 00:15:25.953 "message": "No such device" 00:15:25.953 } 00:15:25.953 08:23:11 -- common/autotest_common.sh@653 -- # es=1 00:15:25.953 08:23:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:25.953 08:23:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:25.953 08:23:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:25.953 08:23:11 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:26.214 aio_bdev 00:15:26.214 08:23:12 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:26.214 08:23:12 -- common/autotest_common.sh@897 -- # local bdev_name=3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:26.214 08:23:12 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:26.214 08:23:12 -- common/autotest_common.sh@899 -- # local i 00:15:26.214 08:23:12 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:26.214 08:23:12 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:26.214 08:23:12 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:26.474 08:23:12 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 -t 2000 00:15:26.733 [ 00:15:26.734 { 00:15:26.734 "name": "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0", 00:15:26.734 "aliases": [ 00:15:26.734 "lvs/lvol" 00:15:26.734 ], 00:15:26.734 "product_name": "Logical Volume", 00:15:26.734 "block_size": 4096, 00:15:26.734 "num_blocks": 38912, 00:15:26.734 "uuid": "3d02155f-82f7-4120-82ff-8d5f6cd0e7b0", 00:15:26.734 "assigned_rate_limits": { 00:15:26.734 "rw_ios_per_sec": 0, 00:15:26.734 "rw_mbytes_per_sec": 0, 00:15:26.734 "r_mbytes_per_sec": 0, 00:15:26.734 "w_mbytes_per_sec": 0 00:15:26.734 }, 00:15:26.734 "claimed": false, 00:15:26.734 "zoned": false, 00:15:26.734 "supported_io_types": { 00:15:26.734 "read": true, 00:15:26.734 "write": true, 00:15:26.734 "unmap": true, 00:15:26.734 "write_zeroes": true, 00:15:26.734 "flush": false, 00:15:26.734 "reset": true, 00:15:26.734 "compare": false, 00:15:26.734 "compare_and_write": false, 00:15:26.734 "abort": false, 00:15:26.734 "nvme_admin": false, 00:15:26.734 "nvme_io": false 00:15:26.734 }, 00:15:26.734 "driver_specific": { 00:15:26.734 "lvol": { 00:15:26.734 "lvol_store_uuid": "d3f2db35-adbc-4f16-bfba-61cd84cb1e19", 00:15:26.734 "base_bdev": "aio_bdev", 00:15:26.734 "thin_provision": false, 00:15:26.734 "snapshot": false, 00:15:26.734 "clone": false, 00:15:26.734 "esnap_clone": false 00:15:26.734 } 00:15:26.734 } 00:15:26.734 } 00:15:26.734 ] 00:15:26.734 08:23:12 -- common/autotest_common.sh@905 -- # return 0 00:15:26.734 08:23:12 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:26.734 08:23:12 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:27.301 08:23:12 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:27.301 08:23:12 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:27.301 08:23:12 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:27.301 08:23:13 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:27.301 08:23:13 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3d02155f-82f7-4120-82ff-8d5f6cd0e7b0 00:15:27.560 08:23:13 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d3f2db35-adbc-4f16-bfba-61cd84cb1e19 00:15:28.127 08:23:13 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:28.127 08:23:13 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:28.385 00:15:28.385 real 0m20.564s 00:15:28.385 user 0m51.379s 00:15:28.385 sys 0m4.626s 00:15:28.385 08:23:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:28.385 08:23:14 -- common/autotest_common.sh@10 -- # set +x 00:15:28.385 ************************************ 00:15:28.385 END TEST lvs_grow_dirty 00:15:28.385 ************************************ 00:15:28.385 08:23:14 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:28.385 08:23:14 -- common/autotest_common.sh@806 -- # type=--id 00:15:28.385 08:23:14 -- common/autotest_common.sh@807 -- # id=0 00:15:28.385 08:23:14 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:28.385 08:23:14 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:28.385 08:23:14 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:28.385 08:23:14 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:28.385 08:23:14 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:28.385 08:23:14 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:28.385 nvmf_trace.0 00:15:28.385 08:23:14 -- common/autotest_common.sh@821 -- # return 0 00:15:28.385 08:23:14 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:28.385 08:23:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:28.385 08:23:14 -- nvmf/common.sh@116 -- # sync 00:15:28.385 08:23:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:28.385 08:23:14 -- nvmf/common.sh@119 -- # set +e 00:15:28.385 08:23:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:28.385 08:23:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:28.385 rmmod nvme_tcp 00:15:28.385 rmmod nvme_fabrics 00:15:28.385 rmmod nvme_keyring 00:15:28.385 08:23:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.385 08:23:14 -- nvmf/common.sh@123 -- # set -e 00:15:28.385 08:23:14 -- nvmf/common.sh@124 -- # return 0 00:15:28.385 08:23:14 -- nvmf/common.sh@477 -- # '[' -n 947005 ']' 00:15:28.385 08:23:14 -- nvmf/common.sh@478 -- # killprocess 947005 00:15:28.385 08:23:14 -- common/autotest_common.sh@936 -- # '[' -z 947005 ']' 00:15:28.385 08:23:14 -- common/autotest_common.sh@940 -- # kill -0 947005 00:15:28.385 08:23:14 -- common/autotest_common.sh@941 -- # uname 00:15:28.385 08:23:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:28.385 08:23:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 947005 00:15:28.385 08:23:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:28.385 08:23:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:28.385 08:23:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 947005' 00:15:28.385 killing process with pid 947005 00:15:28.385 08:23:14 -- common/autotest_common.sh@955 -- # kill 947005 00:15:28.385 08:23:14 -- common/autotest_common.sh@960 -- # wait 947005 00:15:28.644 08:23:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.644 08:23:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.644 08:23:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.644 08:23:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.644 08:23:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.644 08:23:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.644 08:23:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.644 08:23:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.183 08:23:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:31.183 00:15:31.183 real 0m44.587s 00:15:31.183 user 1m16.092s 00:15:31.183 sys 0m8.254s 00:15:31.183 08:23:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:31.183 08:23:16 -- common/autotest_common.sh@10 -- # set +x 00:15:31.183 ************************************ 00:15:31.183 END TEST nvmf_lvs_grow 00:15:31.183 ************************************ 00:15:31.183 08:23:16 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:31.183 08:23:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:31.183 08:23:16 -- common/autotest_common.sh@10 -- # set +x 00:15:31.183 ************************************ 00:15:31.183 START TEST nvmf_bdev_io_wait 00:15:31.183 ************************************ 00:15:31.183 08:23:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:31.183 * Looking for test storage... 00:15:31.183 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:31.183 08:23:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:31.183 08:23:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:31.183 08:23:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:31.183 08:23:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:31.183 08:23:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:31.183 08:23:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:31.183 08:23:16 -- scripts/common.sh@335 -- # IFS=.-: 00:15:31.183 08:23:16 -- scripts/common.sh@335 -- # read -ra ver1 00:15:31.183 08:23:16 -- scripts/common.sh@336 -- # IFS=.-: 00:15:31.183 08:23:16 -- scripts/common.sh@336 -- # read -ra ver2 00:15:31.183 08:23:16 -- scripts/common.sh@337 -- # local 'op=<' 00:15:31.183 08:23:16 -- scripts/common.sh@339 -- # ver1_l=2 00:15:31.183 08:23:16 -- scripts/common.sh@340 -- # ver2_l=1 00:15:31.183 08:23:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:31.183 08:23:16 -- scripts/common.sh@343 -- # case "$op" in 00:15:31.183 08:23:16 -- scripts/common.sh@344 -- # : 1 00:15:31.183 08:23:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:31.183 08:23:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:31.183 08:23:16 -- scripts/common.sh@364 -- # decimal 1 00:15:31.183 08:23:16 -- scripts/common.sh@352 -- # local d=1 00:15:31.183 08:23:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:31.183 08:23:16 -- scripts/common.sh@354 -- # echo 1 00:15:31.183 08:23:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:31.183 08:23:16 -- scripts/common.sh@365 -- # decimal 2 00:15:31.183 08:23:16 -- scripts/common.sh@352 -- # local d=2 00:15:31.183 08:23:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:31.183 08:23:16 -- scripts/common.sh@354 -- # echo 2 00:15:31.183 08:23:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:31.183 08:23:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:31.183 08:23:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:31.183 08:23:16 -- scripts/common.sh@367 -- # return 0 00:15:31.183 08:23:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:31.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.183 --rc genhtml_branch_coverage=1 00:15:31.183 --rc genhtml_function_coverage=1 00:15:31.183 --rc genhtml_legend=1 00:15:31.183 --rc geninfo_all_blocks=1 00:15:31.183 --rc geninfo_unexecuted_blocks=1 00:15:31.183 00:15:31.183 ' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:31.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.183 --rc genhtml_branch_coverage=1 00:15:31.183 --rc genhtml_function_coverage=1 00:15:31.183 --rc genhtml_legend=1 00:15:31.183 --rc geninfo_all_blocks=1 00:15:31.183 --rc geninfo_unexecuted_blocks=1 00:15:31.183 00:15:31.183 ' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:31.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.183 --rc genhtml_branch_coverage=1 00:15:31.183 --rc genhtml_function_coverage=1 00:15:31.183 --rc genhtml_legend=1 00:15:31.183 --rc geninfo_all_blocks=1 00:15:31.183 --rc geninfo_unexecuted_blocks=1 00:15:31.183 00:15:31.183 ' 00:15:31.183 08:23:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:31.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.183 --rc genhtml_branch_coverage=1 00:15:31.183 --rc genhtml_function_coverage=1 00:15:31.183 --rc genhtml_legend=1 00:15:31.183 --rc geninfo_all_blocks=1 00:15:31.183 --rc geninfo_unexecuted_blocks=1 00:15:31.183 00:15:31.183 ' 00:15:31.183 08:23:16 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:31.183 08:23:16 -- nvmf/common.sh@7 -- # uname -s 00:15:31.183 08:23:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:31.183 08:23:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:31.183 08:23:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:31.183 08:23:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:31.183 08:23:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:31.183 08:23:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:31.183 08:23:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:31.183 08:23:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:31.183 08:23:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:31.183 08:23:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:31.183 08:23:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.183 08:23:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.183 08:23:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:31.183 08:23:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:31.183 08:23:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:31.183 08:23:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:31.183 08:23:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:31.183 08:23:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:31.183 08:23:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:31.183 08:23:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.183 08:23:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.183 08:23:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.183 08:23:16 -- paths/export.sh@5 -- # export PATH 00:15:31.183 08:23:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.183 08:23:16 -- nvmf/common.sh@46 -- # : 0 00:15:31.183 08:23:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:31.183 08:23:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:31.183 08:23:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:31.183 08:23:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:31.183 08:23:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:31.183 08:23:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:31.183 08:23:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:31.183 08:23:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:31.184 08:23:16 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:31.184 08:23:16 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:31.184 08:23:16 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:31.184 08:23:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:31.184 08:23:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:31.184 08:23:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:31.184 08:23:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:31.184 08:23:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:31.184 08:23:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:31.184 08:23:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:31.184 08:23:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.184 08:23:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:31.184 08:23:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:31.184 08:23:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:31.184 08:23:16 -- common/autotest_common.sh@10 -- # set +x 00:15:33.088 08:23:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:33.088 08:23:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:33.088 08:23:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:33.088 08:23:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:33.088 08:23:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:33.088 08:23:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:33.088 08:23:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:33.088 08:23:18 -- nvmf/common.sh@294 -- # net_devs=() 00:15:33.088 08:23:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:33.088 08:23:18 -- nvmf/common.sh@295 -- # e810=() 00:15:33.088 08:23:18 -- nvmf/common.sh@295 -- # local -ga e810 00:15:33.088 08:23:18 -- nvmf/common.sh@296 -- # x722=() 00:15:33.088 08:23:18 -- nvmf/common.sh@296 -- # local -ga x722 00:15:33.088 08:23:18 -- nvmf/common.sh@297 -- # mlx=() 00:15:33.088 08:23:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:33.088 08:23:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:33.088 08:23:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.088 08:23:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:33.088 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:33.088 08:23:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.088 08:23:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:33.088 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:33.088 08:23:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.088 08:23:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.088 08:23:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.088 08:23:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:33.088 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:33.088 08:23:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.088 08:23:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.088 08:23:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.088 08:23:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:33.088 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:33.088 08:23:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:33.088 08:23:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:33.088 08:23:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:33.088 08:23:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:33.088 08:23:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:33.088 08:23:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:33.088 08:23:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:33.088 08:23:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:33.088 08:23:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:33.088 08:23:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:33.088 08:23:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:33.088 08:23:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:33.088 08:23:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:33.088 08:23:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:33.088 08:23:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:33.088 08:23:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:33.088 08:23:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:33.088 08:23:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:33.088 08:23:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:33.088 08:23:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:33.088 08:23:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:33.088 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:33.088 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:15:33.088 00:15:33.088 --- 10.0.0.2 ping statistics --- 00:15:33.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.088 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:15:33.088 08:23:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:33.088 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:33.088 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.201 ms 00:15:33.088 00:15:33.088 --- 10.0.0.1 ping statistics --- 00:15:33.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.088 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:15:33.088 08:23:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:33.088 08:23:18 -- nvmf/common.sh@410 -- # return 0 00:15:33.088 08:23:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:33.088 08:23:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:33.088 08:23:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:33.088 08:23:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:33.089 08:23:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:33.089 08:23:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:33.089 08:23:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:33.089 08:23:18 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:33.089 08:23:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:33.089 08:23:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:33.089 08:23:18 -- common/autotest_common.sh@10 -- # set +x 00:15:33.089 08:23:18 -- nvmf/common.sh@469 -- # nvmfpid=949694 00:15:33.089 08:23:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:33.089 08:23:18 -- nvmf/common.sh@470 -- # waitforlisten 949694 00:15:33.089 08:23:18 -- common/autotest_common.sh@829 -- # '[' -z 949694 ']' 00:15:33.089 08:23:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:33.089 08:23:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:33.089 08:23:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:33.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:33.089 08:23:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:33.089 08:23:18 -- common/autotest_common.sh@10 -- # set +x 00:15:33.089 [2024-11-26 08:23:18.917158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.089 [2024-11-26 08:23:18.917251] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:33.348 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.348 [2024-11-26 08:23:18.988316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:33.348 [2024-11-26 08:23:19.098081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:33.348 [2024-11-26 08:23:19.098249] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:33.348 [2024-11-26 08:23:19.098280] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:33.348 [2024-11-26 08:23:19.098293] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:33.348 [2024-11-26 08:23:19.098356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:33.348 [2024-11-26 08:23:19.101706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:33.348 [2024-11-26 08:23:19.101750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:33.348 [2024-11-26 08:23:19.101754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:33.348 08:23:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:33.348 08:23:19 -- common/autotest_common.sh@862 -- # return 0 00:15:33.348 08:23:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:33.348 08:23:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:33.348 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.348 08:23:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:33.348 08:23:19 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:33.348 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.348 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.348 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.348 08:23:19 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:33.348 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.348 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:33.607 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.607 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 [2024-11-26 08:23:19.267273] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:33.607 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.607 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 Malloc0 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:33.607 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.607 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:33.607 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.607 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:33.607 08:23:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.607 08:23:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.607 [2024-11-26 08:23:19.328099] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:33.607 08:23:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=949725 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@30 -- # READ_PID=949727 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:33.607 08:23:19 -- nvmf/common.sh@520 -- # config=() 00:15:33.607 08:23:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.607 08:23:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.607 08:23:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.607 { 00:15:33.607 "params": { 00:15:33.607 "name": "Nvme$subsystem", 00:15:33.607 "trtype": "$TEST_TRANSPORT", 00:15:33.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.607 "adrfam": "ipv4", 00:15:33.607 "trsvcid": "$NVMF_PORT", 00:15:33.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.607 "hdgst": ${hdgst:-false}, 00:15:33.607 "ddgst": ${ddgst:-false} 00:15:33.607 }, 00:15:33.607 "method": "bdev_nvme_attach_controller" 00:15:33.607 } 00:15:33.607 EOF 00:15:33.607 )") 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=949729 00:15:33.607 08:23:19 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # config=() 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.608 08:23:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.608 { 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme$subsystem", 00:15:33.608 "trtype": "$TEST_TRANSPORT", 00:15:33.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "$NVMF_PORT", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.608 "hdgst": ${hdgst:-false}, 00:15:33.608 "ddgst": ${ddgst:-false} 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 } 00:15:33.608 EOF 00:15:33.608 )") 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=949733 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # config=() 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@35 -- # sync 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # cat 00:15:33.608 08:23:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.608 { 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme$subsystem", 00:15:33.608 "trtype": "$TEST_TRANSPORT", 00:15:33.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "$NVMF_PORT", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.608 "hdgst": ${hdgst:-false}, 00:15:33.608 "ddgst": ${ddgst:-false} 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 } 00:15:33.608 EOF 00:15:33.608 )") 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # config=() 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # cat 00:15:33.608 08:23:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.608 08:23:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.608 { 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme$subsystem", 00:15:33.608 "trtype": "$TEST_TRANSPORT", 00:15:33.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "$NVMF_PORT", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.608 "hdgst": ${hdgst:-false}, 00:15:33.608 "ddgst": ${ddgst:-false} 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 } 00:15:33.608 EOF 00:15:33.608 )") 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # cat 00:15:33.608 08:23:19 -- target/bdev_io_wait.sh@37 -- # wait 949725 00:15:33.608 08:23:19 -- nvmf/common.sh@542 -- # cat 00:15:33.608 08:23:19 -- nvmf/common.sh@544 -- # jq . 00:15:33.608 08:23:19 -- nvmf/common.sh@544 -- # jq . 00:15:33.608 08:23:19 -- nvmf/common.sh@544 -- # jq . 00:15:33.608 08:23:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.608 08:23:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme1", 00:15:33.608 "trtype": "tcp", 00:15:33.608 "traddr": "10.0.0.2", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "4420", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.608 "hdgst": false, 00:15:33.608 "ddgst": false 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 }' 00:15:33.608 08:23:19 -- nvmf/common.sh@544 -- # jq . 00:15:33.608 08:23:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.608 08:23:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme1", 00:15:33.608 "trtype": "tcp", 00:15:33.608 "traddr": "10.0.0.2", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "4420", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.608 "hdgst": false, 00:15:33.608 "ddgst": false 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 }' 00:15:33.608 08:23:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.608 08:23:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme1", 00:15:33.608 "trtype": "tcp", 00:15:33.608 "traddr": "10.0.0.2", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "4420", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.608 "hdgst": false, 00:15:33.608 "ddgst": false 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 }' 00:15:33.608 08:23:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.608 08:23:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.608 "params": { 00:15:33.608 "name": "Nvme1", 00:15:33.608 "trtype": "tcp", 00:15:33.608 "traddr": "10.0.0.2", 00:15:33.608 "adrfam": "ipv4", 00:15:33.608 "trsvcid": "4420", 00:15:33.608 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.608 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.608 "hdgst": false, 00:15:33.608 "ddgst": false 00:15:33.608 }, 00:15:33.608 "method": "bdev_nvme_attach_controller" 00:15:33.608 }' 00:15:33.608 [2024-11-26 08:23:19.370083] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.608 [2024-11-26 08:23:19.370083] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.608 [2024-11-26 08:23:19.370168] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 08:23:19.370169] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:33.608 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:33.608 [2024-11-26 08:23:19.370729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.608 [2024-11-26 08:23:19.370787] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:33.608 [2024-11-26 08:23:19.371304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.608 [2024-11-26 08:23:19.371372] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:33.608 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.866 [2024-11-26 08:23:19.549654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:33.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.866 [2024-11-26 08:23:19.644956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:33.866 [2024-11-26 08:23:19.650063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:33.866 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.124 [2024-11-26 08:23:19.746050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:34.124 [2024-11-26 08:23:19.749280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.124 [2024-11-26 08:23:19.819727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.124 [2024-11-26 08:23:19.841513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:34.124 [2024-11-26 08:23:19.907960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:34.124 Running I/O for 1 seconds... 00:15:34.124 Running I/O for 1 seconds... 00:15:34.384 Running I/O for 1 seconds... 00:15:34.384 Running I/O for 1 seconds... 00:15:35.320 00:15:35.320 Latency(us) 00:15:35.320 [2024-11-26T07:23:21.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.321 [2024-11-26T07:23:21.181Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:35.321 Nvme1n1 : 1.01 9776.89 38.19 0.00 0.00 13042.29 6650.69 22719.15 00:15:35.321 [2024-11-26T07:23:21.181Z] =================================================================================================================== 00:15:35.321 [2024-11-26T07:23:21.181Z] Total : 9776.89 38.19 0.00 0.00 13042.29 6650.69 22719.15 00:15:35.321 00:15:35.321 Latency(us) 00:15:35.321 [2024-11-26T07:23:21.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.321 [2024-11-26T07:23:21.181Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:35.321 Nvme1n1 : 1.01 8758.29 34.21 0.00 0.00 14548.05 8738.13 25437.68 00:15:35.321 [2024-11-26T07:23:21.181Z] =================================================================================================================== 00:15:35.321 [2024-11-26T07:23:21.181Z] Total : 8758.29 34.21 0.00 0.00 14548.05 8738.13 25437.68 00:15:35.321 00:15:35.321 Latency(us) 00:15:35.321 [2024-11-26T07:23:21.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.321 [2024-11-26T07:23:21.181Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:35.321 Nvme1n1 : 1.00 189613.22 740.68 0.00 0.00 672.51 260.93 849.54 00:15:35.321 [2024-11-26T07:23:21.181Z] =================================================================================================================== 00:15:35.321 [2024-11-26T07:23:21.181Z] Total : 189613.22 740.68 0.00 0.00 672.51 260.93 849.54 00:15:35.321 00:15:35.321 Latency(us) 00:15:35.321 [2024-11-26T07:23:21.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.321 [2024-11-26T07:23:21.181Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:35.321 Nvme1n1 : 1.01 10300.75 40.24 0.00 0.00 12376.20 2985.53 19903.53 00:15:35.321 [2024-11-26T07:23:21.181Z] =================================================================================================================== 00:15:35.321 [2024-11-26T07:23:21.181Z] Total : 10300.75 40.24 0.00 0.00 12376.20 2985.53 19903.53 00:15:35.578 08:23:21 -- target/bdev_io_wait.sh@38 -- # wait 949727 00:15:35.578 08:23:21 -- target/bdev_io_wait.sh@39 -- # wait 949729 00:15:35.578 08:23:21 -- target/bdev_io_wait.sh@40 -- # wait 949733 00:15:35.836 08:23:21 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:35.836 08:23:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.836 08:23:21 -- common/autotest_common.sh@10 -- # set +x 00:15:35.836 08:23:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.836 08:23:21 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:35.836 08:23:21 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:35.836 08:23:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:35.836 08:23:21 -- nvmf/common.sh@116 -- # sync 00:15:35.836 08:23:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:35.836 08:23:21 -- nvmf/common.sh@119 -- # set +e 00:15:35.836 08:23:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:35.836 08:23:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:35.836 rmmod nvme_tcp 00:15:35.836 rmmod nvme_fabrics 00:15:35.836 rmmod nvme_keyring 00:15:35.836 08:23:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:35.836 08:23:21 -- nvmf/common.sh@123 -- # set -e 00:15:35.836 08:23:21 -- nvmf/common.sh@124 -- # return 0 00:15:35.836 08:23:21 -- nvmf/common.sh@477 -- # '[' -n 949694 ']' 00:15:35.836 08:23:21 -- nvmf/common.sh@478 -- # killprocess 949694 00:15:35.836 08:23:21 -- common/autotest_common.sh@936 -- # '[' -z 949694 ']' 00:15:35.836 08:23:21 -- common/autotest_common.sh@940 -- # kill -0 949694 00:15:35.836 08:23:21 -- common/autotest_common.sh@941 -- # uname 00:15:35.836 08:23:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:35.836 08:23:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 949694 00:15:35.836 08:23:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:35.836 08:23:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:35.836 08:23:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 949694' 00:15:35.836 killing process with pid 949694 00:15:35.836 08:23:21 -- common/autotest_common.sh@955 -- # kill 949694 00:15:35.836 08:23:21 -- common/autotest_common.sh@960 -- # wait 949694 00:15:36.095 08:23:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:36.095 08:23:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:36.095 08:23:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:36.095 08:23:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:36.095 08:23:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:36.095 08:23:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.095 08:23:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.095 08:23:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.004 08:23:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:38.263 00:15:38.263 real 0m7.384s 00:15:38.263 user 0m16.087s 00:15:38.263 sys 0m3.897s 00:15:38.263 08:23:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:38.263 08:23:23 -- common/autotest_common.sh@10 -- # set +x 00:15:38.263 ************************************ 00:15:38.263 END TEST nvmf_bdev_io_wait 00:15:38.263 ************************************ 00:15:38.263 08:23:23 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.263 08:23:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:38.263 08:23:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:38.263 08:23:23 -- common/autotest_common.sh@10 -- # set +x 00:15:38.263 ************************************ 00:15:38.263 START TEST nvmf_queue_depth 00:15:38.263 ************************************ 00:15:38.263 08:23:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.263 * Looking for test storage... 00:15:38.263 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:38.263 08:23:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:38.263 08:23:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:38.263 08:23:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:38.263 08:23:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:38.263 08:23:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:38.263 08:23:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:38.263 08:23:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:38.263 08:23:24 -- scripts/common.sh@335 -- # IFS=.-: 00:15:38.263 08:23:24 -- scripts/common.sh@335 -- # read -ra ver1 00:15:38.263 08:23:24 -- scripts/common.sh@336 -- # IFS=.-: 00:15:38.263 08:23:24 -- scripts/common.sh@336 -- # read -ra ver2 00:15:38.263 08:23:24 -- scripts/common.sh@337 -- # local 'op=<' 00:15:38.263 08:23:24 -- scripts/common.sh@339 -- # ver1_l=2 00:15:38.263 08:23:24 -- scripts/common.sh@340 -- # ver2_l=1 00:15:38.263 08:23:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:38.263 08:23:24 -- scripts/common.sh@343 -- # case "$op" in 00:15:38.263 08:23:24 -- scripts/common.sh@344 -- # : 1 00:15:38.263 08:23:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:38.263 08:23:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:38.263 08:23:24 -- scripts/common.sh@364 -- # decimal 1 00:15:38.263 08:23:24 -- scripts/common.sh@352 -- # local d=1 00:15:38.263 08:23:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:38.263 08:23:24 -- scripts/common.sh@354 -- # echo 1 00:15:38.263 08:23:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:38.263 08:23:24 -- scripts/common.sh@365 -- # decimal 2 00:15:38.263 08:23:24 -- scripts/common.sh@352 -- # local d=2 00:15:38.263 08:23:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:38.263 08:23:24 -- scripts/common.sh@354 -- # echo 2 00:15:38.263 08:23:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:38.263 08:23:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:38.263 08:23:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:38.263 08:23:24 -- scripts/common.sh@367 -- # return 0 00:15:38.263 08:23:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:38.263 08:23:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:38.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.263 --rc genhtml_branch_coverage=1 00:15:38.263 --rc genhtml_function_coverage=1 00:15:38.263 --rc genhtml_legend=1 00:15:38.263 --rc geninfo_all_blocks=1 00:15:38.263 --rc geninfo_unexecuted_blocks=1 00:15:38.263 00:15:38.263 ' 00:15:38.263 08:23:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:38.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.263 --rc genhtml_branch_coverage=1 00:15:38.263 --rc genhtml_function_coverage=1 00:15:38.263 --rc genhtml_legend=1 00:15:38.263 --rc geninfo_all_blocks=1 00:15:38.263 --rc geninfo_unexecuted_blocks=1 00:15:38.263 00:15:38.263 ' 00:15:38.263 08:23:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:38.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.263 --rc genhtml_branch_coverage=1 00:15:38.263 --rc genhtml_function_coverage=1 00:15:38.263 --rc genhtml_legend=1 00:15:38.263 --rc geninfo_all_blocks=1 00:15:38.263 --rc geninfo_unexecuted_blocks=1 00:15:38.263 00:15:38.263 ' 00:15:38.263 08:23:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:38.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.263 --rc genhtml_branch_coverage=1 00:15:38.263 --rc genhtml_function_coverage=1 00:15:38.263 --rc genhtml_legend=1 00:15:38.263 --rc geninfo_all_blocks=1 00:15:38.263 --rc geninfo_unexecuted_blocks=1 00:15:38.263 00:15:38.263 ' 00:15:38.263 08:23:24 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:38.263 08:23:24 -- nvmf/common.sh@7 -- # uname -s 00:15:38.263 08:23:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:38.263 08:23:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:38.263 08:23:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:38.263 08:23:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:38.263 08:23:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:38.263 08:23:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:38.263 08:23:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:38.263 08:23:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:38.263 08:23:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:38.263 08:23:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:38.263 08:23:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.263 08:23:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.263 08:23:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:38.263 08:23:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:38.263 08:23:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:38.263 08:23:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:38.263 08:23:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:38.263 08:23:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:38.263 08:23:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:38.263 08:23:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.263 08:23:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.263 08:23:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.263 08:23:24 -- paths/export.sh@5 -- # export PATH 00:15:38.263 08:23:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.263 08:23:24 -- nvmf/common.sh@46 -- # : 0 00:15:38.263 08:23:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:38.263 08:23:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:38.263 08:23:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:38.263 08:23:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:38.263 08:23:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:38.263 08:23:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:38.263 08:23:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:38.263 08:23:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:38.263 08:23:24 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:38.263 08:23:24 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:38.263 08:23:24 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:38.263 08:23:24 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:38.263 08:23:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:38.263 08:23:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:38.263 08:23:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:38.263 08:23:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:38.263 08:23:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:38.263 08:23:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:38.263 08:23:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:38.264 08:23:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.264 08:23:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:38.264 08:23:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:38.264 08:23:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:38.264 08:23:24 -- common/autotest_common.sh@10 -- # set +x 00:15:40.168 08:23:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:40.168 08:23:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:40.168 08:23:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:40.168 08:23:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:40.168 08:23:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:40.168 08:23:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:40.168 08:23:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:40.168 08:23:26 -- nvmf/common.sh@294 -- # net_devs=() 00:15:40.168 08:23:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:40.168 08:23:26 -- nvmf/common.sh@295 -- # e810=() 00:15:40.168 08:23:26 -- nvmf/common.sh@295 -- # local -ga e810 00:15:40.168 08:23:26 -- nvmf/common.sh@296 -- # x722=() 00:15:40.168 08:23:26 -- nvmf/common.sh@296 -- # local -ga x722 00:15:40.168 08:23:26 -- nvmf/common.sh@297 -- # mlx=() 00:15:40.168 08:23:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:40.168 08:23:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:40.168 08:23:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:40.168 08:23:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:40.168 08:23:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:40.168 08:23:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:40.168 08:23:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:40.169 08:23:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.169 08:23:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:40.169 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:40.169 08:23:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.169 08:23:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:40.169 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:40.169 08:23:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.169 08:23:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.169 08:23:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.169 08:23:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:40.169 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:40.169 08:23:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.169 08:23:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.169 08:23:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.169 08:23:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.169 08:23:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:40.169 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:40.169 08:23:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.169 08:23:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:40.169 08:23:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:40.169 08:23:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:40.169 08:23:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:40.169 08:23:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:40.169 08:23:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:40.169 08:23:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:40.169 08:23:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:40.169 08:23:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:40.169 08:23:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:40.169 08:23:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:40.169 08:23:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:40.169 08:23:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:40.169 08:23:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:40.169 08:23:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:40.169 08:23:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:40.427 08:23:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:40.427 08:23:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:40.427 08:23:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:40.427 08:23:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:40.427 08:23:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:40.427 08:23:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:40.427 08:23:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:40.427 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:40.427 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:15:40.427 00:15:40.427 --- 10.0.0.2 ping statistics --- 00:15:40.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.427 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:15:40.427 08:23:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:40.427 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:40.427 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:40.427 00:15:40.427 --- 10.0.0.1 ping statistics --- 00:15:40.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.427 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:40.427 08:23:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:40.427 08:23:26 -- nvmf/common.sh@410 -- # return 0 00:15:40.427 08:23:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:40.427 08:23:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:40.427 08:23:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:40.427 08:23:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:40.427 08:23:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:40.427 08:23:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:40.427 08:23:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:40.427 08:23:26 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:40.428 08:23:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:40.428 08:23:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:40.428 08:23:26 -- common/autotest_common.sh@10 -- # set +x 00:15:40.428 08:23:26 -- nvmf/common.sh@469 -- # nvmfpid=952052 00:15:40.428 08:23:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:40.428 08:23:26 -- nvmf/common.sh@470 -- # waitforlisten 952052 00:15:40.428 08:23:26 -- common/autotest_common.sh@829 -- # '[' -z 952052 ']' 00:15:40.428 08:23:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:40.428 08:23:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:40.428 08:23:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:40.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:40.428 08:23:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:40.428 08:23:26 -- common/autotest_common.sh@10 -- # set +x 00:15:40.428 [2024-11-26 08:23:26.203623] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.428 [2024-11-26 08:23:26.203722] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:40.428 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.428 [2024-11-26 08:23:26.270248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:40.686 [2024-11-26 08:23:26.384668] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:40.686 [2024-11-26 08:23:26.384847] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:40.686 [2024-11-26 08:23:26.384867] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:40.686 [2024-11-26 08:23:26.384881] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:40.686 [2024-11-26 08:23:26.384911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:41.623 08:23:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:41.623 08:23:27 -- common/autotest_common.sh@862 -- # return 0 00:15:41.623 08:23:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:41.623 08:23:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 08:23:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:41.623 08:23:27 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:41.623 08:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 [2024-11-26 08:23:27.190088] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:41.623 08:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.623 08:23:27 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:41.623 08:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 Malloc0 00:15:41.623 08:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.623 08:23:27 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:41.623 08:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 08:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.623 08:23:27 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:41.623 08:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 08:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.623 08:23:27 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:41.623 08:23:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 [2024-11-26 08:23:27.245724] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:41.623 08:23:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.623 08:23:27 -- target/queue_depth.sh@30 -- # bdevperf_pid=952171 00:15:41.623 08:23:27 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:41.623 08:23:27 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:41.623 08:23:27 -- target/queue_depth.sh@33 -- # waitforlisten 952171 /var/tmp/bdevperf.sock 00:15:41.623 08:23:27 -- common/autotest_common.sh@829 -- # '[' -z 952171 ']' 00:15:41.623 08:23:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:41.623 08:23:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:41.623 08:23:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:41.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:41.623 08:23:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:41.623 08:23:27 -- common/autotest_common.sh@10 -- # set +x 00:15:41.623 [2024-11-26 08:23:27.288512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:41.623 [2024-11-26 08:23:27.288592] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid952171 ] 00:15:41.623 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.623 [2024-11-26 08:23:27.355349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.623 [2024-11-26 08:23:27.470636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:42.616 08:23:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.616 08:23:28 -- common/autotest_common.sh@862 -- # return 0 00:15:42.616 08:23:28 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:42.616 08:23:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.616 08:23:28 -- common/autotest_common.sh@10 -- # set +x 00:15:42.875 NVMe0n1 00:15:42.875 08:23:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.875 08:23:28 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:42.875 Running I/O for 10 seconds... 00:15:52.862 00:15:52.862 Latency(us) 00:15:52.862 [2024-11-26T07:23:38.722Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:52.862 [2024-11-26T07:23:38.722Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:52.862 Verification LBA range: start 0x0 length 0x4000 00:15:52.862 NVMe0n1 : 10.07 12272.15 47.94 0.00 0.00 83109.23 13883.92 63302.92 00:15:52.862 [2024-11-26T07:23:38.722Z] =================================================================================================================== 00:15:52.862 [2024-11-26T07:23:38.722Z] Total : 12272.15 47.94 0.00 0.00 83109.23 13883.92 63302.92 00:15:53.122 0 00:15:53.122 08:23:38 -- target/queue_depth.sh@39 -- # killprocess 952171 00:15:53.122 08:23:38 -- common/autotest_common.sh@936 -- # '[' -z 952171 ']' 00:15:53.122 08:23:38 -- common/autotest_common.sh@940 -- # kill -0 952171 00:15:53.122 08:23:38 -- common/autotest_common.sh@941 -- # uname 00:15:53.122 08:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:53.122 08:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 952171 00:15:53.122 08:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:53.122 08:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:53.122 08:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 952171' 00:15:53.122 killing process with pid 952171 00:15:53.123 08:23:38 -- common/autotest_common.sh@955 -- # kill 952171 00:15:53.123 Received shutdown signal, test time was about 10.000000 seconds 00:15:53.123 00:15:53.123 Latency(us) 00:15:53.123 [2024-11-26T07:23:38.983Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:53.123 [2024-11-26T07:23:38.983Z] =================================================================================================================== 00:15:53.123 [2024-11-26T07:23:38.983Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:53.123 08:23:38 -- common/autotest_common.sh@960 -- # wait 952171 00:15:53.381 08:23:39 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:53.381 08:23:39 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:53.381 08:23:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:53.381 08:23:39 -- nvmf/common.sh@116 -- # sync 00:15:53.381 08:23:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:53.381 08:23:39 -- nvmf/common.sh@119 -- # set +e 00:15:53.381 08:23:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:53.381 08:23:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:53.381 rmmod nvme_tcp 00:15:53.381 rmmod nvme_fabrics 00:15:53.381 rmmod nvme_keyring 00:15:53.381 08:23:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:53.381 08:23:39 -- nvmf/common.sh@123 -- # set -e 00:15:53.381 08:23:39 -- nvmf/common.sh@124 -- # return 0 00:15:53.381 08:23:39 -- nvmf/common.sh@477 -- # '[' -n 952052 ']' 00:15:53.381 08:23:39 -- nvmf/common.sh@478 -- # killprocess 952052 00:15:53.381 08:23:39 -- common/autotest_common.sh@936 -- # '[' -z 952052 ']' 00:15:53.381 08:23:39 -- common/autotest_common.sh@940 -- # kill -0 952052 00:15:53.381 08:23:39 -- common/autotest_common.sh@941 -- # uname 00:15:53.381 08:23:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:53.381 08:23:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 952052 00:15:53.381 08:23:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:53.381 08:23:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:53.381 08:23:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 952052' 00:15:53.381 killing process with pid 952052 00:15:53.381 08:23:39 -- common/autotest_common.sh@955 -- # kill 952052 00:15:53.381 08:23:39 -- common/autotest_common.sh@960 -- # wait 952052 00:15:53.639 08:23:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:53.639 08:23:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:53.639 08:23:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:53.639 08:23:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:53.639 08:23:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:53.639 08:23:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:53.639 08:23:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:53.639 08:23:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.177 08:23:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.177 00:15:56.177 real 0m17.579s 00:15:56.177 user 0m25.323s 00:15:56.177 sys 0m3.177s 00:15:56.177 08:23:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:56.177 08:23:41 -- common/autotest_common.sh@10 -- # set +x 00:15:56.177 ************************************ 00:15:56.177 END TEST nvmf_queue_depth 00:15:56.177 ************************************ 00:15:56.177 08:23:41 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.177 08:23:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.177 08:23:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.177 08:23:41 -- common/autotest_common.sh@10 -- # set +x 00:15:56.177 ************************************ 00:15:56.177 START TEST nvmf_multipath 00:15:56.177 ************************************ 00:15:56.177 08:23:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.177 * Looking for test storage... 00:15:56.177 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.177 08:23:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.177 08:23:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.177 08:23:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.177 08:23:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.177 08:23:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.177 08:23:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.177 08:23:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.177 08:23:41 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.177 08:23:41 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.177 08:23:41 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.177 08:23:41 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.177 08:23:41 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.177 08:23:41 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.177 08:23:41 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.177 08:23:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.177 08:23:41 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.177 08:23:41 -- scripts/common.sh@344 -- # : 1 00:15:56.177 08:23:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.177 08:23:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.177 08:23:41 -- scripts/common.sh@364 -- # decimal 1 00:15:56.177 08:23:41 -- scripts/common.sh@352 -- # local d=1 00:15:56.177 08:23:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.178 08:23:41 -- scripts/common.sh@354 -- # echo 1 00:15:56.178 08:23:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.178 08:23:41 -- scripts/common.sh@365 -- # decimal 2 00:15:56.178 08:23:41 -- scripts/common.sh@352 -- # local d=2 00:15:56.178 08:23:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.178 08:23:41 -- scripts/common.sh@354 -- # echo 2 00:15:56.178 08:23:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.178 08:23:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.178 08:23:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.178 08:23:41 -- scripts/common.sh@367 -- # return 0 00:15:56.178 08:23:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.178 08:23:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.178 --rc genhtml_branch_coverage=1 00:15:56.178 --rc genhtml_function_coverage=1 00:15:56.178 --rc genhtml_legend=1 00:15:56.178 --rc geninfo_all_blocks=1 00:15:56.178 --rc geninfo_unexecuted_blocks=1 00:15:56.178 00:15:56.178 ' 00:15:56.178 08:23:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.178 --rc genhtml_branch_coverage=1 00:15:56.178 --rc genhtml_function_coverage=1 00:15:56.178 --rc genhtml_legend=1 00:15:56.178 --rc geninfo_all_blocks=1 00:15:56.178 --rc geninfo_unexecuted_blocks=1 00:15:56.178 00:15:56.178 ' 00:15:56.178 08:23:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.178 --rc genhtml_branch_coverage=1 00:15:56.178 --rc genhtml_function_coverage=1 00:15:56.178 --rc genhtml_legend=1 00:15:56.178 --rc geninfo_all_blocks=1 00:15:56.178 --rc geninfo_unexecuted_blocks=1 00:15:56.178 00:15:56.178 ' 00:15:56.178 08:23:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.178 --rc genhtml_branch_coverage=1 00:15:56.178 --rc genhtml_function_coverage=1 00:15:56.178 --rc genhtml_legend=1 00:15:56.178 --rc geninfo_all_blocks=1 00:15:56.178 --rc geninfo_unexecuted_blocks=1 00:15:56.178 00:15:56.178 ' 00:15:56.178 08:23:41 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.178 08:23:41 -- nvmf/common.sh@7 -- # uname -s 00:15:56.178 08:23:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.178 08:23:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.178 08:23:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.178 08:23:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.178 08:23:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.178 08:23:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.178 08:23:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.178 08:23:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.178 08:23:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.178 08:23:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.178 08:23:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.178 08:23:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.178 08:23:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.178 08:23:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.178 08:23:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.178 08:23:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.178 08:23:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.178 08:23:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.178 08:23:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.178 08:23:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.178 08:23:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.178 08:23:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.178 08:23:41 -- paths/export.sh@5 -- # export PATH 00:15:56.178 08:23:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.178 08:23:41 -- nvmf/common.sh@46 -- # : 0 00:15:56.178 08:23:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.178 08:23:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.178 08:23:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.178 08:23:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.178 08:23:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.178 08:23:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.178 08:23:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.178 08:23:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.178 08:23:41 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:56.178 08:23:41 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:56.178 08:23:41 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:56.178 08:23:41 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:56.178 08:23:41 -- target/multipath.sh@43 -- # nvmftestinit 00:15:56.178 08:23:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.178 08:23:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.178 08:23:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.178 08:23:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.178 08:23:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.178 08:23:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.178 08:23:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.178 08:23:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.178 08:23:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.178 08:23:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.178 08:23:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.178 08:23:41 -- common/autotest_common.sh@10 -- # set +x 00:15:58.083 08:23:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.083 08:23:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.083 08:23:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.083 08:23:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.083 08:23:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.083 08:23:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.083 08:23:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.083 08:23:43 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.083 08:23:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.083 08:23:43 -- nvmf/common.sh@295 -- # e810=() 00:15:58.083 08:23:43 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.083 08:23:43 -- nvmf/common.sh@296 -- # x722=() 00:15:58.083 08:23:43 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.083 08:23:43 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.083 08:23:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.083 08:23:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.083 08:23:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.083 08:23:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.083 08:23:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.083 08:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.083 08:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.083 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.083 08:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.083 08:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.083 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.083 08:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.083 08:23:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.083 08:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.083 08:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.083 08:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.083 08:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.084 08:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.084 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.084 08:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.084 08:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.084 08:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.084 08:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.084 08:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.084 08:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.084 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.084 08:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.084 08:23:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.084 08:23:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.084 08:23:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.084 08:23:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.084 08:23:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.084 08:23:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.084 08:23:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.084 08:23:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.084 08:23:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.084 08:23:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.084 08:23:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.084 08:23:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.084 08:23:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.084 08:23:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.084 08:23:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.084 08:23:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.084 08:23:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.084 08:23:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.084 08:23:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.084 08:23:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.084 08:23:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.084 08:23:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.084 08:23:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:15:58.084 00:15:58.084 --- 10.0.0.2 ping statistics --- 00:15:58.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.084 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:15:58.084 08:23:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:15:58.084 00:15:58.084 --- 10.0.0.1 ping statistics --- 00:15:58.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.084 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:15:58.084 08:23:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.084 08:23:43 -- nvmf/common.sh@410 -- # return 0 00:15:58.084 08:23:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.084 08:23:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.084 08:23:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.084 08:23:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.084 08:23:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.084 08:23:43 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:58.084 08:23:43 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:58.084 only one NIC for nvmf test 00:15:58.084 08:23:43 -- target/multipath.sh@47 -- # nvmftestfini 00:15:58.084 08:23:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.084 08:23:43 -- nvmf/common.sh@116 -- # sync 00:15:58.084 08:23:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.084 08:23:43 -- nvmf/common.sh@119 -- # set +e 00:15:58.084 08:23:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.084 08:23:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.084 rmmod nvme_tcp 00:15:58.084 rmmod nvme_fabrics 00:15:58.084 rmmod nvme_keyring 00:15:58.084 08:23:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.084 08:23:43 -- nvmf/common.sh@123 -- # set -e 00:15:58.084 08:23:43 -- nvmf/common.sh@124 -- # return 0 00:15:58.084 08:23:43 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.084 08:23:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.084 08:23:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.084 08:23:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.084 08:23:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.084 08:23:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.084 08:23:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.084 08:23:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.623 08:23:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.623 08:23:45 -- target/multipath.sh@48 -- # exit 0 00:16:00.623 08:23:45 -- target/multipath.sh@1 -- # nvmftestfini 00:16:00.623 08:23:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:00.623 08:23:45 -- nvmf/common.sh@116 -- # sync 00:16:00.623 08:23:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:00.623 08:23:45 -- nvmf/common.sh@119 -- # set +e 00:16:00.623 08:23:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:00.623 08:23:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:00.623 08:23:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:00.623 08:23:45 -- nvmf/common.sh@123 -- # set -e 00:16:00.623 08:23:45 -- nvmf/common.sh@124 -- # return 0 00:16:00.623 08:23:45 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:00.623 08:23:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.623 08:23:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.623 08:23:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.623 08:23:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.623 08:23:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.623 08:23:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.623 08:23:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.623 08:23:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.623 08:23:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.623 00:16:00.623 real 0m4.485s 00:16:00.623 user 0m0.928s 00:16:00.623 sys 0m1.551s 00:16:00.623 08:23:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:00.623 08:23:45 -- common/autotest_common.sh@10 -- # set +x 00:16:00.623 ************************************ 00:16:00.623 END TEST nvmf_multipath 00:16:00.623 ************************************ 00:16:00.623 08:23:46 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.623 08:23:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:00.623 08:23:46 -- common/autotest_common.sh@10 -- # set +x 00:16:00.623 ************************************ 00:16:00.623 START TEST nvmf_zcopy 00:16:00.623 ************************************ 00:16:00.623 08:23:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.623 * Looking for test storage... 00:16:00.623 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:00.623 08:23:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:00.623 08:23:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:00.623 08:23:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:00.623 08:23:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:00.623 08:23:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:00.623 08:23:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:00.623 08:23:46 -- scripts/common.sh@335 -- # IFS=.-: 00:16:00.623 08:23:46 -- scripts/common.sh@335 -- # read -ra ver1 00:16:00.623 08:23:46 -- scripts/common.sh@336 -- # IFS=.-: 00:16:00.623 08:23:46 -- scripts/common.sh@336 -- # read -ra ver2 00:16:00.623 08:23:46 -- scripts/common.sh@337 -- # local 'op=<' 00:16:00.623 08:23:46 -- scripts/common.sh@339 -- # ver1_l=2 00:16:00.623 08:23:46 -- scripts/common.sh@340 -- # ver2_l=1 00:16:00.623 08:23:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:00.623 08:23:46 -- scripts/common.sh@343 -- # case "$op" in 00:16:00.623 08:23:46 -- scripts/common.sh@344 -- # : 1 00:16:00.623 08:23:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:00.623 08:23:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:00.623 08:23:46 -- scripts/common.sh@364 -- # decimal 1 00:16:00.623 08:23:46 -- scripts/common.sh@352 -- # local d=1 00:16:00.623 08:23:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:00.623 08:23:46 -- scripts/common.sh@354 -- # echo 1 00:16:00.623 08:23:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:00.623 08:23:46 -- scripts/common.sh@365 -- # decimal 2 00:16:00.623 08:23:46 -- scripts/common.sh@352 -- # local d=2 00:16:00.623 08:23:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:00.623 08:23:46 -- scripts/common.sh@354 -- # echo 2 00:16:00.623 08:23:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:00.623 08:23:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:00.623 08:23:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:00.623 08:23:46 -- scripts/common.sh@367 -- # return 0 00:16:00.623 08:23:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:00.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.623 --rc genhtml_branch_coverage=1 00:16:00.623 --rc genhtml_function_coverage=1 00:16:00.623 --rc genhtml_legend=1 00:16:00.623 --rc geninfo_all_blocks=1 00:16:00.623 --rc geninfo_unexecuted_blocks=1 00:16:00.623 00:16:00.623 ' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:00.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.623 --rc genhtml_branch_coverage=1 00:16:00.623 --rc genhtml_function_coverage=1 00:16:00.623 --rc genhtml_legend=1 00:16:00.623 --rc geninfo_all_blocks=1 00:16:00.623 --rc geninfo_unexecuted_blocks=1 00:16:00.623 00:16:00.623 ' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:00.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.623 --rc genhtml_branch_coverage=1 00:16:00.623 --rc genhtml_function_coverage=1 00:16:00.623 --rc genhtml_legend=1 00:16:00.623 --rc geninfo_all_blocks=1 00:16:00.623 --rc geninfo_unexecuted_blocks=1 00:16:00.623 00:16:00.623 ' 00:16:00.623 08:23:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:00.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.623 --rc genhtml_branch_coverage=1 00:16:00.623 --rc genhtml_function_coverage=1 00:16:00.623 --rc genhtml_legend=1 00:16:00.623 --rc geninfo_all_blocks=1 00:16:00.623 --rc geninfo_unexecuted_blocks=1 00:16:00.623 00:16:00.623 ' 00:16:00.623 08:23:46 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.623 08:23:46 -- nvmf/common.sh@7 -- # uname -s 00:16:00.623 08:23:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.623 08:23:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.623 08:23:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.623 08:23:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.623 08:23:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.623 08:23:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.623 08:23:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.623 08:23:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.624 08:23:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.624 08:23:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.624 08:23:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.624 08:23:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.624 08:23:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.624 08:23:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.624 08:23:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.624 08:23:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.624 08:23:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.624 08:23:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.624 08:23:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.624 08:23:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.624 08:23:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.624 08:23:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.624 08:23:46 -- paths/export.sh@5 -- # export PATH 00:16:00.624 08:23:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.624 08:23:46 -- nvmf/common.sh@46 -- # : 0 00:16:00.624 08:23:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.624 08:23:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.624 08:23:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.624 08:23:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.624 08:23:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.624 08:23:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.624 08:23:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.624 08:23:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.624 08:23:46 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:00.624 08:23:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:00.624 08:23:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:00.624 08:23:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:00.624 08:23:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:00.624 08:23:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:00.624 08:23:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.624 08:23:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.624 08:23:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.624 08:23:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:00.624 08:23:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:00.624 08:23:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:00.624 08:23:46 -- common/autotest_common.sh@10 -- # set +x 00:16:03.157 08:23:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:03.157 08:23:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:03.157 08:23:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:03.157 08:23:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:03.157 08:23:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:03.157 08:23:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:03.157 08:23:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:03.157 08:23:48 -- nvmf/common.sh@294 -- # net_devs=() 00:16:03.157 08:23:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:03.157 08:23:48 -- nvmf/common.sh@295 -- # e810=() 00:16:03.157 08:23:48 -- nvmf/common.sh@295 -- # local -ga e810 00:16:03.157 08:23:48 -- nvmf/common.sh@296 -- # x722=() 00:16:03.157 08:23:48 -- nvmf/common.sh@296 -- # local -ga x722 00:16:03.157 08:23:48 -- nvmf/common.sh@297 -- # mlx=() 00:16:03.157 08:23:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:03.157 08:23:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:03.157 08:23:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:03.158 08:23:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:03.158 08:23:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:03.158 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:03.158 08:23:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:03.158 08:23:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:03.158 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:03.158 08:23:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:03.158 08:23:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:03.158 08:23:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:03.158 08:23:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:03.158 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:03.158 08:23:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:03.158 08:23:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:03.158 08:23:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:03.158 08:23:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:03.158 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:03.158 08:23:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:03.158 08:23:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:03.158 08:23:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:03.158 08:23:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:03.158 08:23:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:03.158 08:23:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:03.158 08:23:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:03.158 08:23:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:03.158 08:23:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:03.158 08:23:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:03.158 08:23:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:03.158 08:23:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:03.158 08:23:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:03.158 08:23:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:03.158 08:23:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:03.158 08:23:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:03.158 08:23:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:03.158 08:23:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:03.158 08:23:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:03.158 08:23:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:03.158 08:23:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:03.158 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:03.158 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:16:03.158 00:16:03.158 --- 10.0.0.2 ping statistics --- 00:16:03.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.158 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:16:03.158 08:23:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:03.158 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:03.158 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:16:03.158 00:16:03.158 --- 10.0.0.1 ping statistics --- 00:16:03.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.158 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:16:03.158 08:23:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:03.158 08:23:48 -- nvmf/common.sh@410 -- # return 0 00:16:03.158 08:23:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:03.158 08:23:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:03.158 08:23:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:03.158 08:23:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:03.158 08:23:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:03.158 08:23:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:03.158 08:23:48 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:03.158 08:23:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:03.158 08:23:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:03.158 08:23:48 -- common/autotest_common.sh@10 -- # set +x 00:16:03.158 08:23:48 -- nvmf/common.sh@469 -- # nvmfpid=957517 00:16:03.158 08:23:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:03.158 08:23:48 -- nvmf/common.sh@470 -- # waitforlisten 957517 00:16:03.158 08:23:48 -- common/autotest_common.sh@829 -- # '[' -z 957517 ']' 00:16:03.158 08:23:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:03.158 08:23:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:03.158 08:23:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:03.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:03.158 08:23:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:03.158 08:23:48 -- common/autotest_common.sh@10 -- # set +x 00:16:03.158 [2024-11-26 08:23:48.670627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:03.158 [2024-11-26 08:23:48.670716] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:03.158 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.158 [2024-11-26 08:23:48.731573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:03.158 [2024-11-26 08:23:48.842770] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:03.158 [2024-11-26 08:23:48.842923] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:03.158 [2024-11-26 08:23:48.842943] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:03.158 [2024-11-26 08:23:48.842958] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:03.158 [2024-11-26 08:23:48.843001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.093 08:23:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:04.093 08:23:49 -- common/autotest_common.sh@862 -- # return 0 00:16:04.093 08:23:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:04.093 08:23:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:04.093 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.093 08:23:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.093 08:23:49 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:04.093 08:23:49 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:04.093 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.093 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 [2024-11-26 08:23:49.728683] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:04.094 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.094 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:04.094 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.094 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 [2024-11-26 08:23:49.744913] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:04.094 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.094 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:04.094 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.094 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 malloc0 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:04.094 08:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.094 08:23:49 -- common/autotest_common.sh@10 -- # set +x 00:16:04.094 08:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.094 08:23:49 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:04.094 08:23:49 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:04.094 08:23:49 -- nvmf/common.sh@520 -- # config=() 00:16:04.094 08:23:49 -- nvmf/common.sh@520 -- # local subsystem config 00:16:04.094 08:23:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:04.094 08:23:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:04.094 { 00:16:04.094 "params": { 00:16:04.094 "name": "Nvme$subsystem", 00:16:04.094 "trtype": "$TEST_TRANSPORT", 00:16:04.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:04.094 "adrfam": "ipv4", 00:16:04.094 "trsvcid": "$NVMF_PORT", 00:16:04.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:04.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:04.094 "hdgst": ${hdgst:-false}, 00:16:04.094 "ddgst": ${ddgst:-false} 00:16:04.094 }, 00:16:04.094 "method": "bdev_nvme_attach_controller" 00:16:04.094 } 00:16:04.094 EOF 00:16:04.094 )") 00:16:04.094 08:23:49 -- nvmf/common.sh@542 -- # cat 00:16:04.094 08:23:49 -- nvmf/common.sh@544 -- # jq . 00:16:04.094 08:23:49 -- nvmf/common.sh@545 -- # IFS=, 00:16:04.094 08:23:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:04.094 "params": { 00:16:04.094 "name": "Nvme1", 00:16:04.094 "trtype": "tcp", 00:16:04.094 "traddr": "10.0.0.2", 00:16:04.094 "adrfam": "ipv4", 00:16:04.094 "trsvcid": "4420", 00:16:04.094 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:04.094 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:04.094 "hdgst": false, 00:16:04.094 "ddgst": false 00:16:04.094 }, 00:16:04.094 "method": "bdev_nvme_attach_controller" 00:16:04.094 }' 00:16:04.094 [2024-11-26 08:23:49.824527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:04.094 [2024-11-26 08:23:49.824605] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid957670 ] 00:16:04.094 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.094 [2024-11-26 08:23:49.885435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.354 [2024-11-26 08:23:49.995286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.613 Running I/O for 10 seconds... 00:16:14.601 00:16:14.601 Latency(us) 00:16:14.601 [2024-11-26T07:24:00.461Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.601 [2024-11-26T07:24:00.461Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:14.601 Verification LBA range: start 0x0 length 0x1000 00:16:14.601 Nvme1n1 : 10.01 8556.70 66.85 0.00 0.00 14922.98 2305.90 23787.14 00:16:14.601 [2024-11-26T07:24:00.461Z] =================================================================================================================== 00:16:14.601 [2024-11-26T07:24:00.461Z] Total : 8556.70 66.85 0.00 0.00 14922.98 2305.90 23787.14 00:16:14.860 08:24:00 -- target/zcopy.sh@39 -- # perfpid=959068 00:16:14.860 08:24:00 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:14.860 08:24:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.860 08:24:00 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:14.860 08:24:00 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:14.860 08:24:00 -- nvmf/common.sh@520 -- # config=() 00:16:14.860 08:24:00 -- nvmf/common.sh@520 -- # local subsystem config 00:16:14.860 08:24:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:14.860 08:24:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:14.860 { 00:16:14.860 "params": { 00:16:14.860 "name": "Nvme$subsystem", 00:16:14.860 "trtype": "$TEST_TRANSPORT", 00:16:14.860 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.860 "adrfam": "ipv4", 00:16:14.860 "trsvcid": "$NVMF_PORT", 00:16:14.860 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.860 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.860 "hdgst": ${hdgst:-false}, 00:16:14.860 "ddgst": ${ddgst:-false} 00:16:14.860 }, 00:16:14.860 "method": "bdev_nvme_attach_controller" 00:16:14.860 } 00:16:14.860 EOF 00:16:14.860 )") 00:16:14.860 08:24:00 -- nvmf/common.sh@542 -- # cat 00:16:14.860 [2024-11-26 08:24:00.640363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.640404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 08:24:00 -- nvmf/common.sh@544 -- # jq . 00:16:14.860 08:24:00 -- nvmf/common.sh@545 -- # IFS=, 00:16:14.860 08:24:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:14.860 "params": { 00:16:14.860 "name": "Nvme1", 00:16:14.860 "trtype": "tcp", 00:16:14.860 "traddr": "10.0.0.2", 00:16:14.860 "adrfam": "ipv4", 00:16:14.860 "trsvcid": "4420", 00:16:14.860 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.860 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.860 "hdgst": false, 00:16:14.860 "ddgst": false 00:16:14.860 }, 00:16:14.860 "method": "bdev_nvme_attach_controller" 00:16:14.860 }' 00:16:14.860 [2024-11-26 08:24:00.648294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.648316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.656334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.656371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.664372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.664393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.672360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.672379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.675355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:14.860 [2024-11-26 08:24:00.675426] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid959068 ] 00:16:14.860 [2024-11-26 08:24:00.680382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.680403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.688404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.688423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.696425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.696444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 [2024-11-26 08:24:00.704448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.704468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.860 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.860 [2024-11-26 08:24:00.712489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.860 [2024-11-26 08:24:00.712515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.720508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.720535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.728529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.728554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.736552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.736578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.743164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.119 [2024-11-26 08:24:00.744576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.744608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.756658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.756740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.764622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.764644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.772657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.772698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.780677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.119 [2024-11-26 08:24:00.780711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.119 [2024-11-26 08:24:00.788705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.788744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.796741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.796763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.804771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.804793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.812816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.812855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.820807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.820833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.828820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.828842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.836844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.836866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.844865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.844886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.852883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.852904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.860906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.860928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.864829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:15.120 [2024-11-26 08:24:00.868928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.868949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.876953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.877003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.885010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.885074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.893057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.893098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.901085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.901123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.909087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.909128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.917110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.917152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.925136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.925177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.933123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.933150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.941157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.941193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.949186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.949225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.957209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.957250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.965208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.965234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.120 [2024-11-26 08:24:00.973234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.120 [2024-11-26 08:24:00.973261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:00.981271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:00.981302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:00.989283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:00.989312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:00.997307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:00.997334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.005330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.005358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.013348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.013374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.021368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.021393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.029393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.029418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.037419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.037444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.045447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.045474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.053473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.053500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.061495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.061522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.069530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.069557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.077539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.077565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.085564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.085593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 Running I/O for 5 seconds... 00:16:15.378 [2024-11-26 08:24:01.093586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.093613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.110571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.110599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.127808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.127837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.144025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.144052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.160610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.160636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.170405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.170432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.180957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.180998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.193779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.193807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.203761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.203790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.213871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.213899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.378 [2024-11-26 08:24:01.224429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.378 [2024-11-26 08:24:01.224472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.636 [2024-11-26 08:24:01.235355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.636 [2024-11-26 08:24:01.235386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.636 [2024-11-26 08:24:01.247350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.636 [2024-11-26 08:24:01.247375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.636 [2024-11-26 08:24:01.256635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.636 [2024-11-26 08:24:01.256692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.636 [2024-11-26 08:24:01.268439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.636 [2024-11-26 08:24:01.268465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.636 [2024-11-26 08:24:01.281493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.281519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.291367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.291394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.302293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.302324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.313108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.313135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.323587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.323613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.336455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.336481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.345990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.346016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.357084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.357110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.369108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.369134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.378873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.378900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.389478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.389504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.400249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.400274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.413112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.413138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.424838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.424865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.433532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.433558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.444594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.444624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.457091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.457116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.465790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.465823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.478660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.478710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.637 [2024-11-26 08:24:01.488711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.637 [2024-11-26 08:24:01.488751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.499284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.499310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.510017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.510043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.520498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.520523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.531250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.531276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.541798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.541825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.554221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.554248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.563823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.563850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.573956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.573998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.584529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.584554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.596852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.596879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.606679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.606730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.617455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.617480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.628171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.628197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.641193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.641219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.651415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.651442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.661420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.661445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.672370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.672405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.683093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.683119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.693461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.693486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.705939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.705966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.715322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.715348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.726366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.726392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.738347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.738379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.895 [2024-11-26 08:24:01.747211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.895 [2024-11-26 08:24:01.747239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.760632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.760659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.770802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.770828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.781316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.781342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.793755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.793781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.803344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.803370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.813709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.813735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.824444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.824469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.837015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.837041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.846930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.846957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.857385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.857411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.868284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.868309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.878831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.878868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.891188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.891223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.901158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.901184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.911248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.911273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.921840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.921868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.934254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.934279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.944210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.944240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.955100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.955125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.968260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.968286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.978547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.978573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:01.989482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:01.989508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.153 [2024-11-26 08:24:02.002022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.153 [2024-11-26 08:24:02.002072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.012142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.012168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.022547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.022573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.033603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.033630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.044423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.044464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.057482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.057508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.066796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.066822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.079126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.079151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.087982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.088015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.101136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.101162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.111654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.111719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.122272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.122298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.132779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.132806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.142649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.142700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.153242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.153268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.164145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.164171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.174610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.174636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.184770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.184798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.195228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.195255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.205720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.205747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.216345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.216371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.228457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.228483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.237605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.237630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.248635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.248660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.412 [2024-11-26 08:24:02.259084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.412 [2024-11-26 08:24:02.259109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.672 [2024-11-26 08:24:02.270014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.270066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.282649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.282699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.292580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.292606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.303717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.303743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.314418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.314444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.325743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.325770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.337090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.337117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.347644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.347695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.358488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.358515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.371600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.371626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.382059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.382086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.392596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.392622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.402880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.402907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.413445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.413470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.426222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.426249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.435873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.435900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.446152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.446178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.456132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.456158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.466518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.466543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.477330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.477357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.487508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.487538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.498234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.498260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.509028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.509058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.673 [2024-11-26 08:24:02.519452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.673 [2024-11-26 08:24:02.519477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.532321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.532349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.542429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.542455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.553099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.553124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.565330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.565356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.575581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.575606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.586104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.586134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.596516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.596542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.607307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.607332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.617263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.617288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.627869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.933 [2024-11-26 08:24:02.627896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.933 [2024-11-26 08:24:02.638604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.638634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.649022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.649063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.662074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.662100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.673467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.673494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.682552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.682593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.693970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.694012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.706782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.706809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.716486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.716511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.727877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.727905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.740272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.740298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.749837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.749864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.760826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.760853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.771556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.771581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.934 [2024-11-26 08:24:02.784078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.934 [2024-11-26 08:24:02.784105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.793751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.793780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.804487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.804512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.817431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.817456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.827147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.827173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.837960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.838000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.850228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.850253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.859861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.859887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.870724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.870752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.882909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.882936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.892179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.892209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.903422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.903456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.913719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.913745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.924230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.924256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.934566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.934591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.944984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.945011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.955659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.955711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.965958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.965984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.976044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.976070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.986424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.986454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:02.997340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:02.997366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:03.008292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:03.008318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:03.019207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:03.019233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:03.032607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:03.032633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.193 [2024-11-26 08:24:03.043267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.193 [2024-11-26 08:24:03.043293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.453 [2024-11-26 08:24:03.053933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.053975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.064411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.064437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.074935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.074962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.087842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.087868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.099233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.099259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.108305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.108343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.120729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.120755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.131226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.131253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.141762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.141788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.152344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.152370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.162853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.162880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.173246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.173272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.183920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.183946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.194150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.194176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.206777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.206805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.216415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.216447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.227422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.227456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.239815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.239842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.249699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.249726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.259679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.259730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.269471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.269497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.279766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.279800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.290386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.290412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.454 [2024-11-26 08:24:03.303511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.454 [2024-11-26 08:24:03.303537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.313404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.313440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.323310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.323336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.333500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.333526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.344121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.344147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.354085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.354110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.365277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.365306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.377598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.377628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.387557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.387587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.398778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.398808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.411365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.411394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.422994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.423024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.432365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.432395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.444063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.444092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.454640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.454670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.465268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.465297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.475946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.475977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.487016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.487046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.499887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.499918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.509849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.509880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.520876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.520916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.533811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.533842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.543758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.543788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.554767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.554798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.714 [2024-11-26 08:24:03.567555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.714 [2024-11-26 08:24:03.567586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.577113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.577144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.588917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.588947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.602199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.602229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.612601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.612630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.624110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.624140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.635029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.635059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.646065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.646096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.657332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.657362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.667935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.667965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.678036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.678066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.689167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.689198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.699999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.700029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.711150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.711180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.724032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.724063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.734039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.734080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.744875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.744905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.755527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.755557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.766197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.766228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.776804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.776834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.787323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.787353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.798231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.798261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.811085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.811115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.974 [2024-11-26 08:24:03.821275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.974 [2024-11-26 08:24:03.821306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.234 [2024-11-26 08:24:03.832038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.234 [2024-11-26 08:24:03.832069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.234 [2024-11-26 08:24:03.842966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.842996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.853929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.853959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.866699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.866728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.876671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.876712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.888022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.888052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.898634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.898664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.909651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.909680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.920463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.920493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.931251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.931281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.942533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.942563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.953137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.953167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.964151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.964181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.975161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.975191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.988051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.988082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:03.998226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:03.998255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.009170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.009200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.021906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.021936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.031927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.031957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.043149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.043179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.054307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.054337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.065039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.065069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.077675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.077716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.235 [2024-11-26 08:24:04.087790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.235 [2024-11-26 08:24:04.087835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.098634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.098665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.111217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.111248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.121550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.121580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.132131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.132160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.143102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.143132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.154040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.154071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.164875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.164905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.175793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.175823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.188504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.188534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.199018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.199048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.209780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.209811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.222566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.222597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.233241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.233272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.244157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.244188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.257117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.257147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.267562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.267592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.278419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.278450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.291208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.291238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.301388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.301418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.312099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.312128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.324764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.324794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.334791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.334821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.494 [2024-11-26 08:24:04.345673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.494 [2024-11-26 08:24:04.345716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.358214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.358244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.368569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.368599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.379426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.379458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.390508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.390539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.401297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.401327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.414146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.414177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.424515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.424544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.435968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.435998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.446967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.446997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.459751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.459780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.470028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.470059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.480866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.480896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.491562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.491592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.502075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.502105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.513006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.513037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.523897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.523927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.536462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.536492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.548285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.548315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.557308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.557338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.568812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.568852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.581334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.753 [2024-11-26 08:24:04.581364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.753 [2024-11-26 08:24:04.591469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.754 [2024-11-26 08:24:04.591499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.754 [2024-11-26 08:24:04.602557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.754 [2024-11-26 08:24:04.602587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.613814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.613845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.624775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.624806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.635911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.635942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.647151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.647182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.660063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.660093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.670589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.670619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.681827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.681857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.693239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.693269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.704100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.704131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.716828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.716858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.726630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.726661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.737217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.737248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.750280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.750311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.760421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.760451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.772233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.772263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.783252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.783292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.795999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.796030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.806368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.806398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.816970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.817000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.829161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.829192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.839382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.839413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.850379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.850409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.014 [2024-11-26 08:24:04.861324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.014 [2024-11-26 08:24:04.861353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.872453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.872485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.885194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.885227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.895305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.895335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.905957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.905987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.918942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.918973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.928799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.928828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.939856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.939885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.952700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.952730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.273 [2024-11-26 08:24:04.962993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.273 [2024-11-26 08:24:04.963023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:04.973880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:04.973910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:04.985338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:04.985368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:04.996783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:04.996824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.008092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.008123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.021389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.021419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.030749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.030779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.042700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.042730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.053886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.053916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.066557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.066586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.077156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.077187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.088002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.088032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.101239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.101269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.111308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.111338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.274 [2024-11-26 08:24:05.122242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.274 [2024-11-26 08:24:05.122272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.134843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.134874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.144617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.144647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.156170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.156200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.168342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.168372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.177832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.177862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.188723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.188754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.199796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.199826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.212651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.212699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.222976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.223007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.234109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.234140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.245038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.245068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.255913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.255943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.268653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.268684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.278803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.278834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.289892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.289922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.303013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.303043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.313535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.313565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.324255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.324285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.336727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.336757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.346383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.346413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.357852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.357883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.369057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.369087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.533 [2024-11-26 08:24:05.380476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.533 [2024-11-26 08:24:05.380506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.391571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.391603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.402250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.402280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.412908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.412939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.425989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.426032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.436385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.436415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.446955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.446986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.458013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.458042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.469083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.793 [2024-11-26 08:24:05.469113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.793 [2024-11-26 08:24:05.481635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.481666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.492016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.492047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.502775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.502805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.515396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.515426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.525714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.525744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.536103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.536133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.546960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.546991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.557821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.557851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.570210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.570240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.579771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.579801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.591246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.591276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.602704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.602743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.614087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.614118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.625369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.625398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.794 [2024-11-26 08:24:05.635839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.794 [2024-11-26 08:24:05.635869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.649192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.649223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.659006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.659038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.670482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.670512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.683393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.683423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.693775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.693806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.704743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.704772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.717733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.717763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.727828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.727859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.738523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.738554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.751335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.751366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.761751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.761782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.772428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.772459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.783263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.783294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.794226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.794257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.807352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.807382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.817544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.817574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.828741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.828772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.839755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.839785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.850506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.850536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.861705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.861735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.872661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.872700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.885468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.885499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.895564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.895595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.053 [2024-11-26 08:24:05.907667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.053 [2024-11-26 08:24:05.907709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.919071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.919102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.931884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.931914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.942784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.942814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.953885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.953915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.966654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.966697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.977308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.977338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.989073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.989104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:05.999945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:05.999976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.016275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.016307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.025767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.025798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.037159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.037189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.048304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.048336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.059282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.059313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.070260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.070291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.081520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.081550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.092062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.092092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.103204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.103234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.112667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.112706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 [2024-11-26 08:24:06.154864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.154891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.314 00:16:20.314 Latency(us) 00:16:20.314 [2024-11-26T07:24:06.174Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:20.314 [2024-11-26T07:24:06.174Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:20.314 Nvme1n1 : 5.05 11731.55 91.65 0.00 0.00 10806.25 4684.61 52040.44 00:16:20.314 [2024-11-26T07:24:06.174Z] =================================================================================================================== 00:16:20.314 [2024-11-26T07:24:06.174Z] Total : 11731.55 91.65 0.00 0.00 10806.25 4684.61 52040.44 00:16:20.314 [2024-11-26 08:24:06.162313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.314 [2024-11-26 08:24:06.162341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.170333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.170363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.178353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.178381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.186414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.186468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.194436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.194488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.202457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.202507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.210476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.210525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.218495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.218543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.226526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.226577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.234548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.234605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.242587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.242631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.250604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.250661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.258612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.258662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.266638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.266697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.274657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.274710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.282681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.282751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.290713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.290767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.298734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.298783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.306734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.306773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.314733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.314757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.573 [2024-11-26 08:24:06.322759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.573 [2024-11-26 08:24:06.322783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.330774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.330798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.338794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.338818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.346842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.346880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.354883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.354928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.362915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.362962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.370891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.370915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.378920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.378947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.386936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.386973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.394957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.394981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.402982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.403008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.411052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.411101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.419059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.419103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.574 [2024-11-26 08:24:06.427055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.574 [2024-11-26 08:24:06.427084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.832 [2024-11-26 08:24:06.435071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.832 [2024-11-26 08:24:06.435097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.832 [2024-11-26 08:24:06.443088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.832 [2024-11-26 08:24:06.443112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.832 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (959068) - No such process 00:16:20.832 08:24:06 -- target/zcopy.sh@49 -- # wait 959068 00:16:20.832 08:24:06 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:20.832 08:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.832 08:24:06 -- common/autotest_common.sh@10 -- # set +x 00:16:20.832 08:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.832 08:24:06 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:20.832 08:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.832 08:24:06 -- common/autotest_common.sh@10 -- # set +x 00:16:20.832 delay0 00:16:20.832 08:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.832 08:24:06 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:20.832 08:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.832 08:24:06 -- common/autotest_common.sh@10 -- # set +x 00:16:20.832 08:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.833 08:24:06 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:20.833 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.833 [2024-11-26 08:24:06.518801] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:28.951 Initializing NVMe Controllers 00:16:28.951 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:28.951 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:28.951 Initialization complete. Launching workers. 00:16:28.951 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 269, failed: 16393 00:16:28.951 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 16570, failed to submit 92 00:16:28.951 success 16446, unsuccess 124, failed 0 00:16:28.951 08:24:13 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:28.951 08:24:13 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:28.951 08:24:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:28.951 08:24:13 -- nvmf/common.sh@116 -- # sync 00:16:28.951 08:24:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:28.951 08:24:13 -- nvmf/common.sh@119 -- # set +e 00:16:28.951 08:24:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:28.951 08:24:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:28.951 rmmod nvme_tcp 00:16:28.951 rmmod nvme_fabrics 00:16:28.951 rmmod nvme_keyring 00:16:28.951 08:24:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:28.951 08:24:13 -- nvmf/common.sh@123 -- # set -e 00:16:28.951 08:24:13 -- nvmf/common.sh@124 -- # return 0 00:16:28.951 08:24:13 -- nvmf/common.sh@477 -- # '[' -n 957517 ']' 00:16:28.951 08:24:13 -- nvmf/common.sh@478 -- # killprocess 957517 00:16:28.951 08:24:13 -- common/autotest_common.sh@936 -- # '[' -z 957517 ']' 00:16:28.951 08:24:13 -- common/autotest_common.sh@940 -- # kill -0 957517 00:16:28.951 08:24:13 -- common/autotest_common.sh@941 -- # uname 00:16:28.951 08:24:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:28.951 08:24:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 957517 00:16:28.951 08:24:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:28.951 08:24:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:28.951 08:24:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 957517' 00:16:28.951 killing process with pid 957517 00:16:28.951 08:24:13 -- common/autotest_common.sh@955 -- # kill 957517 00:16:28.951 08:24:13 -- common/autotest_common.sh@960 -- # wait 957517 00:16:28.951 08:24:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:28.951 08:24:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:28.951 08:24:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:28.951 08:24:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:28.951 08:24:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:28.951 08:24:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:28.951 08:24:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:28.951 08:24:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:30.331 08:24:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:30.331 00:16:30.331 real 0m30.052s 00:16:30.331 user 0m43.479s 00:16:30.331 sys 0m9.409s 00:16:30.331 08:24:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:30.331 08:24:16 -- common/autotest_common.sh@10 -- # set +x 00:16:30.331 ************************************ 00:16:30.331 END TEST nvmf_zcopy 00:16:30.331 ************************************ 00:16:30.331 08:24:16 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:30.331 08:24:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:30.331 08:24:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:30.331 08:24:16 -- common/autotest_common.sh@10 -- # set +x 00:16:30.331 ************************************ 00:16:30.331 START TEST nvmf_nmic 00:16:30.331 ************************************ 00:16:30.331 08:24:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:30.331 * Looking for test storage... 00:16:30.331 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:30.331 08:24:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:30.331 08:24:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:30.331 08:24:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:30.590 08:24:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:30.590 08:24:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:30.590 08:24:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:30.590 08:24:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:30.590 08:24:16 -- scripts/common.sh@335 -- # IFS=.-: 00:16:30.590 08:24:16 -- scripts/common.sh@335 -- # read -ra ver1 00:16:30.590 08:24:16 -- scripts/common.sh@336 -- # IFS=.-: 00:16:30.590 08:24:16 -- scripts/common.sh@336 -- # read -ra ver2 00:16:30.590 08:24:16 -- scripts/common.sh@337 -- # local 'op=<' 00:16:30.590 08:24:16 -- scripts/common.sh@339 -- # ver1_l=2 00:16:30.590 08:24:16 -- scripts/common.sh@340 -- # ver2_l=1 00:16:30.590 08:24:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:30.590 08:24:16 -- scripts/common.sh@343 -- # case "$op" in 00:16:30.590 08:24:16 -- scripts/common.sh@344 -- # : 1 00:16:30.590 08:24:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:30.590 08:24:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:30.590 08:24:16 -- scripts/common.sh@364 -- # decimal 1 00:16:30.590 08:24:16 -- scripts/common.sh@352 -- # local d=1 00:16:30.590 08:24:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:30.590 08:24:16 -- scripts/common.sh@354 -- # echo 1 00:16:30.590 08:24:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:30.590 08:24:16 -- scripts/common.sh@365 -- # decimal 2 00:16:30.590 08:24:16 -- scripts/common.sh@352 -- # local d=2 00:16:30.590 08:24:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:30.590 08:24:16 -- scripts/common.sh@354 -- # echo 2 00:16:30.590 08:24:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:30.590 08:24:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:30.590 08:24:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:30.590 08:24:16 -- scripts/common.sh@367 -- # return 0 00:16:30.590 08:24:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:30.590 08:24:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:30.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.590 --rc genhtml_branch_coverage=1 00:16:30.590 --rc genhtml_function_coverage=1 00:16:30.590 --rc genhtml_legend=1 00:16:30.590 --rc geninfo_all_blocks=1 00:16:30.590 --rc geninfo_unexecuted_blocks=1 00:16:30.590 00:16:30.590 ' 00:16:30.590 08:24:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:30.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.591 --rc genhtml_branch_coverage=1 00:16:30.591 --rc genhtml_function_coverage=1 00:16:30.591 --rc genhtml_legend=1 00:16:30.591 --rc geninfo_all_blocks=1 00:16:30.591 --rc geninfo_unexecuted_blocks=1 00:16:30.591 00:16:30.591 ' 00:16:30.591 08:24:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:30.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.591 --rc genhtml_branch_coverage=1 00:16:30.591 --rc genhtml_function_coverage=1 00:16:30.591 --rc genhtml_legend=1 00:16:30.591 --rc geninfo_all_blocks=1 00:16:30.591 --rc geninfo_unexecuted_blocks=1 00:16:30.591 00:16:30.591 ' 00:16:30.591 08:24:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:30.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.591 --rc genhtml_branch_coverage=1 00:16:30.591 --rc genhtml_function_coverage=1 00:16:30.591 --rc genhtml_legend=1 00:16:30.591 --rc geninfo_all_blocks=1 00:16:30.591 --rc geninfo_unexecuted_blocks=1 00:16:30.591 00:16:30.591 ' 00:16:30.591 08:24:16 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:30.591 08:24:16 -- nvmf/common.sh@7 -- # uname -s 00:16:30.591 08:24:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:30.591 08:24:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:30.591 08:24:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:30.591 08:24:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:30.591 08:24:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:30.591 08:24:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:30.591 08:24:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:30.591 08:24:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:30.591 08:24:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:30.591 08:24:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:30.591 08:24:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:30.591 08:24:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:30.591 08:24:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:30.591 08:24:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:30.591 08:24:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:30.591 08:24:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:30.591 08:24:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:30.591 08:24:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:30.591 08:24:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:30.591 08:24:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.591 08:24:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.591 08:24:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.591 08:24:16 -- paths/export.sh@5 -- # export PATH 00:16:30.591 08:24:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.591 08:24:16 -- nvmf/common.sh@46 -- # : 0 00:16:30.591 08:24:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:30.591 08:24:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:30.591 08:24:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:30.591 08:24:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:30.591 08:24:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:30.591 08:24:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:30.591 08:24:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:30.591 08:24:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:30.591 08:24:16 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:30.591 08:24:16 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:30.591 08:24:16 -- target/nmic.sh@14 -- # nvmftestinit 00:16:30.591 08:24:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:30.591 08:24:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:30.591 08:24:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:30.591 08:24:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:30.591 08:24:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:30.591 08:24:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:30.591 08:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:30.591 08:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:30.591 08:24:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:30.591 08:24:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:30.591 08:24:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:30.591 08:24:16 -- common/autotest_common.sh@10 -- # set +x 00:16:32.498 08:24:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:32.498 08:24:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:32.498 08:24:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:32.498 08:24:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:32.498 08:24:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:32.498 08:24:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:32.498 08:24:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:32.498 08:24:18 -- nvmf/common.sh@294 -- # net_devs=() 00:16:32.498 08:24:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:32.498 08:24:18 -- nvmf/common.sh@295 -- # e810=() 00:16:32.498 08:24:18 -- nvmf/common.sh@295 -- # local -ga e810 00:16:32.498 08:24:18 -- nvmf/common.sh@296 -- # x722=() 00:16:32.498 08:24:18 -- nvmf/common.sh@296 -- # local -ga x722 00:16:32.498 08:24:18 -- nvmf/common.sh@297 -- # mlx=() 00:16:32.498 08:24:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:32.498 08:24:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:32.498 08:24:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:32.498 08:24:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:32.498 08:24:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.498 08:24:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:32.498 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:32.498 08:24:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.498 08:24:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:32.498 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:32.498 08:24:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.498 08:24:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.498 08:24:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.498 08:24:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:32.498 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:32.498 08:24:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.498 08:24:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.498 08:24:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.498 08:24:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.498 08:24:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:32.498 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:32.498 08:24:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.498 08:24:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:32.498 08:24:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:32.498 08:24:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:32.498 08:24:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:32.498 08:24:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:32.498 08:24:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:32.498 08:24:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:32.498 08:24:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:32.498 08:24:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:32.498 08:24:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:32.498 08:24:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:32.498 08:24:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:32.498 08:24:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:32.498 08:24:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:32.498 08:24:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:32.498 08:24:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:32.498 08:24:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:32.498 08:24:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:32.498 08:24:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:32.498 08:24:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:32.762 08:24:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:32.762 08:24:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:32.762 08:24:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:32.762 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:32.762 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:16:32.762 00:16:32.762 --- 10.0.0.2 ping statistics --- 00:16:32.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.762 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:16:32.762 08:24:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:32.762 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:32.762 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:16:32.762 00:16:32.762 --- 10.0.0.1 ping statistics --- 00:16:32.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.762 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:16:32.762 08:24:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:32.762 08:24:18 -- nvmf/common.sh@410 -- # return 0 00:16:32.762 08:24:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:32.762 08:24:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:32.762 08:24:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:32.762 08:24:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:32.762 08:24:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:32.762 08:24:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:32.762 08:24:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:32.762 08:24:18 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:32.762 08:24:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:32.762 08:24:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:32.762 08:24:18 -- common/autotest_common.sh@10 -- # set +x 00:16:32.762 08:24:18 -- nvmf/common.sh@469 -- # nvmfpid=963217 00:16:32.762 08:24:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:32.762 08:24:18 -- nvmf/common.sh@470 -- # waitforlisten 963217 00:16:32.762 08:24:18 -- common/autotest_common.sh@829 -- # '[' -z 963217 ']' 00:16:32.762 08:24:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:32.762 08:24:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:32.762 08:24:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:32.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:32.762 08:24:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:32.762 08:24:18 -- common/autotest_common.sh@10 -- # set +x 00:16:32.762 [2024-11-26 08:24:18.467909] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:32.762 [2024-11-26 08:24:18.468007] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:32.762 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.762 [2024-11-26 08:24:18.531692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:33.065 [2024-11-26 08:24:18.643773] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:33.065 [2024-11-26 08:24:18.643913] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:33.065 [2024-11-26 08:24:18.643929] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:33.065 [2024-11-26 08:24:18.643941] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:33.065 [2024-11-26 08:24:18.645360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:33.065 [2024-11-26 08:24:18.645472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:33.065 [2024-11-26 08:24:18.645540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:33.065 [2024-11-26 08:24:18.645544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.661 08:24:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:33.661 08:24:19 -- common/autotest_common.sh@862 -- # return 0 00:16:33.661 08:24:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:33.661 08:24:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:33.661 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.921 08:24:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:33.921 08:24:19 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:33.921 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.921 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.921 [2024-11-26 08:24:19.522504] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 Malloc0 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 [2024-11-26 08:24:19.575884] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:33.922 test case1: single bdev can't be used in multiple subsystems 00:16:33.922 08:24:19 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@28 -- # nmic_status=0 00:16:33.922 08:24:19 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 [2024-11-26 08:24:19.599643] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:33.922 [2024-11-26 08:24:19.599693] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:33.922 [2024-11-26 08:24:19.599711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:33.922 request: 00:16:33.922 { 00:16:33.922 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:33.922 "namespace": { 00:16:33.922 "bdev_name": "Malloc0" 00:16:33.922 }, 00:16:33.922 "method": "nvmf_subsystem_add_ns", 00:16:33.922 "req_id": 1 00:16:33.922 } 00:16:33.922 Got JSON-RPC error response 00:16:33.922 response: 00:16:33.922 { 00:16:33.922 "code": -32602, 00:16:33.922 "message": "Invalid parameters" 00:16:33.922 } 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@29 -- # nmic_status=1 00:16:33.922 08:24:19 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:33.922 08:24:19 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:33.922 Adding namespace failed - expected result. 00:16:33.922 08:24:19 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:33.922 test case2: host connect to nvmf target in multiple paths 00:16:33.922 08:24:19 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:33.922 08:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.922 08:24:19 -- common/autotest_common.sh@10 -- # set +x 00:16:33.922 [2024-11-26 08:24:19.607822] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:33.922 08:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.922 08:24:19 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:34.491 08:24:20 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:35.429 08:24:20 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:35.429 08:24:20 -- common/autotest_common.sh@1187 -- # local i=0 00:16:35.429 08:24:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:35.429 08:24:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:35.429 08:24:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:37.337 08:24:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:37.337 08:24:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:37.337 08:24:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:37.337 08:24:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:37.337 08:24:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:37.337 08:24:22 -- common/autotest_common.sh@1197 -- # return 0 00:16:37.337 08:24:22 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:37.337 [global] 00:16:37.337 thread=1 00:16:37.337 invalidate=1 00:16:37.337 rw=write 00:16:37.337 time_based=1 00:16:37.337 runtime=1 00:16:37.337 ioengine=libaio 00:16:37.337 direct=1 00:16:37.337 bs=4096 00:16:37.337 iodepth=1 00:16:37.337 norandommap=0 00:16:37.337 numjobs=1 00:16:37.337 00:16:37.337 verify_dump=1 00:16:37.337 verify_backlog=512 00:16:37.337 verify_state_save=0 00:16:37.337 do_verify=1 00:16:37.337 verify=crc32c-intel 00:16:37.337 [job0] 00:16:37.337 filename=/dev/nvme0n1 00:16:37.337 Could not set queue depth (nvme0n1) 00:16:37.337 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.337 fio-3.35 00:16:37.337 Starting 1 thread 00:16:38.717 00:16:38.717 job0: (groupid=0, jobs=1): err= 0: pid=963885: Tue Nov 26 08:24:24 2024 00:16:38.717 read: IOPS=21, BW=85.8KiB/s (87.8kB/s)(88.0KiB/1026msec) 00:16:38.717 slat (nsec): min=9733, max=35180, avg=24765.50, stdev=9962.49 00:16:38.717 clat (usec): min=40877, max=41265, avg=40979.35, stdev=72.75 00:16:38.717 lat (usec): min=40911, max=41275, avg=41004.11, stdev=68.08 00:16:38.717 clat percentiles (usec): 00:16:38.717 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:38.717 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:38.717 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:38.717 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:38.717 | 99.99th=[41157] 00:16:38.717 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:16:38.717 slat (usec): min=6, max=31801, avg=69.57, stdev=1405.13 00:16:38.717 clat (usec): min=137, max=372, avg=169.16, stdev=28.20 00:16:38.717 lat (usec): min=146, max=32028, avg=238.73, stdev=1407.98 00:16:38.717 clat percentiles (usec): 00:16:38.717 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 149], 20.00th=[ 153], 00:16:38.717 | 30.00th=[ 157], 40.00th=[ 159], 50.00th=[ 161], 60.00th=[ 165], 00:16:38.717 | 70.00th=[ 169], 80.00th=[ 178], 90.00th=[ 190], 95.00th=[ 239], 00:16:38.717 | 99.00th=[ 281], 99.50th=[ 302], 99.90th=[ 371], 99.95th=[ 371], 00:16:38.717 | 99.99th=[ 371] 00:16:38.717 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.717 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.717 lat (usec) : 250=93.45%, 500=2.43% 00:16:38.717 lat (msec) : 50=4.12% 00:16:38.717 cpu : usr=0.29%, sys=0.20%, ctx=537, majf=0, minf=1 00:16:38.717 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.717 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.717 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.717 00:16:38.717 Run status group 0 (all jobs): 00:16:38.717 READ: bw=85.8KiB/s (87.8kB/s), 85.8KiB/s-85.8KiB/s (87.8kB/s-87.8kB/s), io=88.0KiB (90.1kB), run=1026-1026msec 00:16:38.717 WRITE: bw=1996KiB/s (2044kB/s), 1996KiB/s-1996KiB/s (2044kB/s-2044kB/s), io=2048KiB (2097kB), run=1026-1026msec 00:16:38.717 00:16:38.717 Disk stats (read/write): 00:16:38.717 nvme0n1: ios=44/512, merge=0/0, ticks=1702/79, in_queue=1781, util=98.90% 00:16:38.717 08:24:24 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:38.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:38.717 08:24:24 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:38.717 08:24:24 -- common/autotest_common.sh@1208 -- # local i=0 00:16:38.717 08:24:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:38.717 08:24:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.717 08:24:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:38.717 08:24:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.717 08:24:24 -- common/autotest_common.sh@1220 -- # return 0 00:16:38.717 08:24:24 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:38.717 08:24:24 -- target/nmic.sh@53 -- # nvmftestfini 00:16:38.717 08:24:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.717 08:24:24 -- nvmf/common.sh@116 -- # sync 00:16:38.717 08:24:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.717 08:24:24 -- nvmf/common.sh@119 -- # set +e 00:16:38.717 08:24:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.717 08:24:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.717 rmmod nvme_tcp 00:16:38.717 rmmod nvme_fabrics 00:16:38.717 rmmod nvme_keyring 00:16:38.717 08:24:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.717 08:24:24 -- nvmf/common.sh@123 -- # set -e 00:16:38.717 08:24:24 -- nvmf/common.sh@124 -- # return 0 00:16:38.717 08:24:24 -- nvmf/common.sh@477 -- # '[' -n 963217 ']' 00:16:38.717 08:24:24 -- nvmf/common.sh@478 -- # killprocess 963217 00:16:38.717 08:24:24 -- common/autotest_common.sh@936 -- # '[' -z 963217 ']' 00:16:38.717 08:24:24 -- common/autotest_common.sh@940 -- # kill -0 963217 00:16:38.717 08:24:24 -- common/autotest_common.sh@941 -- # uname 00:16:38.717 08:24:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.717 08:24:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 963217 00:16:38.717 08:24:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.717 08:24:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.717 08:24:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 963217' 00:16:38.717 killing process with pid 963217 00:16:38.717 08:24:24 -- common/autotest_common.sh@955 -- # kill 963217 00:16:38.717 08:24:24 -- common/autotest_common.sh@960 -- # wait 963217 00:16:39.284 08:24:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:39.284 08:24:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:39.284 08:24:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:39.284 08:24:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:39.284 08:24:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:39.284 08:24:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:39.284 08:24:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:39.284 08:24:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.192 08:24:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:41.192 00:16:41.192 real 0m10.811s 00:16:41.192 user 0m25.942s 00:16:41.192 sys 0m2.370s 00:16:41.192 08:24:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.192 08:24:26 -- common/autotest_common.sh@10 -- # set +x 00:16:41.192 ************************************ 00:16:41.192 END TEST nvmf_nmic 00:16:41.192 ************************************ 00:16:41.192 08:24:26 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:41.192 08:24:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.192 08:24:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.192 08:24:26 -- common/autotest_common.sh@10 -- # set +x 00:16:41.192 ************************************ 00:16:41.192 START TEST nvmf_fio_target 00:16:41.192 ************************************ 00:16:41.192 08:24:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:41.192 * Looking for test storage... 00:16:41.192 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.192 08:24:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.192 08:24:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.192 08:24:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.451 08:24:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.451 08:24:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.451 08:24:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.451 08:24:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.451 08:24:27 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.451 08:24:27 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.451 08:24:27 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.451 08:24:27 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.451 08:24:27 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.451 08:24:27 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.451 08:24:27 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.451 08:24:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.451 08:24:27 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.451 08:24:27 -- scripts/common.sh@344 -- # : 1 00:16:41.451 08:24:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.451 08:24:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.451 08:24:27 -- scripts/common.sh@364 -- # decimal 1 00:16:41.451 08:24:27 -- scripts/common.sh@352 -- # local d=1 00:16:41.451 08:24:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.451 08:24:27 -- scripts/common.sh@354 -- # echo 1 00:16:41.451 08:24:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.451 08:24:27 -- scripts/common.sh@365 -- # decimal 2 00:16:41.451 08:24:27 -- scripts/common.sh@352 -- # local d=2 00:16:41.451 08:24:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.451 08:24:27 -- scripts/common.sh@354 -- # echo 2 00:16:41.451 08:24:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.451 08:24:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.451 08:24:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.451 08:24:27 -- scripts/common.sh@367 -- # return 0 00:16:41.451 08:24:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.451 08:24:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.451 --rc genhtml_branch_coverage=1 00:16:41.451 --rc genhtml_function_coverage=1 00:16:41.451 --rc genhtml_legend=1 00:16:41.451 --rc geninfo_all_blocks=1 00:16:41.451 --rc geninfo_unexecuted_blocks=1 00:16:41.451 00:16:41.451 ' 00:16:41.451 08:24:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.451 --rc genhtml_branch_coverage=1 00:16:41.451 --rc genhtml_function_coverage=1 00:16:41.451 --rc genhtml_legend=1 00:16:41.451 --rc geninfo_all_blocks=1 00:16:41.451 --rc geninfo_unexecuted_blocks=1 00:16:41.451 00:16:41.451 ' 00:16:41.451 08:24:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.451 --rc genhtml_branch_coverage=1 00:16:41.451 --rc genhtml_function_coverage=1 00:16:41.451 --rc genhtml_legend=1 00:16:41.451 --rc geninfo_all_blocks=1 00:16:41.451 --rc geninfo_unexecuted_blocks=1 00:16:41.451 00:16:41.451 ' 00:16:41.451 08:24:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.451 --rc genhtml_branch_coverage=1 00:16:41.451 --rc genhtml_function_coverage=1 00:16:41.451 --rc genhtml_legend=1 00:16:41.451 --rc geninfo_all_blocks=1 00:16:41.451 --rc geninfo_unexecuted_blocks=1 00:16:41.451 00:16:41.451 ' 00:16:41.451 08:24:27 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.451 08:24:27 -- nvmf/common.sh@7 -- # uname -s 00:16:41.451 08:24:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.451 08:24:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.451 08:24:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.451 08:24:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.451 08:24:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.451 08:24:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.451 08:24:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.451 08:24:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.451 08:24:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.451 08:24:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.451 08:24:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.451 08:24:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.451 08:24:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.451 08:24:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.451 08:24:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.451 08:24:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.451 08:24:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.451 08:24:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.451 08:24:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.451 08:24:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.452 08:24:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.452 08:24:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.452 08:24:27 -- paths/export.sh@5 -- # export PATH 00:16:41.452 08:24:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.452 08:24:27 -- nvmf/common.sh@46 -- # : 0 00:16:41.452 08:24:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.452 08:24:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.452 08:24:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.452 08:24:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.452 08:24:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.452 08:24:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.452 08:24:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.452 08:24:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.452 08:24:27 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.452 08:24:27 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.452 08:24:27 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:41.452 08:24:27 -- target/fio.sh@16 -- # nvmftestinit 00:16:41.452 08:24:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.452 08:24:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.452 08:24:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.452 08:24:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.452 08:24:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.452 08:24:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.452 08:24:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.452 08:24:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.452 08:24:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.452 08:24:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.452 08:24:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.452 08:24:27 -- common/autotest_common.sh@10 -- # set +x 00:16:43.355 08:24:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:43.355 08:24:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:43.355 08:24:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:43.355 08:24:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:43.355 08:24:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:43.355 08:24:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:43.355 08:24:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:43.355 08:24:29 -- nvmf/common.sh@294 -- # net_devs=() 00:16:43.355 08:24:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:43.355 08:24:29 -- nvmf/common.sh@295 -- # e810=() 00:16:43.355 08:24:29 -- nvmf/common.sh@295 -- # local -ga e810 00:16:43.355 08:24:29 -- nvmf/common.sh@296 -- # x722=() 00:16:43.355 08:24:29 -- nvmf/common.sh@296 -- # local -ga x722 00:16:43.355 08:24:29 -- nvmf/common.sh@297 -- # mlx=() 00:16:43.355 08:24:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:43.355 08:24:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:43.355 08:24:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:43.356 08:24:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:43.356 08:24:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:43.356 08:24:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.356 08:24:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:43.356 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:43.356 08:24:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.356 08:24:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:43.356 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:43.356 08:24:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.356 08:24:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.356 08:24:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.356 08:24:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:43.356 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:43.356 08:24:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.356 08:24:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.356 08:24:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.356 08:24:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.356 08:24:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:43.356 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:43.356 08:24:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.356 08:24:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:43.356 08:24:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:43.356 08:24:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:43.356 08:24:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:43.356 08:24:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:43.356 08:24:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:43.356 08:24:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:43.356 08:24:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:43.356 08:24:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:43.356 08:24:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:43.356 08:24:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:43.356 08:24:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:43.356 08:24:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:43.356 08:24:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:43.356 08:24:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:43.356 08:24:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:43.613 08:24:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:43.613 08:24:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:43.613 08:24:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:43.613 08:24:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.613 08:24:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.613 08:24:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.613 08:24:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.613 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.613 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:16:43.613 00:16:43.613 --- 10.0.0.2 ping statistics --- 00:16:43.613 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.613 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:16:43.613 08:24:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.613 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.613 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:16:43.613 00:16:43.613 --- 10.0.0.1 ping statistics --- 00:16:43.613 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.613 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:16:43.613 08:24:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.613 08:24:29 -- nvmf/common.sh@410 -- # return 0 00:16:43.613 08:24:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.613 08:24:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.613 08:24:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.613 08:24:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.613 08:24:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.613 08:24:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.613 08:24:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.613 08:24:29 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:43.613 08:24:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.614 08:24:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:43.614 08:24:29 -- common/autotest_common.sh@10 -- # set +x 00:16:43.614 08:24:29 -- nvmf/common.sh@469 -- # nvmfpid=965978 00:16:43.614 08:24:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:43.614 08:24:29 -- nvmf/common.sh@470 -- # waitforlisten 965978 00:16:43.614 08:24:29 -- common/autotest_common.sh@829 -- # '[' -z 965978 ']' 00:16:43.614 08:24:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.614 08:24:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:43.614 08:24:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.614 08:24:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:43.614 08:24:29 -- common/autotest_common.sh@10 -- # set +x 00:16:43.614 [2024-11-26 08:24:29.440448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:43.614 [2024-11-26 08:24:29.440542] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:43.871 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.871 [2024-11-26 08:24:29.508970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.871 [2024-11-26 08:24:29.629168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.871 [2024-11-26 08:24:29.629313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.871 [2024-11-26 08:24:29.629331] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.871 [2024-11-26 08:24:29.629343] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.871 [2024-11-26 08:24:29.630709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.871 [2024-11-26 08:24:29.630768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.871 [2024-11-26 08:24:29.630794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:43.871 [2024-11-26 08:24:29.630798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.810 08:24:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:44.810 08:24:30 -- common/autotest_common.sh@862 -- # return 0 00:16:44.810 08:24:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.810 08:24:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:44.810 08:24:30 -- common/autotest_common.sh@10 -- # set +x 00:16:44.810 08:24:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.810 08:24:30 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:45.067 [2024-11-26 08:24:30.786412] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:45.067 08:24:30 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.325 08:24:31 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:45.325 08:24:31 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.583 08:24:31 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:45.583 08:24:31 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.841 08:24:31 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:45.841 08:24:31 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.099 08:24:31 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:46.099 08:24:31 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:46.356 08:24:32 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.613 08:24:32 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:46.613 08:24:32 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.871 08:24:32 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:46.871 08:24:32 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:47.128 08:24:32 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:47.128 08:24:32 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:47.385 08:24:33 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:47.642 08:24:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:47.642 08:24:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:47.898 08:24:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:47.898 08:24:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:48.156 08:24:33 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:48.413 [2024-11-26 08:24:34.189829] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:48.413 08:24:34 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:48.671 08:24:34 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:48.929 08:24:34 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:49.496 08:24:35 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:49.496 08:24:35 -- common/autotest_common.sh@1187 -- # local i=0 00:16:49.496 08:24:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:49.496 08:24:35 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:49.496 08:24:35 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:49.496 08:24:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:52.023 08:24:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:52.023 08:24:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:52.023 08:24:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:52.023 08:24:37 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:52.023 08:24:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:52.023 08:24:37 -- common/autotest_common.sh@1197 -- # return 0 00:16:52.023 08:24:37 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:52.023 [global] 00:16:52.023 thread=1 00:16:52.023 invalidate=1 00:16:52.023 rw=write 00:16:52.023 time_based=1 00:16:52.023 runtime=1 00:16:52.023 ioengine=libaio 00:16:52.023 direct=1 00:16:52.023 bs=4096 00:16:52.023 iodepth=1 00:16:52.023 norandommap=0 00:16:52.023 numjobs=1 00:16:52.023 00:16:52.023 verify_dump=1 00:16:52.023 verify_backlog=512 00:16:52.023 verify_state_save=0 00:16:52.023 do_verify=1 00:16:52.023 verify=crc32c-intel 00:16:52.023 [job0] 00:16:52.023 filename=/dev/nvme0n1 00:16:52.023 [job1] 00:16:52.023 filename=/dev/nvme0n2 00:16:52.023 [job2] 00:16:52.023 filename=/dev/nvme0n3 00:16:52.023 [job3] 00:16:52.023 filename=/dev/nvme0n4 00:16:52.023 Could not set queue depth (nvme0n1) 00:16:52.023 Could not set queue depth (nvme0n2) 00:16:52.023 Could not set queue depth (nvme0n3) 00:16:52.023 Could not set queue depth (nvme0n4) 00:16:52.023 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.023 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.023 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.023 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.023 fio-3.35 00:16:52.023 Starting 4 threads 00:16:53.396 00:16:53.396 job0: (groupid=0, jobs=1): err= 0: pid=967203: Tue Nov 26 08:24:38 2024 00:16:53.396 read: IOPS=20, BW=81.9KiB/s (83.8kB/s)(84.0KiB/1026msec) 00:16:53.396 slat (nsec): min=13534, max=34140, avg=19914.14, stdev=8041.69 00:16:53.396 clat (usec): min=40895, max=42000, avg=41383.27, stdev=483.86 00:16:53.396 lat (usec): min=40912, max=42022, avg=41403.18, stdev=486.66 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:53.396 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:53.396 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:53.396 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.396 | 99.99th=[42206] 00:16:53.396 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:16:53.396 slat (nsec): min=6152, max=63201, avg=21925.30, stdev=12009.74 00:16:53.396 clat (usec): min=159, max=516, avg=278.26, stdev=95.06 00:16:53.396 lat (usec): min=173, max=533, avg=300.18, stdev=100.22 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[ 167], 5.00th=[ 182], 10.00th=[ 192], 20.00th=[ 202], 00:16:53.396 | 30.00th=[ 210], 40.00th=[ 219], 50.00th=[ 233], 60.00th=[ 262], 00:16:53.396 | 70.00th=[ 318], 80.00th=[ 392], 90.00th=[ 437], 95.00th=[ 461], 00:16:53.396 | 99.00th=[ 490], 99.50th=[ 502], 99.90th=[ 519], 99.95th=[ 519], 00:16:53.396 | 99.99th=[ 519] 00:16:53.396 bw ( KiB/s): min= 4096, max= 4096, per=26.20%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.396 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.396 lat (usec) : 250=55.91%, 500=39.59%, 750=0.56% 00:16:53.396 lat (msec) : 50=3.94% 00:16:53.396 cpu : usr=0.98%, sys=0.68%, ctx=533, majf=0, minf=2 00:16:53.396 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.396 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.396 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.396 job1: (groupid=0, jobs=1): err= 0: pid=967204: Tue Nov 26 08:24:38 2024 00:16:53.396 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:53.396 slat (nsec): min=5378, max=49789, avg=9659.55, stdev=4646.84 00:16:53.396 clat (usec): min=193, max=486, avg=225.02, stdev=20.72 00:16:53.396 lat (usec): min=198, max=496, avg=234.68, stdev=23.76 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[ 198], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 210], 00:16:53.396 | 30.00th=[ 215], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 225], 00:16:53.396 | 70.00th=[ 233], 80.00th=[ 241], 90.00th=[ 251], 95.00th=[ 258], 00:16:53.396 | 99.00th=[ 293], 99.50th=[ 318], 99.90th=[ 404], 99.95th=[ 412], 00:16:53.396 | 99.99th=[ 486] 00:16:53.396 write: IOPS=2522, BW=9.85MiB/s (10.3MB/s)(9.86MiB/1001msec); 0 zone resets 00:16:53.396 slat (nsec): min=6757, max=60381, avg=13738.28, stdev=8381.12 00:16:53.396 clat (usec): min=135, max=618, avg=185.87, stdev=74.76 00:16:53.396 lat (usec): min=142, max=657, avg=199.61, stdev=80.84 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 145], 20.00th=[ 149], 00:16:53.396 | 30.00th=[ 151], 40.00th=[ 153], 50.00th=[ 159], 60.00th=[ 167], 00:16:53.396 | 70.00th=[ 180], 80.00th=[ 194], 90.00th=[ 245], 95.00th=[ 392], 00:16:53.396 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 578], 99.95th=[ 578], 00:16:53.396 | 99.99th=[ 619] 00:16:53.396 bw ( KiB/s): min= 8192, max= 8192, per=52.40%, avg=8192.00, stdev= 0.00, samples=1 00:16:53.396 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:53.396 lat (usec) : 250=90.29%, 500=9.14%, 750=0.57% 00:16:53.396 cpu : usr=5.50%, sys=6.00%, ctx=4573, majf=0, minf=1 00:16:53.396 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.396 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 issued rwts: total=2048,2525,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.396 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.396 job2: (groupid=0, jobs=1): err= 0: pid=967207: Tue Nov 26 08:24:38 2024 00:16:53.396 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(88.0KiB/1039msec) 00:16:53.396 slat (nsec): min=12762, max=34689, avg=18700.23, stdev=7508.71 00:16:53.396 clat (usec): min=40460, max=41981, avg=41404.94, stdev=506.63 00:16:53.396 lat (usec): min=40472, max=41996, avg=41423.64, stdev=510.30 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:53.396 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:53.396 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:53.396 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.396 | 99.99th=[42206] 00:16:53.396 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:16:53.396 slat (nsec): min=7510, max=54779, avg=19675.25, stdev=7098.76 00:16:53.396 clat (usec): min=159, max=536, avg=224.38, stdev=28.74 00:16:53.396 lat (usec): min=166, max=586, avg=244.05, stdev=29.54 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[ 182], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 208], 00:16:53.396 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 227], 00:16:53.396 | 70.00th=[ 233], 80.00th=[ 237], 90.00th=[ 249], 95.00th=[ 265], 00:16:53.396 | 99.00th=[ 322], 99.50th=[ 400], 99.90th=[ 537], 99.95th=[ 537], 00:16:53.396 | 99.99th=[ 537] 00:16:53.396 bw ( KiB/s): min= 4096, max= 4096, per=26.20%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.396 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.396 lat (usec) : 250=86.89%, 500=8.80%, 750=0.19% 00:16:53.396 lat (msec) : 50=4.12% 00:16:53.396 cpu : usr=0.58%, sys=1.35%, ctx=534, majf=0, minf=1 00:16:53.396 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.396 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.396 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.396 job3: (groupid=0, jobs=1): err= 0: pid=967213: Tue Nov 26 08:24:38 2024 00:16:53.396 read: IOPS=20, BW=82.6KiB/s (84.6kB/s)(84.0KiB/1017msec) 00:16:53.396 slat (nsec): min=13378, max=34391, avg=19039.33, stdev=7617.32 00:16:53.396 clat (usec): min=40538, max=41022, avg=40949.34, stdev=98.56 00:16:53.396 lat (usec): min=40572, max=41038, avg=40968.38, stdev=94.92 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:53.396 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:53.396 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:53.396 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:53.396 | 99.99th=[41157] 00:16:53.396 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:16:53.396 slat (nsec): min=6563, max=62389, avg=22038.80, stdev=11066.16 00:16:53.396 clat (usec): min=184, max=577, avg=278.52, stdev=69.94 00:16:53.396 lat (usec): min=206, max=593, avg=300.56, stdev=72.80 00:16:53.396 clat percentiles (usec): 00:16:53.396 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 221], 00:16:53.396 | 30.00th=[ 231], 40.00th=[ 241], 50.00th=[ 249], 60.00th=[ 273], 00:16:53.396 | 70.00th=[ 310], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 416], 00:16:53.396 | 99.00th=[ 453], 99.50th=[ 465], 99.90th=[ 578], 99.95th=[ 578], 00:16:53.396 | 99.99th=[ 578] 00:16:53.396 bw ( KiB/s): min= 4096, max= 4096, per=26.20%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.396 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.396 lat (usec) : 250=48.22%, 500=47.65%, 750=0.19% 00:16:53.396 lat (msec) : 50=3.94% 00:16:53.396 cpu : usr=0.49%, sys=1.18%, ctx=533, majf=0, minf=1 00:16:53.396 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.396 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.396 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.396 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.396 00:16:53.396 Run status group 0 (all jobs): 00:16:53.396 READ: bw=8131KiB/s (8326kB/s), 81.9KiB/s-8184KiB/s (83.8kB/s-8380kB/s), io=8448KiB (8651kB), run=1001-1039msec 00:16:53.396 WRITE: bw=15.3MiB/s (16.0MB/s), 1971KiB/s-9.85MiB/s (2018kB/s-10.3MB/s), io=15.9MiB (16.6MB), run=1001-1039msec 00:16:53.396 00:16:53.396 Disk stats (read/write): 00:16:53.397 nvme0n1: ios=66/512, merge=0/0, ticks=693/141, in_queue=834, util=86.77% 00:16:53.397 nvme0n2: ios=1818/2048, merge=0/0, ticks=397/374, in_queue=771, util=86.67% 00:16:53.397 nvme0n3: ios=17/512, merge=0/0, ticks=707/98, in_queue=805, util=88.90% 00:16:53.397 nvme0n4: ios=16/512, merge=0/0, ticks=656/136, in_queue=792, util=89.65% 00:16:53.397 08:24:38 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:53.397 [global] 00:16:53.397 thread=1 00:16:53.397 invalidate=1 00:16:53.397 rw=randwrite 00:16:53.397 time_based=1 00:16:53.397 runtime=1 00:16:53.397 ioengine=libaio 00:16:53.397 direct=1 00:16:53.397 bs=4096 00:16:53.397 iodepth=1 00:16:53.397 norandommap=0 00:16:53.397 numjobs=1 00:16:53.397 00:16:53.397 verify_dump=1 00:16:53.397 verify_backlog=512 00:16:53.397 verify_state_save=0 00:16:53.397 do_verify=1 00:16:53.397 verify=crc32c-intel 00:16:53.397 [job0] 00:16:53.397 filename=/dev/nvme0n1 00:16:53.397 [job1] 00:16:53.397 filename=/dev/nvme0n2 00:16:53.397 [job2] 00:16:53.397 filename=/dev/nvme0n3 00:16:53.397 [job3] 00:16:53.397 filename=/dev/nvme0n4 00:16:53.397 Could not set queue depth (nvme0n1) 00:16:53.397 Could not set queue depth (nvme0n2) 00:16:53.397 Could not set queue depth (nvme0n3) 00:16:53.397 Could not set queue depth (nvme0n4) 00:16:53.397 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.397 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.397 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.397 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.397 fio-3.35 00:16:53.397 Starting 4 threads 00:16:54.770 00:16:54.770 job0: (groupid=0, jobs=1): err= 0: pid=967447: Tue Nov 26 08:24:40 2024 00:16:54.770 read: IOPS=526, BW=2108KiB/s (2159kB/s)(2148KiB/1019msec) 00:16:54.770 slat (nsec): min=4456, max=37381, avg=10909.85, stdev=6593.42 00:16:54.770 clat (usec): min=221, max=42526, avg=1432.72, stdev=6774.79 00:16:54.770 lat (usec): min=226, max=42534, avg=1443.63, stdev=6776.51 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 229], 5.00th=[ 233], 10.00th=[ 239], 20.00th=[ 243], 00:16:54.770 | 30.00th=[ 249], 40.00th=[ 258], 50.00th=[ 265], 60.00th=[ 281], 00:16:54.770 | 70.00th=[ 293], 80.00th=[ 306], 90.00th=[ 388], 95.00th=[ 486], 00:16:54.770 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:16:54.770 | 99.99th=[42730] 00:16:54.770 write: IOPS=1004, BW=4020KiB/s (4116kB/s)(4096KiB/1019msec); 0 zone resets 00:16:54.770 slat (nsec): min=5864, max=53805, avg=12471.69, stdev=7000.63 00:16:54.770 clat (usec): min=144, max=1337, avg=220.43, stdev=68.70 00:16:54.770 lat (usec): min=151, max=1346, avg=232.91, stdev=68.86 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 163], 20.00th=[ 178], 00:16:54.770 | 30.00th=[ 192], 40.00th=[ 202], 50.00th=[ 217], 60.00th=[ 235], 00:16:54.770 | 70.00th=[ 243], 80.00th=[ 247], 90.00th=[ 265], 95.00th=[ 297], 00:16:54.770 | 99.00th=[ 359], 99.50th=[ 388], 99.90th=[ 1123], 99.95th=[ 1336], 00:16:54.770 | 99.99th=[ 1336] 00:16:54.770 bw ( KiB/s): min= 4096, max= 4096, per=28.18%, avg=4096.00, stdev= 0.00, samples=2 00:16:54.770 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:54.770 lat (usec) : 250=67.20%, 500=31.26%, 750=0.32% 00:16:54.770 lat (msec) : 2=0.26%, 50=0.96% 00:16:54.770 cpu : usr=0.79%, sys=2.06%, ctx=1562, majf=0, minf=1 00:16:54.770 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 issued rwts: total=537,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.770 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.770 job1: (groupid=0, jobs=1): err= 0: pid=967448: Tue Nov 26 08:24:40 2024 00:16:54.770 read: IOPS=1012, BW=4051KiB/s (4148kB/s)(4128KiB/1019msec) 00:16:54.770 slat (nsec): min=5644, max=43182, avg=12676.56, stdev=5938.83 00:16:54.770 clat (usec): min=226, max=42126, avg=635.19, stdev=3800.03 00:16:54.770 lat (usec): min=232, max=42152, avg=647.87, stdev=3800.45 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 233], 5.00th=[ 239], 10.00th=[ 243], 20.00th=[ 253], 00:16:54.770 | 30.00th=[ 262], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 285], 00:16:54.770 | 70.00th=[ 293], 80.00th=[ 302], 90.00th=[ 310], 95.00th=[ 322], 00:16:54.770 | 99.00th=[ 469], 99.50th=[41157], 99.90th=[41681], 99.95th=[42206], 00:16:54.770 | 99.99th=[42206] 00:16:54.770 write: IOPS=1507, BW=6029KiB/s (6174kB/s)(6144KiB/1019msec); 0 zone resets 00:16:54.770 slat (nsec): min=7193, max=58949, avg=15874.74, stdev=8561.85 00:16:54.770 clat (usec): min=136, max=3306, avg=205.01, stdev=95.86 00:16:54.770 lat (usec): min=144, max=3314, avg=220.89, stdev=98.46 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 145], 5.00th=[ 149], 10.00th=[ 153], 20.00th=[ 157], 00:16:54.770 | 30.00th=[ 165], 40.00th=[ 178], 50.00th=[ 188], 60.00th=[ 202], 00:16:54.770 | 70.00th=[ 223], 80.00th=[ 243], 90.00th=[ 269], 95.00th=[ 310], 00:16:54.770 | 99.00th=[ 400], 99.50th=[ 429], 99.90th=[ 449], 99.95th=[ 3294], 00:16:54.770 | 99.99th=[ 3294] 00:16:54.770 bw ( KiB/s): min= 4096, max= 8192, per=42.27%, avg=6144.00, stdev=2896.31, samples=2 00:16:54.770 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:54.770 lat (usec) : 250=56.81%, 500=42.76% 00:16:54.770 lat (msec) : 2=0.04%, 4=0.04%, 50=0.35% 00:16:54.770 cpu : usr=2.65%, sys=5.11%, ctx=2569, majf=0, minf=1 00:16:54.770 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 issued rwts: total=1032,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.770 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.770 job2: (groupid=0, jobs=1): err= 0: pid=967449: Tue Nov 26 08:24:40 2024 00:16:54.770 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:16:54.770 slat (nsec): min=4530, max=57440, avg=13233.42, stdev=8063.75 00:16:54.770 clat (usec): min=225, max=41963, avg=1616.50, stdev=7095.66 00:16:54.770 lat (usec): min=238, max=41997, avg=1629.74, stdev=7096.97 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 235], 5.00th=[ 241], 10.00th=[ 249], 20.00th=[ 269], 00:16:54.770 | 30.00th=[ 289], 40.00th=[ 310], 50.00th=[ 326], 60.00th=[ 367], 00:16:54.770 | 70.00th=[ 383], 80.00th=[ 408], 90.00th=[ 469], 95.00th=[ 519], 00:16:54.770 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:54.770 | 99.99th=[42206] 00:16:54.770 write: IOPS=630, BW=2521KiB/s (2582kB/s)(2524KiB/1001msec); 0 zone resets 00:16:54.770 slat (nsec): min=7201, max=53360, avg=18634.44, stdev=8013.68 00:16:54.770 clat (usec): min=157, max=662, avg=235.72, stdev=58.21 00:16:54.770 lat (usec): min=176, max=679, avg=254.35, stdev=57.84 00:16:54.770 clat percentiles (usec): 00:16:54.770 | 1.00th=[ 165], 5.00th=[ 169], 10.00th=[ 176], 20.00th=[ 188], 00:16:54.770 | 30.00th=[ 202], 40.00th=[ 212], 50.00th=[ 223], 60.00th=[ 233], 00:16:54.770 | 70.00th=[ 247], 80.00th=[ 277], 90.00th=[ 322], 95.00th=[ 347], 00:16:54.770 | 99.00th=[ 408], 99.50th=[ 437], 99.90th=[ 660], 99.95th=[ 660], 00:16:54.770 | 99.99th=[ 660] 00:16:54.770 bw ( KiB/s): min= 4096, max= 4096, per=28.18%, avg=4096.00, stdev= 0.00, samples=1 00:16:54.770 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:54.770 lat (usec) : 250=44.18%, 500=53.02%, 750=1.22% 00:16:54.770 lat (msec) : 2=0.17%, 50=1.40% 00:16:54.770 cpu : usr=1.00%, sys=1.90%, ctx=1143, majf=0, minf=2 00:16:54.770 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.770 issued rwts: total=512,631,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.770 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.770 job3: (groupid=0, jobs=1): err= 0: pid=967450: Tue Nov 26 08:24:40 2024 00:16:54.770 read: IOPS=355, BW=1421KiB/s (1455kB/s)(1448KiB/1019msec) 00:16:54.771 slat (nsec): min=4429, max=45418, avg=11594.41, stdev=5614.14 00:16:54.771 clat (usec): min=225, max=42048, avg=2428.42, stdev=9048.17 00:16:54.771 lat (usec): min=231, max=42083, avg=2440.01, stdev=9050.08 00:16:54.771 clat percentiles (usec): 00:16:54.771 | 1.00th=[ 229], 5.00th=[ 233], 10.00th=[ 237], 20.00th=[ 243], 00:16:54.771 | 30.00th=[ 249], 40.00th=[ 253], 50.00th=[ 260], 60.00th=[ 273], 00:16:54.771 | 70.00th=[ 293], 80.00th=[ 371], 90.00th=[ 469], 95.00th=[33817], 00:16:54.771 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.771 | 99.99th=[42206] 00:16:54.771 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:16:54.771 slat (nsec): min=7590, max=52514, avg=19019.59, stdev=7502.53 00:16:54.771 clat (usec): min=168, max=482, avg=237.98, stdev=52.18 00:16:54.771 lat (usec): min=185, max=511, avg=257.00, stdev=52.29 00:16:54.771 clat percentiles (usec): 00:16:54.771 | 1.00th=[ 172], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 196], 00:16:54.771 | 30.00th=[ 206], 40.00th=[ 217], 50.00th=[ 225], 60.00th=[ 235], 00:16:54.771 | 70.00th=[ 249], 80.00th=[ 277], 90.00th=[ 322], 95.00th=[ 334], 00:16:54.771 | 99.00th=[ 412], 99.50th=[ 420], 99.90th=[ 482], 99.95th=[ 482], 00:16:54.771 | 99.99th=[ 482] 00:16:54.771 bw ( KiB/s): min= 4096, max= 4096, per=28.18%, avg=4096.00, stdev= 0.00, samples=1 00:16:54.771 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:54.771 lat (usec) : 250=55.49%, 500=40.96%, 750=1.26% 00:16:54.771 lat (msec) : 10=0.11%, 50=2.17% 00:16:54.771 cpu : usr=0.88%, sys=1.18%, ctx=874, majf=0, minf=2 00:16:54.771 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.771 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.771 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.771 issued rwts: total=362,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.771 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.771 00:16:54.771 Run status group 0 (all jobs): 00:16:54.771 READ: bw=9590KiB/s (9820kB/s), 1421KiB/s-4051KiB/s (1455kB/s-4148kB/s), io=9772KiB (10.0MB), run=1001-1019msec 00:16:54.771 WRITE: bw=14.2MiB/s (14.9MB/s), 2010KiB/s-6029KiB/s (2058kB/s-6174kB/s), io=14.5MiB (15.2MB), run=1001-1019msec 00:16:54.771 00:16:54.771 Disk stats (read/write): 00:16:54.771 nvme0n1: ios=552/893, merge=0/0, ticks=904/188, in_queue=1092, util=96.19% 00:16:54.771 nvme0n2: ios=1067/1536, merge=0/0, ticks=894/295, in_queue=1189, util=98.07% 00:16:54.771 nvme0n3: ios=352/512, merge=0/0, ticks=693/119, in_queue=812, util=89.06% 00:16:54.771 nvme0n4: ios=160/512, merge=0/0, ticks=701/111, in_queue=812, util=89.72% 00:16:54.771 08:24:40 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:54.771 [global] 00:16:54.771 thread=1 00:16:54.771 invalidate=1 00:16:54.771 rw=write 00:16:54.771 time_based=1 00:16:54.771 runtime=1 00:16:54.771 ioengine=libaio 00:16:54.771 direct=1 00:16:54.771 bs=4096 00:16:54.771 iodepth=128 00:16:54.771 norandommap=0 00:16:54.771 numjobs=1 00:16:54.771 00:16:54.771 verify_dump=1 00:16:54.771 verify_backlog=512 00:16:54.771 verify_state_save=0 00:16:54.771 do_verify=1 00:16:54.771 verify=crc32c-intel 00:16:54.771 [job0] 00:16:54.771 filename=/dev/nvme0n1 00:16:54.771 [job1] 00:16:54.771 filename=/dev/nvme0n2 00:16:54.771 [job2] 00:16:54.771 filename=/dev/nvme0n3 00:16:54.771 [job3] 00:16:54.771 filename=/dev/nvme0n4 00:16:54.771 Could not set queue depth (nvme0n1) 00:16:54.771 Could not set queue depth (nvme0n2) 00:16:54.771 Could not set queue depth (nvme0n3) 00:16:54.771 Could not set queue depth (nvme0n4) 00:16:54.771 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.771 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.771 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.771 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.771 fio-3.35 00:16:54.771 Starting 4 threads 00:16:56.146 00:16:56.146 job0: (groupid=0, jobs=1): err= 0: pid=967678: Tue Nov 26 08:24:41 2024 00:16:56.146 read: IOPS=5973, BW=23.3MiB/s (24.5MB/s)(23.4MiB/1005msec) 00:16:56.146 slat (usec): min=2, max=9658, avg=81.32, stdev=597.40 00:16:56.146 clat (usec): min=2478, max=20916, avg=10678.28, stdev=2363.66 00:16:56.146 lat (usec): min=3567, max=21753, avg=10759.61, stdev=2408.52 00:16:56.146 clat percentiles (usec): 00:16:56.146 | 1.00th=[ 6521], 5.00th=[ 7504], 10.00th=[ 8291], 20.00th=[ 9110], 00:16:56.146 | 30.00th=[ 9372], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10683], 00:16:56.146 | 70.00th=[11338], 80.00th=[12387], 90.00th=[13304], 95.00th=[15664], 00:16:56.146 | 99.00th=[19006], 99.50th=[20055], 99.90th=[20841], 99.95th=[20841], 00:16:56.146 | 99.99th=[20841] 00:16:56.146 write: IOPS=6113, BW=23.9MiB/s (25.0MB/s)(24.0MiB/1005msec); 0 zone resets 00:16:56.146 slat (usec): min=3, max=9957, avg=74.64, stdev=621.16 00:16:56.146 clat (usec): min=2984, max=21007, avg=10307.57, stdev=2344.20 00:16:56.146 lat (usec): min=2991, max=21026, avg=10382.21, stdev=2407.21 00:16:56.146 clat percentiles (usec): 00:16:56.146 | 1.00th=[ 4359], 5.00th=[ 6063], 10.00th=[ 6718], 20.00th=[ 8455], 00:16:56.146 | 30.00th=[ 9765], 40.00th=[10028], 50.00th=[10421], 60.00th=[11076], 00:16:56.146 | 70.00th=[11338], 80.00th=[11600], 90.00th=[12125], 95.00th=[14746], 00:16:56.146 | 99.00th=[15401], 99.50th=[16188], 99.90th=[20317], 99.95th=[20841], 00:16:56.146 | 99.99th=[21103] 00:16:56.146 bw ( KiB/s): min=24576, max=24576, per=32.64%, avg=24576.00, stdev= 0.00, samples=2 00:16:56.146 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:16:56.146 lat (msec) : 4=0.38%, 10=40.16%, 20=59.14%, 50=0.32% 00:16:56.146 cpu : usr=6.37%, sys=10.36%, ctx=302, majf=0, minf=1 00:16:56.146 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:56.146 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.146 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.146 issued rwts: total=6003,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.146 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.146 job1: (groupid=0, jobs=1): err= 0: pid=967679: Tue Nov 26 08:24:41 2024 00:16:56.146 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:56.146 slat (usec): min=2, max=11690, avg=95.91, stdev=616.84 00:16:56.146 clat (usec): min=4334, max=28982, avg=12260.57, stdev=3208.04 00:16:56.146 lat (usec): min=4340, max=28988, avg=12356.48, stdev=3240.52 00:16:56.146 clat percentiles (usec): 00:16:56.146 | 1.00th=[ 7177], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10028], 00:16:56.146 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11469], 60.00th=[12518], 00:16:56.146 | 70.00th=[13042], 80.00th=[13829], 90.00th=[15664], 95.00th=[18744], 00:16:56.146 | 99.00th=[25035], 99.50th=[27132], 99.90th=[28443], 99.95th=[28967], 00:16:56.146 | 99.99th=[28967] 00:16:56.146 write: IOPS=5398, BW=21.1MiB/s (22.1MB/s)(21.1MiB/1002msec); 0 zone resets 00:16:56.146 slat (usec): min=3, max=11132, avg=85.30, stdev=501.71 00:16:56.146 clat (usec): min=404, max=28982, avg=11901.40, stdev=2922.10 00:16:56.146 lat (usec): min=1482, max=28990, avg=11986.70, stdev=2945.48 00:16:56.146 clat percentiles (usec): 00:16:56.146 | 1.00th=[ 3654], 5.00th=[ 6587], 10.00th=[ 8979], 20.00th=[10552], 00:16:56.146 | 30.00th=[11338], 40.00th=[11731], 50.00th=[11994], 60.00th=[12387], 00:16:56.146 | 70.00th=[12649], 80.00th=[13042], 90.00th=[13960], 95.00th=[16319], 00:16:56.146 | 99.00th=[21890], 99.50th=[22938], 99.90th=[26084], 99.95th=[26084], 00:16:56.146 | 99.99th=[28967] 00:16:56.146 bw ( KiB/s): min=20008, max=22240, per=28.06%, avg=21124.00, stdev=1578.26, samples=2 00:16:56.146 iops : min= 5002, max= 5560, avg=5281.00, stdev=394.57, samples=2 00:16:56.146 lat (usec) : 500=0.01% 00:16:56.147 lat (msec) : 2=0.04%, 4=0.82%, 10=16.52%, 20=79.79%, 50=2.83% 00:16:56.147 cpu : usr=6.39%, sys=8.79%, ctx=511, majf=0, minf=2 00:16:56.147 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:56.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.147 issued rwts: total=5120,5409,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.147 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.147 job2: (groupid=0, jobs=1): err= 0: pid=967680: Tue Nov 26 08:24:41 2024 00:16:56.147 read: IOPS=3440, BW=13.4MiB/s (14.1MB/s)(13.5MiB/1007msec) 00:16:56.147 slat (usec): min=2, max=14255, avg=133.44, stdev=814.95 00:16:56.147 clat (usec): min=2645, max=43250, avg=16664.96, stdev=4694.03 00:16:56.147 lat (usec): min=8928, max=43257, avg=16798.39, stdev=4768.31 00:16:56.147 clat percentiles (usec): 00:16:56.147 | 1.00th=[10028], 5.00th=[12256], 10.00th=[13304], 20.00th=[14091], 00:16:56.147 | 30.00th=[14615], 40.00th=[15008], 50.00th=[15270], 60.00th=[15664], 00:16:56.147 | 70.00th=[16057], 80.00th=[17957], 90.00th=[24249], 95.00th=[26608], 00:16:56.147 | 99.00th=[33817], 99.50th=[37487], 99.90th=[43254], 99.95th=[43254], 00:16:56.147 | 99.99th=[43254] 00:16:56.147 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:16:56.147 slat (usec): min=3, max=10934, avg=141.55, stdev=772.58 00:16:56.147 clat (usec): min=7318, max=71341, avg=19442.28, stdev=11710.30 00:16:56.147 lat (usec): min=7327, max=71348, avg=19583.83, stdev=11791.70 00:16:56.147 clat percentiles (usec): 00:16:56.147 | 1.00th=[11076], 5.00th=[12125], 10.00th=[13698], 20.00th=[14484], 00:16:56.147 | 30.00th=[14877], 40.00th=[15401], 50.00th=[15926], 60.00th=[16188], 00:16:56.147 | 70.00th=[16581], 80.00th=[17695], 90.00th=[24249], 95.00th=[54789], 00:16:56.147 | 99.00th=[64750], 99.50th=[65274], 99.90th=[71828], 99.95th=[71828], 00:16:56.147 | 99.99th=[71828] 00:16:56.147 bw ( KiB/s): min=12352, max=16320, per=19.04%, avg=14336.00, stdev=2805.80, samples=2 00:16:56.147 iops : min= 3088, max= 4080, avg=3584.00, stdev=701.45, samples=2 00:16:56.147 lat (msec) : 4=0.01%, 10=0.72%, 20=83.94%, 50=11.94%, 100=3.38% 00:16:56.147 cpu : usr=3.98%, sys=7.06%, ctx=322, majf=0, minf=1 00:16:56.147 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:56.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.147 issued rwts: total=3465,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.147 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.147 job3: (groupid=0, jobs=1): err= 0: pid=967681: Tue Nov 26 08:24:41 2024 00:16:56.147 read: IOPS=3552, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1009msec) 00:16:56.147 slat (usec): min=2, max=9578, avg=115.81, stdev=637.72 00:16:56.147 clat (usec): min=9225, max=39806, avg=15393.67, stdev=4156.43 00:16:56.147 lat (usec): min=9349, max=40993, avg=15509.48, stdev=4197.95 00:16:56.147 clat percentiles (usec): 00:16:56.147 | 1.00th=[10028], 5.00th=[11338], 10.00th=[12387], 20.00th=[12911], 00:16:56.147 | 30.00th=[13042], 40.00th=[13304], 50.00th=[13566], 60.00th=[14353], 00:16:56.147 | 70.00th=[15401], 80.00th=[17695], 90.00th=[22676], 95.00th=[24511], 00:16:56.147 | 99.00th=[26608], 99.50th=[32900], 99.90th=[39584], 99.95th=[39584], 00:16:56.147 | 99.99th=[39584] 00:16:56.147 write: IOPS=3820, BW=14.9MiB/s (15.6MB/s)(15.1MiB/1009msec); 0 zone resets 00:16:56.147 slat (usec): min=3, max=23814, avg=145.52, stdev=911.88 00:16:56.147 clat (usec): min=4700, max=56807, avg=18183.97, stdev=9868.46 00:16:56.147 lat (usec): min=9461, max=56818, avg=18329.49, stdev=9938.50 00:16:56.147 clat percentiles (usec): 00:16:56.147 | 1.00th=[10159], 5.00th=[10421], 10.00th=[11076], 20.00th=[13304], 00:16:56.147 | 30.00th=[13698], 40.00th=[14091], 50.00th=[14484], 60.00th=[15008], 00:16:56.147 | 70.00th=[16581], 80.00th=[18482], 90.00th=[32637], 95.00th=[43779], 00:16:56.147 | 99.00th=[54264], 99.50th=[55837], 99.90th=[56886], 99.95th=[56886], 00:16:56.147 | 99.99th=[56886] 00:16:56.147 bw ( KiB/s): min=13376, max=16440, per=19.80%, avg=14908.00, stdev=2166.58, samples=2 00:16:56.147 iops : min= 3344, max= 4110, avg=3727.00, stdev=541.64, samples=2 00:16:56.147 lat (msec) : 10=0.93%, 20=83.37%, 50=14.01%, 100=1.69% 00:16:56.147 cpu : usr=2.78%, sys=5.65%, ctx=314, majf=0, minf=1 00:16:56.147 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:56.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.147 issued rwts: total=3584,3855,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.147 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.147 00:16:56.147 Run status group 0 (all jobs): 00:16:56.147 READ: bw=70.4MiB/s (73.8MB/s), 13.4MiB/s-23.3MiB/s (14.1MB/s-24.5MB/s), io=71.0MiB (74.4MB), run=1002-1009msec 00:16:56.147 WRITE: bw=73.5MiB/s (77.1MB/s), 13.9MiB/s-23.9MiB/s (14.6MB/s-25.0MB/s), io=74.2MiB (77.8MB), run=1002-1009msec 00:16:56.147 00:16:56.147 Disk stats (read/write): 00:16:56.147 nvme0n1: ios=5095/5120, merge=0/0, ticks=52020/51057, in_queue=103077, util=99.90% 00:16:56.147 nvme0n2: ios=4437/4608, merge=0/0, ticks=48668/48550, in_queue=97218, util=99.09% 00:16:56.147 nvme0n3: ios=2901/3072, merge=0/0, ticks=16301/21898, in_queue=38199, util=97.29% 00:16:56.147 nvme0n4: ios=3209/3584, merge=0/0, ticks=16515/21647, in_queue=38162, util=96.53% 00:16:56.147 08:24:41 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:56.147 [global] 00:16:56.147 thread=1 00:16:56.147 invalidate=1 00:16:56.147 rw=randwrite 00:16:56.147 time_based=1 00:16:56.147 runtime=1 00:16:56.147 ioengine=libaio 00:16:56.147 direct=1 00:16:56.147 bs=4096 00:16:56.147 iodepth=128 00:16:56.147 norandommap=0 00:16:56.147 numjobs=1 00:16:56.147 00:16:56.147 verify_dump=1 00:16:56.147 verify_backlog=512 00:16:56.147 verify_state_save=0 00:16:56.147 do_verify=1 00:16:56.147 verify=crc32c-intel 00:16:56.147 [job0] 00:16:56.147 filename=/dev/nvme0n1 00:16:56.147 [job1] 00:16:56.147 filename=/dev/nvme0n2 00:16:56.147 [job2] 00:16:56.147 filename=/dev/nvme0n3 00:16:56.147 [job3] 00:16:56.147 filename=/dev/nvme0n4 00:16:56.147 Could not set queue depth (nvme0n1) 00:16:56.147 Could not set queue depth (nvme0n2) 00:16:56.147 Could not set queue depth (nvme0n3) 00:16:56.147 Could not set queue depth (nvme0n4) 00:16:56.405 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.405 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.405 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.405 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.405 fio-3.35 00:16:56.405 Starting 4 threads 00:16:57.779 00:16:57.779 job0: (groupid=0, jobs=1): err= 0: pid=967984: Tue Nov 26 08:24:43 2024 00:16:57.779 read: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec) 00:16:57.779 slat (usec): min=2, max=11205, avg=91.78, stdev=624.72 00:16:57.779 clat (usec): min=3981, max=29551, avg=12055.73, stdev=3462.57 00:16:57.779 lat (usec): min=4111, max=29563, avg=12147.52, stdev=3493.29 00:16:57.779 clat percentiles (usec): 00:16:57.779 | 1.00th=[ 5342], 5.00th=[ 8094], 10.00th=[ 8717], 20.00th=[ 9634], 00:16:57.779 | 30.00th=[10290], 40.00th=[10421], 50.00th=[10814], 60.00th=[11469], 00:16:57.779 | 70.00th=[13042], 80.00th=[14353], 90.00th=[17171], 95.00th=[19006], 00:16:57.779 | 99.00th=[22676], 99.50th=[25822], 99.90th=[28181], 99.95th=[29492], 00:16:57.779 | 99.99th=[29492] 00:16:57.779 write: IOPS=4606, BW=18.0MiB/s (18.9MB/s)(18.1MiB/1005msec); 0 zone resets 00:16:57.779 slat (usec): min=4, max=13250, avg=115.97, stdev=694.57 00:16:57.779 clat (usec): min=1875, max=93024, avg=15508.18, stdev=13919.67 00:16:57.779 lat (usec): min=3074, max=93061, avg=15624.15, stdev=14007.54 00:16:57.779 clat percentiles (usec): 00:16:57.779 | 1.00th=[ 4015], 5.00th=[ 5538], 10.00th=[ 7308], 20.00th=[ 9372], 00:16:57.779 | 30.00th=[10552], 40.00th=[11600], 50.00th=[12125], 60.00th=[12256], 00:16:57.779 | 70.00th=[12518], 80.00th=[15795], 90.00th=[21627], 95.00th=[46400], 00:16:57.779 | 99.00th=[86508], 99.50th=[87557], 99.90th=[92799], 99.95th=[92799], 00:16:57.779 | 99.99th=[92799] 00:16:57.779 bw ( KiB/s): min=16368, max=20496, per=28.12%, avg=18432.00, stdev=2918.94, samples=2 00:16:57.779 iops : min= 4092, max= 5124, avg=4608.00, stdev=729.73, samples=2 00:16:57.779 lat (msec) : 2=0.01%, 4=0.50%, 10=24.59%, 20=65.30%, 50=7.80% 00:16:57.779 lat (msec) : 100=1.80% 00:16:57.779 cpu : usr=5.08%, sys=8.57%, ctx=479, majf=0, minf=1 00:16:57.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:57.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.779 issued rwts: total=4608,4630,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.779 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.779 job1: (groupid=0, jobs=1): err= 0: pid=967998: Tue Nov 26 08:24:43 2024 00:16:57.779 read: IOPS=3579, BW=14.0MiB/s (14.7MB/s)(14.6MiB/1046msec) 00:16:57.779 slat (usec): min=2, max=20960, avg=126.52, stdev=961.01 00:16:57.779 clat (usec): min=6082, max=83366, avg=17217.84, stdev=14250.87 00:16:57.779 lat (usec): min=6086, max=83991, avg=17344.36, stdev=14308.55 00:16:57.779 clat percentiles (usec): 00:16:57.779 | 1.00th=[ 6521], 5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[10814], 00:16:57.779 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11863], 60.00th=[12256], 00:16:57.779 | 70.00th=[13435], 80.00th=[17957], 90.00th=[38011], 95.00th=[53216], 00:16:57.779 | 99.00th=[83362], 99.50th=[83362], 99.90th=[83362], 99.95th=[83362], 00:16:57.779 | 99.99th=[83362] 00:16:57.779 write: IOPS=3915, BW=15.3MiB/s (16.0MB/s)(16.0MiB/1046msec); 0 zone resets 00:16:57.779 slat (usec): min=3, max=18470, avg=121.19, stdev=770.94 00:16:57.779 clat (usec): min=4017, max=55182, avg=16431.87, stdev=9296.84 00:16:57.779 lat (usec): min=4023, max=55224, avg=16553.07, stdev=9364.19 00:16:57.779 clat percentiles (usec): 00:16:57.779 | 1.00th=[ 7635], 5.00th=[ 9372], 10.00th=[10814], 20.00th=[11600], 00:16:57.779 | 30.00th=[11863], 40.00th=[11994], 50.00th=[12125], 60.00th=[12780], 00:16:57.779 | 70.00th=[14091], 80.00th=[21103], 90.00th=[28181], 95.00th=[39060], 00:16:57.779 | 99.00th=[52167], 99.50th=[52167], 99.90th=[52167], 99.95th=[52167], 00:16:57.779 | 99.99th=[55313] 00:16:57.779 bw ( KiB/s): min=12288, max=20480, per=24.99%, avg=16384.00, stdev=5792.62, samples=2 00:16:57.779 iops : min= 3072, max= 5120, avg=4096.00, stdev=1448.15, samples=2 00:16:57.779 lat (msec) : 10=10.06%, 20=69.87%, 50=16.44%, 100=3.62% 00:16:57.779 cpu : usr=4.02%, sys=4.11%, ctx=465, majf=0, minf=1 00:16:57.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:57.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.779 issued rwts: total=3744,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.779 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.779 job2: (groupid=0, jobs=1): err= 0: pid=968034: Tue Nov 26 08:24:43 2024 00:16:57.779 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:16:57.779 slat (usec): min=2, max=21765, avg=137.90, stdev=1018.74 00:16:57.780 clat (usec): min=5601, max=50458, avg=17796.47, stdev=9309.32 00:16:57.780 lat (usec): min=5628, max=50462, avg=17934.37, stdev=9364.44 00:16:57.780 clat percentiles (usec): 00:16:57.780 | 1.00th=[ 8717], 5.00th=[11076], 10.00th=[11863], 20.00th=[12780], 00:16:57.780 | 30.00th=[13566], 40.00th=[14353], 50.00th=[14746], 60.00th=[15664], 00:16:57.780 | 70.00th=[16581], 80.00th=[18482], 90.00th=[31851], 95.00th=[46400], 00:16:57.780 | 99.00th=[50070], 99.50th=[50594], 99.90th=[50594], 99.95th=[50594], 00:16:57.780 | 99.99th=[50594] 00:16:57.780 write: IOPS=3818, BW=14.9MiB/s (15.6MB/s)(15.0MiB/1006msec); 0 zone resets 00:16:57.780 slat (usec): min=4, max=14217, avg=122.80, stdev=826.47 00:16:57.780 clat (usec): min=5057, max=55938, avg=16392.21, stdev=6656.36 00:16:57.780 lat (usec): min=6433, max=55946, avg=16515.01, stdev=6720.88 00:16:57.780 clat percentiles (usec): 00:16:57.780 | 1.00th=[ 6456], 5.00th=[ 7832], 10.00th=[10159], 20.00th=[13173], 00:16:57.780 | 30.00th=[13960], 40.00th=[14877], 50.00th=[15664], 60.00th=[16319], 00:16:57.780 | 70.00th=[16909], 80.00th=[17957], 90.00th=[22938], 95.00th=[26084], 00:16:57.780 | 99.00th=[45876], 99.50th=[55837], 99.90th=[55837], 99.95th=[55837], 00:16:57.780 | 99.99th=[55837] 00:16:57.780 bw ( KiB/s): min=13624, max=16088, per=22.66%, avg=14856.00, stdev=1742.31, samples=2 00:16:57.780 iops : min= 3406, max= 4022, avg=3714.00, stdev=435.58, samples=2 00:16:57.780 lat (msec) : 10=5.75%, 20=80.46%, 50=12.57%, 100=1.23% 00:16:57.780 cpu : usr=4.88%, sys=5.77%, ctx=332, majf=0, minf=1 00:16:57.780 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:57.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.780 issued rwts: total=3584,3841,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.780 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.780 job3: (groupid=0, jobs=1): err= 0: pid=968042: Tue Nov 26 08:24:43 2024 00:16:57.780 read: IOPS=4159, BW=16.2MiB/s (17.0MB/s)(17.0MiB/1048msec) 00:16:57.780 slat (usec): min=2, max=23003, avg=105.53, stdev=672.90 00:16:57.780 clat (usec): min=8049, max=86868, avg=14842.99, stdev=10990.01 00:16:57.780 lat (usec): min=8412, max=86871, avg=14948.52, stdev=11026.29 00:16:57.780 clat percentiles (usec): 00:16:57.780 | 1.00th=[ 9372], 5.00th=[11076], 10.00th=[11207], 20.00th=[11469], 00:16:57.780 | 30.00th=[11863], 40.00th=[12125], 50.00th=[12518], 60.00th=[13173], 00:16:57.780 | 70.00th=[13566], 80.00th=[14222], 90.00th=[15533], 95.00th=[22152], 00:16:57.780 | 99.00th=[80217], 99.50th=[86508], 99.90th=[86508], 99.95th=[86508], 00:16:57.780 | 99.99th=[86508] 00:16:57.780 write: IOPS=4396, BW=17.2MiB/s (18.0MB/s)(18.0MiB/1048msec); 0 zone resets 00:16:57.780 slat (usec): min=3, max=13379, avg=103.41, stdev=606.92 00:16:57.780 clat (usec): min=4638, max=49215, avg=14625.53, stdev=4233.61 00:16:57.780 lat (usec): min=4646, max=49222, avg=14728.94, stdev=4276.51 00:16:57.780 clat percentiles (usec): 00:16:57.780 | 1.00th=[ 8225], 5.00th=[11076], 10.00th=[11600], 20.00th=[12256], 00:16:57.780 | 30.00th=[12780], 40.00th=[13435], 50.00th=[13698], 60.00th=[13960], 00:16:57.780 | 70.00th=[14484], 80.00th=[14877], 90.00th=[22676], 95.00th=[24249], 00:16:57.780 | 99.00th=[28181], 99.50th=[32113], 99.90th=[48497], 99.95th=[48497], 00:16:57.780 | 99.99th=[49021] 00:16:57.780 bw ( KiB/s): min=17072, max=19792, per=28.12%, avg=18432.00, stdev=1923.33, samples=2 00:16:57.780 iops : min= 4268, max= 4948, avg=4608.00, stdev=480.83, samples=2 00:16:57.780 lat (msec) : 10=2.10%, 20=89.66%, 50=6.84%, 100=1.41% 00:16:57.780 cpu : usr=2.96%, sys=5.83%, ctx=442, majf=0, minf=1 00:16:57.780 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:57.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.780 issued rwts: total=4359,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.780 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.780 00:16:57.780 Run status group 0 (all jobs): 00:16:57.780 READ: bw=60.7MiB/s (63.7MB/s), 13.9MiB/s-17.9MiB/s (14.6MB/s-18.8MB/s), io=63.7MiB (66.7MB), run=1005-1048msec 00:16:57.780 WRITE: bw=64.0MiB/s (67.1MB/s), 14.9MiB/s-18.0MiB/s (15.6MB/s-18.9MB/s), io=67.1MiB (70.3MB), run=1005-1048msec 00:16:57.780 00:16:57.780 Disk stats (read/write): 00:16:57.780 nvme0n1: ios=3636/3911, merge=0/0, ticks=41654/62283, in_queue=103937, util=98.00% 00:16:57.780 nvme0n2: ios=3096/3387, merge=0/0, ticks=19988/22545, in_queue=42533, util=87.01% 00:16:57.780 nvme0n3: ios=3030/3072, merge=0/0, ticks=27080/25410, in_queue=52490, util=96.97% 00:16:57.780 nvme0n4: ios=3668/4096, merge=0/0, ticks=14931/20314, in_queue=35245, util=89.67% 00:16:57.780 08:24:43 -- target/fio.sh@55 -- # sync 00:16:57.780 08:24:43 -- target/fio.sh@59 -- # fio_pid=968182 00:16:57.780 08:24:43 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:57.780 08:24:43 -- target/fio.sh@61 -- # sleep 3 00:16:57.780 [global] 00:16:57.780 thread=1 00:16:57.780 invalidate=1 00:16:57.780 rw=read 00:16:57.780 time_based=1 00:16:57.780 runtime=10 00:16:57.780 ioengine=libaio 00:16:57.780 direct=1 00:16:57.780 bs=4096 00:16:57.780 iodepth=1 00:16:57.780 norandommap=1 00:16:57.780 numjobs=1 00:16:57.780 00:16:57.780 [job0] 00:16:57.780 filename=/dev/nvme0n1 00:16:57.780 [job1] 00:16:57.780 filename=/dev/nvme0n2 00:16:57.780 [job2] 00:16:57.780 filename=/dev/nvme0n3 00:16:57.780 [job3] 00:16:57.780 filename=/dev/nvme0n4 00:16:57.780 Could not set queue depth (nvme0n1) 00:16:57.780 Could not set queue depth (nvme0n2) 00:16:57.780 Could not set queue depth (nvme0n3) 00:16:57.780 Could not set queue depth (nvme0n4) 00:16:57.780 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.780 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.780 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.780 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.780 fio-3.35 00:16:57.780 Starting 4 threads 00:17:01.060 08:24:46 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:01.060 08:24:46 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:01.060 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=33968128, buflen=4096 00:17:01.060 fio: pid=968278, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.060 08:24:46 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.060 08:24:46 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:01.060 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=1196032, buflen=4096 00:17:01.060 fio: pid=968277, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.318 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=52809728, buflen=4096 00:17:01.318 fio: pid=968275, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.318 08:24:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.318 08:24:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:01.576 08:24:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.576 08:24:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:01.576 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=421888, buflen=4096 00:17:01.576 fio: pid=968276, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:17:01.835 00:17:01.835 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=968275: Tue Nov 26 08:24:47 2024 00:17:01.835 read: IOPS=3753, BW=14.7MiB/s (15.4MB/s)(50.4MiB/3435msec) 00:17:01.835 slat (usec): min=4, max=16369, avg=13.72, stdev=206.58 00:17:01.835 clat (usec): min=194, max=25699, avg=249.53, stdev=308.31 00:17:01.835 lat (usec): min=201, max=25727, avg=263.25, stdev=372.24 00:17:01.835 clat percentiles (usec): 00:17:01.835 | 1.00th=[ 206], 5.00th=[ 212], 10.00th=[ 217], 20.00th=[ 223], 00:17:01.835 | 30.00th=[ 229], 40.00th=[ 233], 50.00th=[ 237], 60.00th=[ 241], 00:17:01.835 | 70.00th=[ 247], 80.00th=[ 265], 90.00th=[ 285], 95.00th=[ 310], 00:17:01.835 | 99.00th=[ 383], 99.50th=[ 408], 99.90th=[ 486], 99.95th=[ 494], 00:17:01.835 | 99.99th=[22938] 00:17:01.835 bw ( KiB/s): min=13872, max=16424, per=65.08%, avg=15054.67, stdev=910.63, samples=6 00:17:01.835 iops : min= 3468, max= 4106, avg=3763.67, stdev=227.66, samples=6 00:17:01.835 lat (usec) : 250=73.77%, 500=26.18%, 750=0.01%, 1000=0.01% 00:17:01.835 lat (msec) : 10=0.01%, 50=0.02% 00:17:01.835 cpu : usr=1.54%, sys=4.72%, ctx=12902, majf=0, minf=1 00:17:01.835 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 issued rwts: total=12894,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.835 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.835 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=968276: Tue Nov 26 08:24:47 2024 00:17:01.835 read: IOPS=27, BW=110KiB/s (113kB/s)(412KiB/3732msec) 00:17:01.835 slat (usec): min=6, max=10893, avg=253.30, stdev=1409.29 00:17:01.835 clat (usec): min=242, max=42009, avg=35971.05, stdev=13316.53 00:17:01.835 lat (usec): min=253, max=52038, avg=36161.50, stdev=13444.63 00:17:01.835 clat percentiles (usec): 00:17:01.835 | 1.00th=[ 285], 5.00th=[ 326], 10.00th=[ 502], 20.00th=[40633], 00:17:01.835 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:01.835 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:17:01.835 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:01.835 | 99.99th=[42206] 00:17:01.835 bw ( KiB/s): min= 96, max= 144, per=0.48%, avg=111.14, stdev=20.26, samples=7 00:17:01.835 iops : min= 24, max= 36, avg=27.71, stdev= 5.09, samples=7 00:17:01.835 lat (usec) : 250=0.96%, 500=8.65%, 750=1.92% 00:17:01.835 lat (msec) : 20=0.96%, 50=86.54% 00:17:01.835 cpu : usr=0.00%, sys=0.24%, ctx=105, majf=0, minf=2 00:17:01.835 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 complete : 0=1.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 issued rwts: total=104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.835 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.835 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=968277: Tue Nov 26 08:24:47 2024 00:17:01.835 read: IOPS=91, BW=363KiB/s (372kB/s)(1168KiB/3217msec) 00:17:01.835 slat (nsec): min=5850, max=51318, avg=11620.01, stdev=7721.30 00:17:01.835 clat (usec): min=284, max=41981, avg=10920.72, stdev=17869.00 00:17:01.835 lat (usec): min=291, max=41998, avg=10932.33, stdev=17874.52 00:17:01.835 clat percentiles (usec): 00:17:01.835 | 1.00th=[ 289], 5.00th=[ 293], 10.00th=[ 297], 20.00th=[ 302], 00:17:01.835 | 30.00th=[ 306], 40.00th=[ 314], 50.00th=[ 334], 60.00th=[ 383], 00:17:01.835 | 70.00th=[ 429], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:17:01.835 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:17:01.835 | 99.99th=[42206] 00:17:01.835 bw ( KiB/s): min= 96, max= 1800, per=1.65%, avg=382.67, stdev=694.36, samples=6 00:17:01.835 iops : min= 24, max= 450, avg=95.67, stdev=173.59, samples=6 00:17:01.835 lat (usec) : 500=72.01%, 750=1.02%, 1000=0.68% 00:17:01.835 lat (msec) : 50=25.94% 00:17:01.835 cpu : usr=0.00%, sys=0.19%, ctx=294, majf=0, minf=2 00:17:01.835 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.835 issued rwts: total=293,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.835 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.835 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=968278: Tue Nov 26 08:24:47 2024 00:17:01.835 read: IOPS=2838, BW=11.1MiB/s (11.6MB/s)(32.4MiB/2922msec) 00:17:01.835 slat (nsec): min=4833, max=68181, avg=14151.54, stdev=8397.92 00:17:01.835 clat (usec): min=219, max=41962, avg=332.11, stdev=1414.55 00:17:01.835 lat (usec): min=225, max=41976, avg=346.26, stdev=1414.79 00:17:01.835 clat percentiles (usec): 00:17:01.835 | 1.00th=[ 233], 5.00th=[ 243], 10.00th=[ 249], 20.00th=[ 255], 00:17:01.835 | 30.00th=[ 262], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 285], 00:17:01.836 | 70.00th=[ 289], 80.00th=[ 302], 90.00th=[ 334], 95.00th=[ 351], 00:17:01.836 | 99.00th=[ 412], 99.50th=[ 490], 99.90th=[41157], 99.95th=[41157], 00:17:01.836 | 99.99th=[42206] 00:17:01.836 bw ( KiB/s): min= 2328, max=14208, per=48.00%, avg=11102.40, stdev=4933.42, samples=5 00:17:01.836 iops : min= 582, max= 3552, avg=2775.60, stdev=1233.35, samples=5 00:17:01.836 lat (usec) : 250=12.66%, 500=87.00%, 750=0.18%, 1000=0.02% 00:17:01.836 lat (msec) : 50=0.12% 00:17:01.836 cpu : usr=1.99%, sys=4.25%, ctx=8296, majf=0, minf=2 00:17:01.836 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.836 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.836 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.836 issued rwts: total=8294,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.836 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.836 00:17:01.836 Run status group 0 (all jobs): 00:17:01.836 READ: bw=22.6MiB/s (23.7MB/s), 110KiB/s-14.7MiB/s (113kB/s-15.4MB/s), io=84.3MiB (88.4MB), run=2922-3732msec 00:17:01.836 00:17:01.836 Disk stats (read/write): 00:17:01.836 nvme0n1: ios=12623/0, merge=0/0, ticks=3351/0, in_queue=3351, util=98.68% 00:17:01.836 nvme0n2: ios=100/0, merge=0/0, ticks=3583/0, in_queue=3583, util=96.20% 00:17:01.836 nvme0n3: ios=289/0, merge=0/0, ticks=3066/0, in_queue=3066, util=96.79% 00:17:01.836 nvme0n4: ios=8211/0, merge=0/0, ticks=3882/0, in_queue=3882, util=99.90% 00:17:01.836 08:24:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.836 08:24:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:02.094 08:24:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.094 08:24:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:02.352 08:24:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.353 08:24:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:02.610 08:24:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.610 08:24:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:02.869 08:24:48 -- target/fio.sh@69 -- # fio_status=0 00:17:02.869 08:24:48 -- target/fio.sh@70 -- # wait 968182 00:17:02.869 08:24:48 -- target/fio.sh@70 -- # fio_status=4 00:17:02.869 08:24:48 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:03.127 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:03.127 08:24:48 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:03.127 08:24:48 -- common/autotest_common.sh@1208 -- # local i=0 00:17:03.127 08:24:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:03.127 08:24:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:03.127 08:24:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:03.127 08:24:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:03.127 08:24:48 -- common/autotest_common.sh@1220 -- # return 0 00:17:03.127 08:24:48 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:03.127 08:24:48 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:03.127 nvmf hotplug test: fio failed as expected 00:17:03.127 08:24:48 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:03.386 08:24:49 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:03.386 08:24:49 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:03.386 08:24:49 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:03.386 08:24:49 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:03.386 08:24:49 -- target/fio.sh@91 -- # nvmftestfini 00:17:03.386 08:24:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:03.386 08:24:49 -- nvmf/common.sh@116 -- # sync 00:17:03.386 08:24:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:03.386 08:24:49 -- nvmf/common.sh@119 -- # set +e 00:17:03.386 08:24:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:03.386 08:24:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:03.386 rmmod nvme_tcp 00:17:03.386 rmmod nvme_fabrics 00:17:03.386 rmmod nvme_keyring 00:17:03.386 08:24:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:03.386 08:24:49 -- nvmf/common.sh@123 -- # set -e 00:17:03.386 08:24:49 -- nvmf/common.sh@124 -- # return 0 00:17:03.386 08:24:49 -- nvmf/common.sh@477 -- # '[' -n 965978 ']' 00:17:03.386 08:24:49 -- nvmf/common.sh@478 -- # killprocess 965978 00:17:03.386 08:24:49 -- common/autotest_common.sh@936 -- # '[' -z 965978 ']' 00:17:03.386 08:24:49 -- common/autotest_common.sh@940 -- # kill -0 965978 00:17:03.386 08:24:49 -- common/autotest_common.sh@941 -- # uname 00:17:03.386 08:24:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.386 08:24:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 965978 00:17:03.386 08:24:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:03.386 08:24:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:03.386 08:24:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 965978' 00:17:03.386 killing process with pid 965978 00:17:03.386 08:24:49 -- common/autotest_common.sh@955 -- # kill 965978 00:17:03.386 08:24:49 -- common/autotest_common.sh@960 -- # wait 965978 00:17:03.644 08:24:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:03.644 08:24:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:03.644 08:24:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:03.644 08:24:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:03.644 08:24:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:03.644 08:24:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:03.644 08:24:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:03.644 08:24:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.206 08:24:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:06.206 00:17:06.206 real 0m24.604s 00:17:06.206 user 1m24.837s 00:17:06.206 sys 0m7.252s 00:17:06.206 08:24:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:06.206 08:24:51 -- common/autotest_common.sh@10 -- # set +x 00:17:06.206 ************************************ 00:17:06.206 END TEST nvmf_fio_target 00:17:06.206 ************************************ 00:17:06.206 08:24:51 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:06.206 08:24:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:06.206 08:24:51 -- common/autotest_common.sh@10 -- # set +x 00:17:06.206 ************************************ 00:17:06.206 START TEST nvmf_bdevio 00:17:06.206 ************************************ 00:17:06.206 08:24:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:06.206 * Looking for test storage... 00:17:06.206 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:06.206 08:24:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:06.206 08:24:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:06.206 08:24:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:06.206 08:24:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:06.206 08:24:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:06.206 08:24:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:06.206 08:24:51 -- scripts/common.sh@335 -- # IFS=.-: 00:17:06.206 08:24:51 -- scripts/common.sh@335 -- # read -ra ver1 00:17:06.206 08:24:51 -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.206 08:24:51 -- scripts/common.sh@336 -- # read -ra ver2 00:17:06.206 08:24:51 -- scripts/common.sh@337 -- # local 'op=<' 00:17:06.206 08:24:51 -- scripts/common.sh@339 -- # ver1_l=2 00:17:06.206 08:24:51 -- scripts/common.sh@340 -- # ver2_l=1 00:17:06.206 08:24:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:06.206 08:24:51 -- scripts/common.sh@343 -- # case "$op" in 00:17:06.206 08:24:51 -- scripts/common.sh@344 -- # : 1 00:17:06.206 08:24:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:06.206 08:24:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.206 08:24:51 -- scripts/common.sh@364 -- # decimal 1 00:17:06.206 08:24:51 -- scripts/common.sh@352 -- # local d=1 00:17:06.206 08:24:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.206 08:24:51 -- scripts/common.sh@354 -- # echo 1 00:17:06.206 08:24:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:06.206 08:24:51 -- scripts/common.sh@365 -- # decimal 2 00:17:06.206 08:24:51 -- scripts/common.sh@352 -- # local d=2 00:17:06.206 08:24:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:06.206 08:24:51 -- scripts/common.sh@354 -- # echo 2 00:17:06.206 08:24:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:06.206 08:24:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:06.206 08:24:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:06.206 08:24:51 -- scripts/common.sh@367 -- # return 0 00:17:06.206 08:24:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:06.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.206 --rc genhtml_branch_coverage=1 00:17:06.206 --rc genhtml_function_coverage=1 00:17:06.206 --rc genhtml_legend=1 00:17:06.206 --rc geninfo_all_blocks=1 00:17:06.206 --rc geninfo_unexecuted_blocks=1 00:17:06.206 00:17:06.206 ' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:06.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.206 --rc genhtml_branch_coverage=1 00:17:06.206 --rc genhtml_function_coverage=1 00:17:06.206 --rc genhtml_legend=1 00:17:06.206 --rc geninfo_all_blocks=1 00:17:06.206 --rc geninfo_unexecuted_blocks=1 00:17:06.206 00:17:06.206 ' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:06.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.206 --rc genhtml_branch_coverage=1 00:17:06.206 --rc genhtml_function_coverage=1 00:17:06.206 --rc genhtml_legend=1 00:17:06.206 --rc geninfo_all_blocks=1 00:17:06.206 --rc geninfo_unexecuted_blocks=1 00:17:06.206 00:17:06.206 ' 00:17:06.206 08:24:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:06.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.206 --rc genhtml_branch_coverage=1 00:17:06.206 --rc genhtml_function_coverage=1 00:17:06.206 --rc genhtml_legend=1 00:17:06.206 --rc geninfo_all_blocks=1 00:17:06.206 --rc geninfo_unexecuted_blocks=1 00:17:06.206 00:17:06.206 ' 00:17:06.206 08:24:51 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:06.206 08:24:51 -- nvmf/common.sh@7 -- # uname -s 00:17:06.206 08:24:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:06.206 08:24:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:06.206 08:24:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:06.206 08:24:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:06.206 08:24:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:06.206 08:24:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:06.206 08:24:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:06.206 08:24:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:06.206 08:24:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:06.206 08:24:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:06.206 08:24:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.206 08:24:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.206 08:24:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:06.206 08:24:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:06.206 08:24:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:06.206 08:24:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:06.206 08:24:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:06.206 08:24:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:06.206 08:24:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:06.206 08:24:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.206 08:24:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.206 08:24:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.206 08:24:51 -- paths/export.sh@5 -- # export PATH 00:17:06.206 08:24:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.206 08:24:51 -- nvmf/common.sh@46 -- # : 0 00:17:06.206 08:24:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:06.206 08:24:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:06.206 08:24:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:06.206 08:24:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:06.206 08:24:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:06.206 08:24:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:06.206 08:24:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:06.206 08:24:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:06.206 08:24:51 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:06.206 08:24:51 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:06.206 08:24:51 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:06.206 08:24:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:06.206 08:24:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:06.206 08:24:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:06.206 08:24:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:06.206 08:24:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:06.206 08:24:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.206 08:24:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.206 08:24:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.206 08:24:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:06.206 08:24:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:06.206 08:24:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:06.206 08:24:51 -- common/autotest_common.sh@10 -- # set +x 00:17:08.148 08:24:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:08.148 08:24:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:08.148 08:24:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:08.148 08:24:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:08.148 08:24:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:08.148 08:24:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:08.148 08:24:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:08.148 08:24:53 -- nvmf/common.sh@294 -- # net_devs=() 00:17:08.148 08:24:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:08.148 08:24:53 -- nvmf/common.sh@295 -- # e810=() 00:17:08.148 08:24:53 -- nvmf/common.sh@295 -- # local -ga e810 00:17:08.148 08:24:53 -- nvmf/common.sh@296 -- # x722=() 00:17:08.148 08:24:53 -- nvmf/common.sh@296 -- # local -ga x722 00:17:08.148 08:24:53 -- nvmf/common.sh@297 -- # mlx=() 00:17:08.148 08:24:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:08.148 08:24:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:08.148 08:24:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:08.148 08:24:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:08.148 08:24:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:08.148 08:24:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.148 08:24:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:08.148 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:08.148 08:24:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.148 08:24:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:08.148 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:08.148 08:24:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:08.148 08:24:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.148 08:24:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.148 08:24:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.148 08:24:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.148 08:24:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:08.148 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:08.148 08:24:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.148 08:24:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.148 08:24:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.148 08:24:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.148 08:24:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.148 08:24:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:08.148 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:08.148 08:24:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.148 08:24:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:08.148 08:24:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:08.148 08:24:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:08.148 08:24:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:08.149 08:24:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:08.149 08:24:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:08.149 08:24:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:08.149 08:24:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:08.149 08:24:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:08.149 08:24:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:08.149 08:24:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:08.149 08:24:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:08.149 08:24:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:08.149 08:24:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:08.149 08:24:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:08.149 08:24:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:08.149 08:24:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:08.149 08:24:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:08.149 08:24:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:08.149 08:24:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:08.149 08:24:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:08.149 08:24:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:08.149 08:24:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:08.149 08:24:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:08.149 08:24:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:08.149 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:08.149 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:17:08.149 00:17:08.149 --- 10.0.0.2 ping statistics --- 00:17:08.149 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.149 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:17:08.149 08:24:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:08.149 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:08.149 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:17:08.149 00:17:08.149 --- 10.0.0.1 ping statistics --- 00:17:08.149 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.149 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:17:08.149 08:24:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:08.149 08:24:53 -- nvmf/common.sh@410 -- # return 0 00:17:08.149 08:24:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:08.149 08:24:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:08.149 08:24:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:08.149 08:24:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:08.149 08:24:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:08.149 08:24:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:08.149 08:24:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:08.149 08:24:53 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:08.149 08:24:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:08.149 08:24:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:08.149 08:24:53 -- common/autotest_common.sh@10 -- # set +x 00:17:08.149 08:24:53 -- nvmf/common.sh@469 -- # nvmfpid=970939 00:17:08.149 08:24:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:08.149 08:24:53 -- nvmf/common.sh@470 -- # waitforlisten 970939 00:17:08.149 08:24:53 -- common/autotest_common.sh@829 -- # '[' -z 970939 ']' 00:17:08.149 08:24:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.149 08:24:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:08.149 08:24:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.149 08:24:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:08.149 08:24:53 -- common/autotest_common.sh@10 -- # set +x 00:17:08.149 [2024-11-26 08:24:53.900353] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.149 [2024-11-26 08:24:53.900427] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:08.149 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.149 [2024-11-26 08:24:53.970112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:08.411 [2024-11-26 08:24:54.086784] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:08.411 [2024-11-26 08:24:54.086958] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.411 [2024-11-26 08:24:54.086978] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.411 [2024-11-26 08:24:54.087001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.411 [2024-11-26 08:24:54.087071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:08.411 [2024-11-26 08:24:54.087738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:08.411 [2024-11-26 08:24:54.087798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:08.411 [2024-11-26 08:24:54.087794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:09.054 08:24:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:09.054 08:24:54 -- common/autotest_common.sh@862 -- # return 0 00:17:09.054 08:24:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:09.054 08:24:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:09.054 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 08:24:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:09.314 08:24:54 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:09.314 08:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.314 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 [2024-11-26 08:24:54.918280] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:09.314 08:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.314 08:24:54 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:09.314 08:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.314 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 Malloc0 00:17:09.314 08:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.314 08:24:54 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:09.314 08:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.314 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 08:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.314 08:24:54 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:09.314 08:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.314 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 08:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.314 08:24:54 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:09.314 08:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.314 08:24:54 -- common/autotest_common.sh@10 -- # set +x 00:17:09.314 [2024-11-26 08:24:54.971764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:09.314 08:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.314 08:24:54 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:09.314 08:24:54 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:09.314 08:24:54 -- nvmf/common.sh@520 -- # config=() 00:17:09.314 08:24:54 -- nvmf/common.sh@520 -- # local subsystem config 00:17:09.314 08:24:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:09.314 08:24:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:09.314 { 00:17:09.314 "params": { 00:17:09.314 "name": "Nvme$subsystem", 00:17:09.314 "trtype": "$TEST_TRANSPORT", 00:17:09.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:09.314 "adrfam": "ipv4", 00:17:09.314 "trsvcid": "$NVMF_PORT", 00:17:09.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:09.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:09.314 "hdgst": ${hdgst:-false}, 00:17:09.314 "ddgst": ${ddgst:-false} 00:17:09.314 }, 00:17:09.314 "method": "bdev_nvme_attach_controller" 00:17:09.314 } 00:17:09.314 EOF 00:17:09.314 )") 00:17:09.314 08:24:54 -- nvmf/common.sh@542 -- # cat 00:17:09.314 08:24:54 -- nvmf/common.sh@544 -- # jq . 00:17:09.314 08:24:54 -- nvmf/common.sh@545 -- # IFS=, 00:17:09.314 08:24:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:09.314 "params": { 00:17:09.314 "name": "Nvme1", 00:17:09.314 "trtype": "tcp", 00:17:09.314 "traddr": "10.0.0.2", 00:17:09.314 "adrfam": "ipv4", 00:17:09.314 "trsvcid": "4420", 00:17:09.314 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:09.314 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:09.314 "hdgst": false, 00:17:09.314 "ddgst": false 00:17:09.314 }, 00:17:09.314 "method": "bdev_nvme_attach_controller" 00:17:09.314 }' 00:17:09.314 [2024-11-26 08:24:55.014649] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:09.314 [2024-11-26 08:24:55.014743] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid971105 ] 00:17:09.314 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.314 [2024-11-26 08:24:55.074543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:09.574 [2024-11-26 08:24:55.188543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.574 [2024-11-26 08:24:55.188597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:09.574 [2024-11-26 08:24:55.188600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:09.832 [2024-11-26 08:24:55.534008] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:09.832 [2024-11-26 08:24:55.534066] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:09.832 I/O targets: 00:17:09.832 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:09.832 00:17:09.832 00:17:09.832 CUnit - A unit testing framework for C - Version 2.1-3 00:17:09.832 http://cunit.sourceforge.net/ 00:17:09.832 00:17:09.832 00:17:09.832 Suite: bdevio tests on: Nvme1n1 00:17:09.832 Test: blockdev write read block ...passed 00:17:09.832 Test: blockdev write zeroes read block ...passed 00:17:09.832 Test: blockdev write zeroes read no split ...passed 00:17:09.832 Test: blockdev write zeroes read split ...passed 00:17:10.091 Test: blockdev write zeroes read split partial ...passed 00:17:10.091 Test: blockdev reset ...[2024-11-26 08:24:55.690135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:10.091 [2024-11-26 08:24:55.690251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf77f20 (9): Bad file descriptor 00:17:10.091 [2024-11-26 08:24:55.703918] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:10.091 passed 00:17:10.091 Test: blockdev write read 8 blocks ...passed 00:17:10.091 Test: blockdev write read size > 128k ...passed 00:17:10.091 Test: blockdev write read invalid size ...passed 00:17:10.091 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:10.091 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:10.091 Test: blockdev write read max offset ...passed 00:17:10.091 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:10.091 Test: blockdev writev readv 8 blocks ...passed 00:17:10.091 Test: blockdev writev readv 30 x 1block ...passed 00:17:10.351 Test: blockdev writev readv block ...passed 00:17:10.351 Test: blockdev writev readv size > 128k ...passed 00:17:10.351 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:10.351 Test: blockdev comparev and writev ...[2024-11-26 08:24:55.959968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.960028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.960435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.960481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.960876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.960922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.960938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.961311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.961336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:55.961357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.351 [2024-11-26 08:24:55.961373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:10.351 passed 00:17:10.351 Test: blockdev nvme passthru rw ...passed 00:17:10.351 Test: blockdev nvme passthru vendor specific ...[2024-11-26 08:24:56.043987] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.351 [2024-11-26 08:24:56.044014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:56.044164] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.351 [2024-11-26 08:24:56.044187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:56.044335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.351 [2024-11-26 08:24:56.044356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:10.351 [2024-11-26 08:24:56.044500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.351 [2024-11-26 08:24:56.044524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:10.351 passed 00:17:10.351 Test: blockdev nvme admin passthru ...passed 00:17:10.351 Test: blockdev copy ...passed 00:17:10.351 00:17:10.351 Run Summary: Type Total Ran Passed Failed Inactive 00:17:10.351 suites 1 1 n/a 0 0 00:17:10.351 tests 23 23 23 0 0 00:17:10.351 asserts 152 152 152 0 n/a 00:17:10.351 00:17:10.351 Elapsed time = 1.138 seconds 00:17:10.611 08:24:56 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:10.611 08:24:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.611 08:24:56 -- common/autotest_common.sh@10 -- # set +x 00:17:10.611 08:24:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.611 08:24:56 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:10.611 08:24:56 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:10.611 08:24:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:10.611 08:24:56 -- nvmf/common.sh@116 -- # sync 00:17:10.611 08:24:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:10.611 08:24:56 -- nvmf/common.sh@119 -- # set +e 00:17:10.611 08:24:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:10.611 08:24:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:10.611 rmmod nvme_tcp 00:17:10.611 rmmod nvme_fabrics 00:17:10.611 rmmod nvme_keyring 00:17:10.611 08:24:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:10.611 08:24:56 -- nvmf/common.sh@123 -- # set -e 00:17:10.611 08:24:56 -- nvmf/common.sh@124 -- # return 0 00:17:10.611 08:24:56 -- nvmf/common.sh@477 -- # '[' -n 970939 ']' 00:17:10.611 08:24:56 -- nvmf/common.sh@478 -- # killprocess 970939 00:17:10.611 08:24:56 -- common/autotest_common.sh@936 -- # '[' -z 970939 ']' 00:17:10.611 08:24:56 -- common/autotest_common.sh@940 -- # kill -0 970939 00:17:10.611 08:24:56 -- common/autotest_common.sh@941 -- # uname 00:17:10.611 08:24:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:10.611 08:24:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 970939 00:17:10.611 08:24:56 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:10.611 08:24:56 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:10.611 08:24:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 970939' 00:17:10.611 killing process with pid 970939 00:17:10.611 08:24:56 -- common/autotest_common.sh@955 -- # kill 970939 00:17:10.611 08:24:56 -- common/autotest_common.sh@960 -- # wait 970939 00:17:11.178 08:24:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:11.178 08:24:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:11.178 08:24:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:11.178 08:24:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:11.178 08:24:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:11.178 08:24:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.178 08:24:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.178 08:24:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.085 08:24:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:13.085 00:17:13.085 real 0m7.216s 00:17:13.085 user 0m14.069s 00:17:13.085 sys 0m2.077s 00:17:13.085 08:24:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:13.085 08:24:58 -- common/autotest_common.sh@10 -- # set +x 00:17:13.085 ************************************ 00:17:13.085 END TEST nvmf_bdevio 00:17:13.085 ************************************ 00:17:13.085 08:24:58 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:13.085 08:24:58 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:13.085 08:24:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:13.085 08:24:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.085 08:24:58 -- common/autotest_common.sh@10 -- # set +x 00:17:13.085 ************************************ 00:17:13.085 START TEST nvmf_bdevio_no_huge 00:17:13.085 ************************************ 00:17:13.085 08:24:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:13.085 * Looking for test storage... 00:17:13.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:13.085 08:24:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:13.085 08:24:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:13.085 08:24:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:13.346 08:24:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:13.346 08:24:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:13.346 08:24:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:13.346 08:24:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:13.346 08:24:58 -- scripts/common.sh@335 -- # IFS=.-: 00:17:13.346 08:24:58 -- scripts/common.sh@335 -- # read -ra ver1 00:17:13.346 08:24:58 -- scripts/common.sh@336 -- # IFS=.-: 00:17:13.346 08:24:58 -- scripts/common.sh@336 -- # read -ra ver2 00:17:13.346 08:24:58 -- scripts/common.sh@337 -- # local 'op=<' 00:17:13.346 08:24:58 -- scripts/common.sh@339 -- # ver1_l=2 00:17:13.346 08:24:58 -- scripts/common.sh@340 -- # ver2_l=1 00:17:13.346 08:24:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:13.346 08:24:58 -- scripts/common.sh@343 -- # case "$op" in 00:17:13.346 08:24:58 -- scripts/common.sh@344 -- # : 1 00:17:13.346 08:24:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:13.346 08:24:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.346 08:24:58 -- scripts/common.sh@364 -- # decimal 1 00:17:13.346 08:24:58 -- scripts/common.sh@352 -- # local d=1 00:17:13.346 08:24:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:13.346 08:24:58 -- scripts/common.sh@354 -- # echo 1 00:17:13.346 08:24:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:13.346 08:24:58 -- scripts/common.sh@365 -- # decimal 2 00:17:13.346 08:24:58 -- scripts/common.sh@352 -- # local d=2 00:17:13.346 08:24:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:13.346 08:24:58 -- scripts/common.sh@354 -- # echo 2 00:17:13.346 08:24:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:13.346 08:24:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.346 08:24:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:13.346 08:24:58 -- scripts/common.sh@367 -- # return 0 00:17:13.346 08:24:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:13.346 08:24:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:13.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.346 --rc genhtml_branch_coverage=1 00:17:13.346 --rc genhtml_function_coverage=1 00:17:13.346 --rc genhtml_legend=1 00:17:13.346 --rc geninfo_all_blocks=1 00:17:13.346 --rc geninfo_unexecuted_blocks=1 00:17:13.346 00:17:13.346 ' 00:17:13.346 08:24:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:13.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.346 --rc genhtml_branch_coverage=1 00:17:13.346 --rc genhtml_function_coverage=1 00:17:13.346 --rc genhtml_legend=1 00:17:13.346 --rc geninfo_all_blocks=1 00:17:13.346 --rc geninfo_unexecuted_blocks=1 00:17:13.346 00:17:13.346 ' 00:17:13.346 08:24:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:13.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.346 --rc genhtml_branch_coverage=1 00:17:13.346 --rc genhtml_function_coverage=1 00:17:13.346 --rc genhtml_legend=1 00:17:13.346 --rc geninfo_all_blocks=1 00:17:13.346 --rc geninfo_unexecuted_blocks=1 00:17:13.346 00:17:13.346 ' 00:17:13.346 08:24:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:13.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.346 --rc genhtml_branch_coverage=1 00:17:13.346 --rc genhtml_function_coverage=1 00:17:13.346 --rc genhtml_legend=1 00:17:13.346 --rc geninfo_all_blocks=1 00:17:13.346 --rc geninfo_unexecuted_blocks=1 00:17:13.346 00:17:13.346 ' 00:17:13.346 08:24:58 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:13.346 08:24:58 -- nvmf/common.sh@7 -- # uname -s 00:17:13.346 08:24:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:13.346 08:24:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:13.346 08:24:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:13.346 08:24:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:13.347 08:24:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:13.347 08:24:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:13.347 08:24:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:13.347 08:24:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:13.347 08:24:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:13.347 08:24:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:13.347 08:24:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.347 08:24:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.347 08:24:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:13.347 08:24:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:13.347 08:24:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:13.347 08:24:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:13.347 08:24:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:13.347 08:24:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:13.347 08:24:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:13.347 08:24:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.347 08:24:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.347 08:24:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.347 08:24:58 -- paths/export.sh@5 -- # export PATH 00:17:13.347 08:24:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.347 08:24:58 -- nvmf/common.sh@46 -- # : 0 00:17:13.347 08:24:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:13.347 08:24:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:13.347 08:24:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:13.347 08:24:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:13.347 08:24:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:13.347 08:24:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:13.347 08:24:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:13.347 08:24:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:13.347 08:24:58 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:13.347 08:24:58 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:13.347 08:24:58 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:13.347 08:24:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:13.347 08:24:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:13.347 08:24:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:13.347 08:24:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:13.347 08:24:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:13.347 08:24:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.347 08:24:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.347 08:24:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.347 08:24:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:13.347 08:24:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:13.347 08:24:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:13.347 08:24:58 -- common/autotest_common.sh@10 -- # set +x 00:17:15.251 08:25:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:15.251 08:25:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:15.251 08:25:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:15.251 08:25:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:15.251 08:25:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:15.251 08:25:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:15.251 08:25:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:15.251 08:25:00 -- nvmf/common.sh@294 -- # net_devs=() 00:17:15.251 08:25:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:15.251 08:25:00 -- nvmf/common.sh@295 -- # e810=() 00:17:15.251 08:25:00 -- nvmf/common.sh@295 -- # local -ga e810 00:17:15.251 08:25:00 -- nvmf/common.sh@296 -- # x722=() 00:17:15.251 08:25:00 -- nvmf/common.sh@296 -- # local -ga x722 00:17:15.251 08:25:00 -- nvmf/common.sh@297 -- # mlx=() 00:17:15.251 08:25:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:15.251 08:25:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:15.251 08:25:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:15.251 08:25:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:15.251 08:25:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:15.251 08:25:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.251 08:25:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:15.251 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:15.251 08:25:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.251 08:25:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:15.251 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:15.251 08:25:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.251 08:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:15.252 08:25:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.252 08:25:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.252 08:25:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.252 08:25:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.252 08:25:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:15.252 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:15.252 08:25:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.252 08:25:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.252 08:25:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.252 08:25:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.252 08:25:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.252 08:25:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:15.252 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:15.252 08:25:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.252 08:25:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:15.252 08:25:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:15.252 08:25:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:15.252 08:25:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:15.252 08:25:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:15.252 08:25:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:15.252 08:25:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:15.252 08:25:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:15.252 08:25:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:15.252 08:25:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:15.252 08:25:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:15.252 08:25:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:15.252 08:25:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:15.252 08:25:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:15.252 08:25:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:15.252 08:25:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:15.252 08:25:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:15.252 08:25:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:15.252 08:25:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:15.252 08:25:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:15.252 08:25:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:15.252 08:25:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:15.252 08:25:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:15.252 08:25:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:15.252 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:15.252 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:17:15.252 00:17:15.252 --- 10.0.0.2 ping statistics --- 00:17:15.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.252 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:17:15.252 08:25:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:15.252 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:15.252 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:17:15.252 00:17:15.252 --- 10.0.0.1 ping statistics --- 00:17:15.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.252 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:17:15.252 08:25:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:15.252 08:25:01 -- nvmf/common.sh@410 -- # return 0 00:17:15.252 08:25:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:15.252 08:25:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:15.252 08:25:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:15.252 08:25:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:15.252 08:25:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:15.252 08:25:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:15.252 08:25:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:15.252 08:25:01 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:15.252 08:25:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:15.252 08:25:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:15.252 08:25:01 -- common/autotest_common.sh@10 -- # set +x 00:17:15.252 08:25:01 -- nvmf/common.sh@469 -- # nvmfpid=973192 00:17:15.252 08:25:01 -- nvmf/common.sh@470 -- # waitforlisten 973192 00:17:15.252 08:25:01 -- common/autotest_common.sh@829 -- # '[' -z 973192 ']' 00:17:15.252 08:25:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:15.252 08:25:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:15.252 08:25:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:15.252 08:25:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:15.252 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:15.252 08:25:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:15.252 08:25:01 -- common/autotest_common.sh@10 -- # set +x 00:17:15.511 [2024-11-26 08:25:01.133052] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.511 [2024-11-26 08:25:01.133135] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:15.511 [2024-11-26 08:25:01.204075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:15.511 [2024-11-26 08:25:01.310100] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:15.511 [2024-11-26 08:25:01.310261] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:15.511 [2024-11-26 08:25:01.310289] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:15.511 [2024-11-26 08:25:01.310301] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:15.511 [2024-11-26 08:25:01.310359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:15.511 [2024-11-26 08:25:01.310424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:15.511 [2024-11-26 08:25:01.310471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:15.511 [2024-11-26 08:25:01.310473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:16.450 08:25:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.450 08:25:02 -- common/autotest_common.sh@862 -- # return 0 00:17:16.450 08:25:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:16.450 08:25:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 08:25:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:16.450 08:25:02 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:16.450 08:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 [2024-11-26 08:25:02.131938] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:16.450 08:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.450 08:25:02 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:16.450 08:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 Malloc0 00:17:16.450 08:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.450 08:25:02 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:16.450 08:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 08:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.450 08:25:02 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:16.450 08:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 08:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.450 08:25:02 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:16.450 08:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.450 08:25:02 -- common/autotest_common.sh@10 -- # set +x 00:17:16.450 [2024-11-26 08:25:02.170328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.450 08:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.450 08:25:02 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:16.450 08:25:02 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:16.450 08:25:02 -- nvmf/common.sh@520 -- # config=() 00:17:16.450 08:25:02 -- nvmf/common.sh@520 -- # local subsystem config 00:17:16.450 08:25:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:16.450 08:25:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:16.450 { 00:17:16.450 "params": { 00:17:16.450 "name": "Nvme$subsystem", 00:17:16.450 "trtype": "$TEST_TRANSPORT", 00:17:16.450 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.450 "adrfam": "ipv4", 00:17:16.450 "trsvcid": "$NVMF_PORT", 00:17:16.450 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.450 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.450 "hdgst": ${hdgst:-false}, 00:17:16.450 "ddgst": ${ddgst:-false} 00:17:16.450 }, 00:17:16.450 "method": "bdev_nvme_attach_controller" 00:17:16.450 } 00:17:16.450 EOF 00:17:16.450 )") 00:17:16.450 08:25:02 -- nvmf/common.sh@542 -- # cat 00:17:16.450 08:25:02 -- nvmf/common.sh@544 -- # jq . 00:17:16.450 08:25:02 -- nvmf/common.sh@545 -- # IFS=, 00:17:16.450 08:25:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:16.450 "params": { 00:17:16.450 "name": "Nvme1", 00:17:16.450 "trtype": "tcp", 00:17:16.450 "traddr": "10.0.0.2", 00:17:16.450 "adrfam": "ipv4", 00:17:16.450 "trsvcid": "4420", 00:17:16.450 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:16.450 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:16.450 "hdgst": false, 00:17:16.450 "ddgst": false 00:17:16.450 }, 00:17:16.450 "method": "bdev_nvme_attach_controller" 00:17:16.450 }' 00:17:16.450 [2024-11-26 08:25:02.213698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.450 [2024-11-26 08:25:02.213774] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid973354 ] 00:17:16.450 [2024-11-26 08:25:02.276653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:16.710 [2024-11-26 08:25:02.390870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:16.710 [2024-11-26 08:25:02.390922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:16.710 [2024-11-26 08:25:02.390925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:16.969 [2024-11-26 08:25:02.585722] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:16.969 [2024-11-26 08:25:02.585788] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:16.969 I/O targets: 00:17:16.969 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:16.969 00:17:16.969 00:17:16.969 CUnit - A unit testing framework for C - Version 2.1-3 00:17:16.969 http://cunit.sourceforge.net/ 00:17:16.969 00:17:16.969 00:17:16.969 Suite: bdevio tests on: Nvme1n1 00:17:16.969 Test: blockdev write read block ...passed 00:17:16.969 Test: blockdev write zeroes read block ...passed 00:17:16.969 Test: blockdev write zeroes read no split ...passed 00:17:16.969 Test: blockdev write zeroes read split ...passed 00:17:16.969 Test: blockdev write zeroes read split partial ...passed 00:17:16.969 Test: blockdev reset ...[2024-11-26 08:25:02.790056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:16.969 [2024-11-26 08:25:02.790161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14c37d0 (9): Bad file descriptor 00:17:17.227 [2024-11-26 08:25:02.844511] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:17.227 passed 00:17:17.227 Test: blockdev write read 8 blocks ...passed 00:17:17.227 Test: blockdev write read size > 128k ...passed 00:17:17.227 Test: blockdev write read invalid size ...passed 00:17:17.227 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:17.227 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:17.227 Test: blockdev write read max offset ...passed 00:17:17.227 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:17.227 Test: blockdev writev readv 8 blocks ...passed 00:17:17.487 Test: blockdev writev readv 30 x 1block ...passed 00:17:17.487 Test: blockdev writev readv block ...passed 00:17:17.487 Test: blockdev writev readv size > 128k ...passed 00:17:17.487 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:17.487 Test: blockdev comparev and writev ...[2024-11-26 08:25:03.143719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.143755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.143781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.143797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.144148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.144173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.144194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.144210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.144552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.144582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.144604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.144620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.144979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.145003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.145024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.487 [2024-11-26 08:25:03.145039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:17.487 passed 00:17:17.487 Test: blockdev nvme passthru rw ...passed 00:17:17.487 Test: blockdev nvme passthru vendor specific ...[2024-11-26 08:25:03.227976] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.487 [2024-11-26 08:25:03.228003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.228154] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.487 [2024-11-26 08:25:03.228178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.228329] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.487 [2024-11-26 08:25:03.228351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:17.487 [2024-11-26 08:25:03.228498] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.487 [2024-11-26 08:25:03.228520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:17.487 passed 00:17:17.487 Test: blockdev nvme admin passthru ...passed 00:17:17.487 Test: blockdev copy ...passed 00:17:17.487 00:17:17.487 Run Summary: Type Total Ran Passed Failed Inactive 00:17:17.487 suites 1 1 n/a 0 0 00:17:17.487 tests 23 23 23 0 0 00:17:17.487 asserts 152 152 152 0 n/a 00:17:17.487 00:17:17.487 Elapsed time = 1.393 seconds 00:17:18.057 08:25:03 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:18.057 08:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:18.057 08:25:03 -- common/autotest_common.sh@10 -- # set +x 00:17:18.057 08:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:18.057 08:25:03 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:18.057 08:25:03 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:18.057 08:25:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:18.057 08:25:03 -- nvmf/common.sh@116 -- # sync 00:17:18.057 08:25:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:18.057 08:25:03 -- nvmf/common.sh@119 -- # set +e 00:17:18.057 08:25:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:18.057 08:25:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:18.057 rmmod nvme_tcp 00:17:18.057 rmmod nvme_fabrics 00:17:18.057 rmmod nvme_keyring 00:17:18.057 08:25:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:18.057 08:25:03 -- nvmf/common.sh@123 -- # set -e 00:17:18.057 08:25:03 -- nvmf/common.sh@124 -- # return 0 00:17:18.057 08:25:03 -- nvmf/common.sh@477 -- # '[' -n 973192 ']' 00:17:18.057 08:25:03 -- nvmf/common.sh@478 -- # killprocess 973192 00:17:18.057 08:25:03 -- common/autotest_common.sh@936 -- # '[' -z 973192 ']' 00:17:18.057 08:25:03 -- common/autotest_common.sh@940 -- # kill -0 973192 00:17:18.057 08:25:03 -- common/autotest_common.sh@941 -- # uname 00:17:18.057 08:25:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:18.057 08:25:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 973192 00:17:18.057 08:25:03 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:18.057 08:25:03 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:18.057 08:25:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 973192' 00:17:18.057 killing process with pid 973192 00:17:18.057 08:25:03 -- common/autotest_common.sh@955 -- # kill 973192 00:17:18.057 08:25:03 -- common/autotest_common.sh@960 -- # wait 973192 00:17:18.629 08:25:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:18.629 08:25:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:18.629 08:25:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:18.629 08:25:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:18.629 08:25:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:18.629 08:25:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:18.629 08:25:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:18.629 08:25:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.536 08:25:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:20.536 00:17:20.536 real 0m7.472s 00:17:20.536 user 0m14.628s 00:17:20.536 sys 0m2.577s 00:17:20.536 08:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:20.536 08:25:06 -- common/autotest_common.sh@10 -- # set +x 00:17:20.536 ************************************ 00:17:20.536 END TEST nvmf_bdevio_no_huge 00:17:20.536 ************************************ 00:17:20.536 08:25:06 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.536 08:25:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:20.536 08:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:20.536 08:25:06 -- common/autotest_common.sh@10 -- # set +x 00:17:20.536 ************************************ 00:17:20.536 START TEST nvmf_tls 00:17:20.536 ************************************ 00:17:20.536 08:25:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.536 * Looking for test storage... 00:17:20.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:20.536 08:25:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:20.536 08:25:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:20.536 08:25:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:20.796 08:25:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:20.796 08:25:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:20.796 08:25:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:20.796 08:25:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:20.796 08:25:06 -- scripts/common.sh@335 -- # IFS=.-: 00:17:20.796 08:25:06 -- scripts/common.sh@335 -- # read -ra ver1 00:17:20.796 08:25:06 -- scripts/common.sh@336 -- # IFS=.-: 00:17:20.796 08:25:06 -- scripts/common.sh@336 -- # read -ra ver2 00:17:20.796 08:25:06 -- scripts/common.sh@337 -- # local 'op=<' 00:17:20.796 08:25:06 -- scripts/common.sh@339 -- # ver1_l=2 00:17:20.796 08:25:06 -- scripts/common.sh@340 -- # ver2_l=1 00:17:20.796 08:25:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:20.796 08:25:06 -- scripts/common.sh@343 -- # case "$op" in 00:17:20.796 08:25:06 -- scripts/common.sh@344 -- # : 1 00:17:20.796 08:25:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:20.796 08:25:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:20.796 08:25:06 -- scripts/common.sh@364 -- # decimal 1 00:17:20.796 08:25:06 -- scripts/common.sh@352 -- # local d=1 00:17:20.796 08:25:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:20.796 08:25:06 -- scripts/common.sh@354 -- # echo 1 00:17:20.796 08:25:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:20.796 08:25:06 -- scripts/common.sh@365 -- # decimal 2 00:17:20.796 08:25:06 -- scripts/common.sh@352 -- # local d=2 00:17:20.796 08:25:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:20.796 08:25:06 -- scripts/common.sh@354 -- # echo 2 00:17:20.796 08:25:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:20.796 08:25:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:20.796 08:25:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:20.796 08:25:06 -- scripts/common.sh@367 -- # return 0 00:17:20.796 08:25:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:20.796 08:25:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:20.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.796 --rc genhtml_branch_coverage=1 00:17:20.796 --rc genhtml_function_coverage=1 00:17:20.796 --rc genhtml_legend=1 00:17:20.796 --rc geninfo_all_blocks=1 00:17:20.796 --rc geninfo_unexecuted_blocks=1 00:17:20.796 00:17:20.796 ' 00:17:20.796 08:25:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:20.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.796 --rc genhtml_branch_coverage=1 00:17:20.796 --rc genhtml_function_coverage=1 00:17:20.796 --rc genhtml_legend=1 00:17:20.796 --rc geninfo_all_blocks=1 00:17:20.796 --rc geninfo_unexecuted_blocks=1 00:17:20.796 00:17:20.796 ' 00:17:20.796 08:25:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:20.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.796 --rc genhtml_branch_coverage=1 00:17:20.796 --rc genhtml_function_coverage=1 00:17:20.796 --rc genhtml_legend=1 00:17:20.796 --rc geninfo_all_blocks=1 00:17:20.796 --rc geninfo_unexecuted_blocks=1 00:17:20.796 00:17:20.796 ' 00:17:20.796 08:25:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:20.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.796 --rc genhtml_branch_coverage=1 00:17:20.796 --rc genhtml_function_coverage=1 00:17:20.796 --rc genhtml_legend=1 00:17:20.796 --rc geninfo_all_blocks=1 00:17:20.796 --rc geninfo_unexecuted_blocks=1 00:17:20.796 00:17:20.796 ' 00:17:20.796 08:25:06 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:20.796 08:25:06 -- nvmf/common.sh@7 -- # uname -s 00:17:20.796 08:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:20.796 08:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:20.796 08:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:20.796 08:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:20.796 08:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:20.796 08:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:20.796 08:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:20.796 08:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:20.796 08:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:20.796 08:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:20.796 08:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.796 08:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.796 08:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:20.796 08:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:20.796 08:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:20.796 08:25:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:20.796 08:25:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:20.796 08:25:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:20.796 08:25:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:20.796 08:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.796 08:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.796 08:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.796 08:25:06 -- paths/export.sh@5 -- # export PATH 00:17:20.796 08:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.796 08:25:06 -- nvmf/common.sh@46 -- # : 0 00:17:20.796 08:25:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:20.796 08:25:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:20.796 08:25:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:20.796 08:25:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:20.796 08:25:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:20.796 08:25:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:20.796 08:25:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:20.796 08:25:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:20.796 08:25:06 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.796 08:25:06 -- target/tls.sh@71 -- # nvmftestinit 00:17:20.796 08:25:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:20.796 08:25:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:20.796 08:25:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:20.796 08:25:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:20.796 08:25:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:20.796 08:25:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:20.796 08:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:20.796 08:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.796 08:25:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:20.796 08:25:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:20.796 08:25:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:20.796 08:25:06 -- common/autotest_common.sh@10 -- # set +x 00:17:22.706 08:25:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:22.706 08:25:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:22.706 08:25:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:22.706 08:25:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:22.706 08:25:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:22.706 08:25:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:22.706 08:25:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:22.706 08:25:08 -- nvmf/common.sh@294 -- # net_devs=() 00:17:22.706 08:25:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:22.706 08:25:08 -- nvmf/common.sh@295 -- # e810=() 00:17:22.706 08:25:08 -- nvmf/common.sh@295 -- # local -ga e810 00:17:22.706 08:25:08 -- nvmf/common.sh@296 -- # x722=() 00:17:22.706 08:25:08 -- nvmf/common.sh@296 -- # local -ga x722 00:17:22.706 08:25:08 -- nvmf/common.sh@297 -- # mlx=() 00:17:22.706 08:25:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:22.706 08:25:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:22.706 08:25:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:22.706 08:25:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:22.706 08:25:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.706 08:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:22.706 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:22.706 08:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.706 08:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:22.706 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:22.706 08:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.706 08:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.706 08:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.706 08:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:22.706 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:22.706 08:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.706 08:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.706 08:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.706 08:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.706 08:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:22.706 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:22.706 08:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.706 08:25:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:22.706 08:25:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:22.706 08:25:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:22.706 08:25:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:22.706 08:25:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:22.706 08:25:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:22.706 08:25:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:22.706 08:25:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:22.706 08:25:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:22.706 08:25:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:22.706 08:25:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:22.706 08:25:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:22.706 08:25:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:22.706 08:25:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:22.706 08:25:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:22.706 08:25:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:22.706 08:25:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:22.706 08:25:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:22.707 08:25:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:22.707 08:25:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:22.707 08:25:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:22.707 08:25:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:22.707 08:25:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:22.707 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:22.707 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:17:22.707 00:17:22.707 --- 10.0.0.2 ping statistics --- 00:17:22.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.707 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:17:22.707 08:25:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:22.707 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:22.707 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:17:22.707 00:17:22.707 --- 10.0.0.1 ping statistics --- 00:17:22.707 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.707 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:17:22.707 08:25:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:22.707 08:25:08 -- nvmf/common.sh@410 -- # return 0 00:17:22.707 08:25:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:22.707 08:25:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:22.707 08:25:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:22.707 08:25:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:22.707 08:25:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:22.707 08:25:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:22.707 08:25:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:22.707 08:25:08 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:22.707 08:25:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:22.707 08:25:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:22.707 08:25:08 -- common/autotest_common.sh@10 -- # set +x 00:17:22.707 08:25:08 -- nvmf/common.sh@469 -- # nvmfpid=975564 00:17:22.707 08:25:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:22.707 08:25:08 -- nvmf/common.sh@470 -- # waitforlisten 975564 00:17:22.707 08:25:08 -- common/autotest_common.sh@829 -- # '[' -z 975564 ']' 00:17:22.707 08:25:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.707 08:25:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.707 08:25:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.707 08:25:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.707 08:25:08 -- common/autotest_common.sh@10 -- # set +x 00:17:22.707 [2024-11-26 08:25:08.559536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.707 [2024-11-26 08:25:08.559610] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:22.965 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.965 [2024-11-26 08:25:08.630113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.965 [2024-11-26 08:25:08.743604] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:22.965 [2024-11-26 08:25:08.743786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:22.965 [2024-11-26 08:25:08.743807] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:22.965 [2024-11-26 08:25:08.743820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:22.965 [2024-11-26 08:25:08.743848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.965 08:25:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.965 08:25:08 -- common/autotest_common.sh@862 -- # return 0 00:17:22.965 08:25:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.965 08:25:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.965 08:25:08 -- common/autotest_common.sh@10 -- # set +x 00:17:22.965 08:25:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.965 08:25:08 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:22.965 08:25:08 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:23.223 true 00:17:23.223 08:25:09 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.223 08:25:09 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:23.491 08:25:09 -- target/tls.sh@82 -- # version=0 00:17:23.491 08:25:09 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:23.491 08:25:09 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:23.751 08:25:09 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.751 08:25:09 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:24.009 08:25:09 -- target/tls.sh@90 -- # version=13 00:17:24.009 08:25:09 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:24.009 08:25:09 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:24.267 08:25:10 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.267 08:25:10 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:24.526 08:25:10 -- target/tls.sh@98 -- # version=7 00:17:24.526 08:25:10 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:24.526 08:25:10 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.526 08:25:10 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:24.785 08:25:10 -- target/tls.sh@105 -- # ktls=false 00:17:24.785 08:25:10 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:24.785 08:25:10 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:25.043 08:25:10 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:25.043 08:25:10 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:25.303 08:25:11 -- target/tls.sh@113 -- # ktls=true 00:17:25.303 08:25:11 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:25.303 08:25:11 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:25.561 08:25:11 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:25.561 08:25:11 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:25.819 08:25:11 -- target/tls.sh@121 -- # ktls=false 00:17:25.819 08:25:11 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:25.819 08:25:11 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:25.819 08:25:11 -- target/tls.sh@49 -- # local key hash crc 00:17:25.819 08:25:11 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:25.819 08:25:11 -- target/tls.sh@51 -- # hash=01 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # tail -c8 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # head -c 4 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # crc='p$H�' 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.819 08:25:11 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.819 08:25:11 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:25.819 08:25:11 -- target/tls.sh@49 -- # local key hash crc 00:17:25.819 08:25:11 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:25.819 08:25:11 -- target/tls.sh@51 -- # hash=01 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # tail -c8 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # head -c 4 00:17:25.819 08:25:11 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:25.819 08:25:11 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.819 08:25:11 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.819 08:25:11 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.819 08:25:11 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.819 08:25:11 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.819 08:25:11 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.819 08:25:11 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.077 08:25:11 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:26.077 08:25:11 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:26.336 08:25:11 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:26.594 08:25:12 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.594 08:25:12 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.594 08:25:12 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:26.852 [2024-11-26 08:25:12.550620] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.852 08:25:12 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:27.109 08:25:12 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:27.367 [2024-11-26 08:25:13.047975] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:27.367 [2024-11-26 08:25:13.048232] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:27.367 08:25:13 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:27.625 malloc0 00:17:27.625 08:25:13 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:27.883 08:25:13 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:28.142 08:25:13 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:28.142 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.129 Initializing NVMe Controllers 00:17:38.129 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:38.129 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:38.129 Initialization complete. Launching workers. 00:17:38.129 ======================================================== 00:17:38.129 Latency(us) 00:17:38.129 Device Information : IOPS MiB/s Average min max 00:17:38.129 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7797.59 30.46 8210.33 1071.17 9209.73 00:17:38.129 ======================================================== 00:17:38.129 Total : 7797.59 30.46 8210.33 1071.17 9209.73 00:17:38.129 00:17:38.129 08:25:23 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.129 08:25:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.129 08:25:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:38.129 08:25:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:38.129 08:25:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:38.129 08:25:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.129 08:25:23 -- target/tls.sh@28 -- # bdevperf_pid=977404 00:17:38.129 08:25:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.129 08:25:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.129 08:25:23 -- target/tls.sh@31 -- # waitforlisten 977404 /var/tmp/bdevperf.sock 00:17:38.129 08:25:23 -- common/autotest_common.sh@829 -- # '[' -z 977404 ']' 00:17:38.129 08:25:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.129 08:25:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.129 08:25:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.129 08:25:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.129 08:25:23 -- common/autotest_common.sh@10 -- # set +x 00:17:38.129 [2024-11-26 08:25:23.966596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.129 [2024-11-26 08:25:23.966671] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid977404 ] 00:17:38.387 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.388 [2024-11-26 08:25:24.023930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.388 [2024-11-26 08:25:24.132222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.322 08:25:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.322 08:25:24 -- common/autotest_common.sh@862 -- # return 0 00:17:39.322 08:25:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.580 [2024-11-26 08:25:25.224924] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:39.580 TLSTESTn1 00:17:39.580 08:25:25 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:39.840 Running I/O for 10 seconds... 00:17:49.818 00:17:49.818 Latency(us) 00:17:49.818 [2024-11-26T07:25:35.678Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.818 [2024-11-26T07:25:35.678Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:49.818 Verification LBA range: start 0x0 length 0x2000 00:17:49.818 TLSTESTn1 : 10.02 4346.78 16.98 0.00 0.00 29401.09 7281.78 44661.57 00:17:49.818 [2024-11-26T07:25:35.678Z] =================================================================================================================== 00:17:49.818 [2024-11-26T07:25:35.678Z] Total : 4346.78 16.98 0.00 0.00 29401.09 7281.78 44661.57 00:17:49.818 0 00:17:49.818 08:25:35 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:49.818 08:25:35 -- target/tls.sh@45 -- # killprocess 977404 00:17:49.818 08:25:35 -- common/autotest_common.sh@936 -- # '[' -z 977404 ']' 00:17:49.818 08:25:35 -- common/autotest_common.sh@940 -- # kill -0 977404 00:17:49.818 08:25:35 -- common/autotest_common.sh@941 -- # uname 00:17:49.818 08:25:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.818 08:25:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 977404 00:17:49.818 08:25:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.818 08:25:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.818 08:25:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 977404' 00:17:49.818 killing process with pid 977404 00:17:49.818 08:25:35 -- common/autotest_common.sh@955 -- # kill 977404 00:17:49.818 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.818 00:17:49.818 Latency(us) 00:17:49.818 [2024-11-26T07:25:35.678Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.818 [2024-11-26T07:25:35.678Z] =================================================================================================================== 00:17:49.818 [2024-11-26T07:25:35.678Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:49.819 08:25:35 -- common/autotest_common.sh@960 -- # wait 977404 00:17:50.079 08:25:35 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.079 08:25:35 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.080 08:25:35 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.080 08:25:35 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:50.080 08:25:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.080 08:25:35 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:50.080 08:25:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.080 08:25:35 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.080 08:25:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:50.080 08:25:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:50.080 08:25:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:50.080 08:25:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:50.080 08:25:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:50.080 08:25:35 -- target/tls.sh@28 -- # bdevperf_pid=978896 00:17:50.080 08:25:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:50.080 08:25:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:50.080 08:25:35 -- target/tls.sh@31 -- # waitforlisten 978896 /var/tmp/bdevperf.sock 00:17:50.080 08:25:35 -- common/autotest_common.sh@829 -- # '[' -z 978896 ']' 00:17:50.080 08:25:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:50.080 08:25:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:50.080 08:25:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:50.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:50.080 08:25:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:50.080 08:25:35 -- common/autotest_common.sh@10 -- # set +x 00:17:50.080 [2024-11-26 08:25:35.853956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:50.080 [2024-11-26 08:25:35.854053] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid978896 ] 00:17:50.080 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.080 [2024-11-26 08:25:35.919819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.338 [2024-11-26 08:25:36.029743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:51.275 08:25:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.275 08:25:36 -- common/autotest_common.sh@862 -- # return 0 00:17:51.275 08:25:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:51.533 [2024-11-26 08:25:37.145815] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.533 [2024-11-26 08:25:37.151246] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:51.533 [2024-11-26 08:25:37.151712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16d01f0 (107): Transport endpoint is not connected 00:17:51.533 [2024-11-26 08:25:37.152699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16d01f0 (9): Bad file descriptor 00:17:51.533 [2024-11-26 08:25:37.153709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:51.533 [2024-11-26 08:25:37.153732] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:51.533 [2024-11-26 08:25:37.153748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:51.533 request: 00:17:51.533 { 00:17:51.533 "name": "TLSTEST", 00:17:51.533 "trtype": "tcp", 00:17:51.533 "traddr": "10.0.0.2", 00:17:51.533 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.533 "adrfam": "ipv4", 00:17:51.533 "trsvcid": "4420", 00:17:51.533 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.533 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:51.533 "method": "bdev_nvme_attach_controller", 00:17:51.533 "req_id": 1 00:17:51.533 } 00:17:51.533 Got JSON-RPC error response 00:17:51.533 response: 00:17:51.533 { 00:17:51.533 "code": -32602, 00:17:51.533 "message": "Invalid parameters" 00:17:51.533 } 00:17:51.533 08:25:37 -- target/tls.sh@36 -- # killprocess 978896 00:17:51.533 08:25:37 -- common/autotest_common.sh@936 -- # '[' -z 978896 ']' 00:17:51.533 08:25:37 -- common/autotest_common.sh@940 -- # kill -0 978896 00:17:51.533 08:25:37 -- common/autotest_common.sh@941 -- # uname 00:17:51.533 08:25:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.533 08:25:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 978896 00:17:51.533 08:25:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:51.533 08:25:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:51.533 08:25:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 978896' 00:17:51.533 killing process with pid 978896 00:17:51.533 08:25:37 -- common/autotest_common.sh@955 -- # kill 978896 00:17:51.533 Received shutdown signal, test time was about 10.000000 seconds 00:17:51.533 00:17:51.533 Latency(us) 00:17:51.533 [2024-11-26T07:25:37.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.533 [2024-11-26T07:25:37.393Z] =================================================================================================================== 00:17:51.533 [2024-11-26T07:25:37.393Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:51.533 08:25:37 -- common/autotest_common.sh@960 -- # wait 978896 00:17:51.792 08:25:37 -- target/tls.sh@37 -- # return 1 00:17:51.792 08:25:37 -- common/autotest_common.sh@653 -- # es=1 00:17:51.792 08:25:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.792 08:25:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.792 08:25:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.792 08:25:37 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.792 08:25:37 -- common/autotest_common.sh@650 -- # local es=0 00:17:51.792 08:25:37 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.792 08:25:37 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:51.792 08:25:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.792 08:25:37 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:51.792 08:25:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.792 08:25:37 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.792 08:25:37 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:51.792 08:25:37 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:51.792 08:25:37 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:51.792 08:25:37 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:51.792 08:25:37 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.792 08:25:37 -- target/tls.sh@28 -- # bdevperf_pid=979054 00:17:51.792 08:25:37 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:51.792 08:25:37 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:51.792 08:25:37 -- target/tls.sh@31 -- # waitforlisten 979054 /var/tmp/bdevperf.sock 00:17:51.792 08:25:37 -- common/autotest_common.sh@829 -- # '[' -z 979054 ']' 00:17:51.792 08:25:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.792 08:25:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.792 08:25:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.792 08:25:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.792 08:25:37 -- common/autotest_common.sh@10 -- # set +x 00:17:51.792 [2024-11-26 08:25:37.512083] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:51.792 [2024-11-26 08:25:37.512153] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid979054 ] 00:17:51.792 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.792 [2024-11-26 08:25:37.567761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.052 [2024-11-26 08:25:37.670497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.074 08:25:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.074 08:25:38 -- common/autotest_common.sh@862 -- # return 0 00:17:53.074 08:25:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.074 [2024-11-26 08:25:38.724635] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:53.074 [2024-11-26 08:25:38.732298] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:53.074 [2024-11-26 08:25:38.732331] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:53.074 [2024-11-26 08:25:38.732388] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:53.074 [2024-11-26 08:25:38.732628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c3b1f0 (107): Transport endpoint is not connected 00:17:53.075 [2024-11-26 08:25:38.733616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c3b1f0 (9): Bad file descriptor 00:17:53.075 [2024-11-26 08:25:38.734616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:53.075 [2024-11-26 08:25:38.734636] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:53.075 [2024-11-26 08:25:38.734665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:53.075 request: 00:17:53.075 { 00:17:53.075 "name": "TLSTEST", 00:17:53.075 "trtype": "tcp", 00:17:53.075 "traddr": "10.0.0.2", 00:17:53.075 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:53.075 "adrfam": "ipv4", 00:17:53.075 "trsvcid": "4420", 00:17:53.075 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:53.075 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:53.075 "method": "bdev_nvme_attach_controller", 00:17:53.075 "req_id": 1 00:17:53.075 } 00:17:53.075 Got JSON-RPC error response 00:17:53.075 response: 00:17:53.075 { 00:17:53.075 "code": -32602, 00:17:53.075 "message": "Invalid parameters" 00:17:53.075 } 00:17:53.075 08:25:38 -- target/tls.sh@36 -- # killprocess 979054 00:17:53.075 08:25:38 -- common/autotest_common.sh@936 -- # '[' -z 979054 ']' 00:17:53.075 08:25:38 -- common/autotest_common.sh@940 -- # kill -0 979054 00:17:53.075 08:25:38 -- common/autotest_common.sh@941 -- # uname 00:17:53.075 08:25:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:53.075 08:25:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 979054 00:17:53.075 08:25:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:53.075 08:25:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:53.075 08:25:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 979054' 00:17:53.075 killing process with pid 979054 00:17:53.075 08:25:38 -- common/autotest_common.sh@955 -- # kill 979054 00:17:53.075 Received shutdown signal, test time was about 10.000000 seconds 00:17:53.075 00:17:53.075 Latency(us) 00:17:53.075 [2024-11-26T07:25:38.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.075 [2024-11-26T07:25:38.935Z] =================================================================================================================== 00:17:53.075 [2024-11-26T07:25:38.935Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:53.075 08:25:38 -- common/autotest_common.sh@960 -- # wait 979054 00:17:53.361 08:25:39 -- target/tls.sh@37 -- # return 1 00:17:53.361 08:25:39 -- common/autotest_common.sh@653 -- # es=1 00:17:53.361 08:25:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:53.361 08:25:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:53.361 08:25:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:53.361 08:25:39 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.361 08:25:39 -- common/autotest_common.sh@650 -- # local es=0 00:17:53.361 08:25:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.361 08:25:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:53.361 08:25:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.361 08:25:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:53.361 08:25:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.361 08:25:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.361 08:25:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:53.361 08:25:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:53.361 08:25:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:53.361 08:25:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:53.361 08:25:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:53.361 08:25:39 -- target/tls.sh@28 -- # bdevperf_pid=979324 00:17:53.361 08:25:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:53.361 08:25:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:53.361 08:25:39 -- target/tls.sh@31 -- # waitforlisten 979324 /var/tmp/bdevperf.sock 00:17:53.361 08:25:39 -- common/autotest_common.sh@829 -- # '[' -z 979324 ']' 00:17:53.361 08:25:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:53.361 08:25:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:53.361 08:25:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:53.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:53.361 08:25:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:53.361 08:25:39 -- common/autotest_common.sh@10 -- # set +x 00:17:53.361 [2024-11-26 08:25:39.088569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:53.361 [2024-11-26 08:25:39.088639] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid979324 ] 00:17:53.361 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.361 [2024-11-26 08:25:39.144563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:53.619 [2024-11-26 08:25:39.244826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:54.555 08:25:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:54.555 08:25:40 -- common/autotest_common.sh@862 -- # return 0 00:17:54.555 08:25:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:54.555 [2024-11-26 08:25:40.348371] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:54.555 [2024-11-26 08:25:40.356419] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.555 [2024-11-26 08:25:40.356452] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.555 [2024-11-26 08:25:40.356509] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:54.555 [2024-11-26 08:25:40.357396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc081f0 (107): Transport endpoint is not connected 00:17:54.555 [2024-11-26 08:25:40.358382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc081f0 (9): Bad file descriptor 00:17:54.555 [2024-11-26 08:25:40.359381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:54.555 [2024-11-26 08:25:40.359401] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:54.555 [2024-11-26 08:25:40.359430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:54.555 request: 00:17:54.555 { 00:17:54.555 "name": "TLSTEST", 00:17:54.555 "trtype": "tcp", 00:17:54.555 "traddr": "10.0.0.2", 00:17:54.556 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:54.556 "adrfam": "ipv4", 00:17:54.556 "trsvcid": "4420", 00:17:54.556 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:54.556 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:54.556 "method": "bdev_nvme_attach_controller", 00:17:54.556 "req_id": 1 00:17:54.556 } 00:17:54.556 Got JSON-RPC error response 00:17:54.556 response: 00:17:54.556 { 00:17:54.556 "code": -32602, 00:17:54.556 "message": "Invalid parameters" 00:17:54.556 } 00:17:54.556 08:25:40 -- target/tls.sh@36 -- # killprocess 979324 00:17:54.556 08:25:40 -- common/autotest_common.sh@936 -- # '[' -z 979324 ']' 00:17:54.556 08:25:40 -- common/autotest_common.sh@940 -- # kill -0 979324 00:17:54.556 08:25:40 -- common/autotest_common.sh@941 -- # uname 00:17:54.556 08:25:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.556 08:25:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 979324 00:17:54.815 08:25:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.815 08:25:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.815 08:25:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 979324' 00:17:54.815 killing process with pid 979324 00:17:54.815 08:25:40 -- common/autotest_common.sh@955 -- # kill 979324 00:17:54.815 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.815 00:17:54.815 Latency(us) 00:17:54.815 [2024-11-26T07:25:40.675Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.815 [2024-11-26T07:25:40.675Z] =================================================================================================================== 00:17:54.815 [2024-11-26T07:25:40.675Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:54.815 08:25:40 -- common/autotest_common.sh@960 -- # wait 979324 00:17:55.077 08:25:40 -- target/tls.sh@37 -- # return 1 00:17:55.077 08:25:40 -- common/autotest_common.sh@653 -- # es=1 00:17:55.077 08:25:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:55.077 08:25:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:55.077 08:25:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:55.077 08:25:40 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:55.077 08:25:40 -- common/autotest_common.sh@650 -- # local es=0 00:17:55.077 08:25:40 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:55.077 08:25:40 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:55.077 08:25:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:55.077 08:25:40 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:55.077 08:25:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:55.077 08:25:40 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:55.077 08:25:40 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:55.077 08:25:40 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:55.077 08:25:40 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:55.077 08:25:40 -- target/tls.sh@23 -- # psk= 00:17:55.077 08:25:40 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:55.077 08:25:40 -- target/tls.sh@28 -- # bdevperf_pid=979478 00:17:55.077 08:25:40 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:55.077 08:25:40 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:55.077 08:25:40 -- target/tls.sh@31 -- # waitforlisten 979478 /var/tmp/bdevperf.sock 00:17:55.077 08:25:40 -- common/autotest_common.sh@829 -- # '[' -z 979478 ']' 00:17:55.077 08:25:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.077 08:25:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.077 08:25:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.077 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.077 08:25:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.077 08:25:40 -- common/autotest_common.sh@10 -- # set +x 00:17:55.077 [2024-11-26 08:25:40.730382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:55.077 [2024-11-26 08:25:40.730464] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid979478 ] 00:17:55.077 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.077 [2024-11-26 08:25:40.798230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.077 [2024-11-26 08:25:40.905666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.015 08:25:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.015 08:25:41 -- common/autotest_common.sh@862 -- # return 0 00:17:56.015 08:25:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:56.275 [2024-11-26 08:25:41.950562] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:56.275 [2024-11-26 08:25:41.952305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11fe050 (9): Bad file descriptor 00:17:56.275 [2024-11-26 08:25:41.953302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:56.275 [2024-11-26 08:25:41.953321] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:56.275 [2024-11-26 08:25:41.953349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:56.275 request: 00:17:56.275 { 00:17:56.275 "name": "TLSTEST", 00:17:56.275 "trtype": "tcp", 00:17:56.275 "traddr": "10.0.0.2", 00:17:56.275 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.275 "adrfam": "ipv4", 00:17:56.275 "trsvcid": "4420", 00:17:56.275 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.275 "method": "bdev_nvme_attach_controller", 00:17:56.275 "req_id": 1 00:17:56.275 } 00:17:56.275 Got JSON-RPC error response 00:17:56.275 response: 00:17:56.275 { 00:17:56.275 "code": -32602, 00:17:56.275 "message": "Invalid parameters" 00:17:56.275 } 00:17:56.275 08:25:41 -- target/tls.sh@36 -- # killprocess 979478 00:17:56.275 08:25:41 -- common/autotest_common.sh@936 -- # '[' -z 979478 ']' 00:17:56.275 08:25:41 -- common/autotest_common.sh@940 -- # kill -0 979478 00:17:56.275 08:25:41 -- common/autotest_common.sh@941 -- # uname 00:17:56.275 08:25:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.275 08:25:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 979478 00:17:56.275 08:25:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.275 08:25:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.275 08:25:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 979478' 00:17:56.275 killing process with pid 979478 00:17:56.275 08:25:42 -- common/autotest_common.sh@955 -- # kill 979478 00:17:56.275 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.275 00:17:56.275 Latency(us) 00:17:56.275 [2024-11-26T07:25:42.135Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.275 [2024-11-26T07:25:42.135Z] =================================================================================================================== 00:17:56.275 [2024-11-26T07:25:42.135Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:56.275 08:25:42 -- common/autotest_common.sh@960 -- # wait 979478 00:17:56.536 08:25:42 -- target/tls.sh@37 -- # return 1 00:17:56.536 08:25:42 -- common/autotest_common.sh@653 -- # es=1 00:17:56.536 08:25:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:56.536 08:25:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:56.536 08:25:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:56.536 08:25:42 -- target/tls.sh@167 -- # killprocess 975564 00:17:56.536 08:25:42 -- common/autotest_common.sh@936 -- # '[' -z 975564 ']' 00:17:56.536 08:25:42 -- common/autotest_common.sh@940 -- # kill -0 975564 00:17:56.536 08:25:42 -- common/autotest_common.sh@941 -- # uname 00:17:56.536 08:25:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.536 08:25:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 975564 00:17:56.536 08:25:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:56.536 08:25:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:56.536 08:25:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 975564' 00:17:56.536 killing process with pid 975564 00:17:56.536 08:25:42 -- common/autotest_common.sh@955 -- # kill 975564 00:17:56.536 08:25:42 -- common/autotest_common.sh@960 -- # wait 975564 00:17:56.795 08:25:42 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:56.795 08:25:42 -- target/tls.sh@49 -- # local key hash crc 00:17:56.795 08:25:42 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:56.795 08:25:42 -- target/tls.sh@51 -- # hash=02 00:17:56.795 08:25:42 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:56.795 08:25:42 -- target/tls.sh@52 -- # gzip -1 -c 00:17:56.795 08:25:42 -- target/tls.sh@52 -- # tail -c8 00:17:56.795 08:25:42 -- target/tls.sh@52 -- # head -c 4 00:17:56.795 08:25:42 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:56.795 08:25:42 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:56.795 08:25:42 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:56.795 08:25:42 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.795 08:25:42 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.795 08:25:42 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.795 08:25:42 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.795 08:25:42 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.795 08:25:42 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:56.795 08:25:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.795 08:25:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:56.795 08:25:42 -- common/autotest_common.sh@10 -- # set +x 00:17:56.795 08:25:42 -- nvmf/common.sh@469 -- # nvmfpid=979771 00:17:56.795 08:25:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:56.795 08:25:42 -- nvmf/common.sh@470 -- # waitforlisten 979771 00:17:56.795 08:25:42 -- common/autotest_common.sh@829 -- # '[' -z 979771 ']' 00:17:56.795 08:25:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.795 08:25:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.795 08:25:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.795 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.795 08:25:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.795 08:25:42 -- common/autotest_common.sh@10 -- # set +x 00:17:57.055 [2024-11-26 08:25:42.668421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.055 [2024-11-26 08:25:42.668495] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:57.055 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.055 [2024-11-26 08:25:42.734653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.055 [2024-11-26 08:25:42.846207] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:57.055 [2024-11-26 08:25:42.846375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:57.055 [2024-11-26 08:25:42.846395] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:57.055 [2024-11-26 08:25:42.846410] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:57.055 [2024-11-26 08:25:42.846447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.990 08:25:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.990 08:25:43 -- common/autotest_common.sh@862 -- # return 0 00:17:57.990 08:25:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:57.990 08:25:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:57.990 08:25:43 -- common/autotest_common.sh@10 -- # set +x 00:17:57.990 08:25:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:57.990 08:25:43 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.990 08:25:43 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.990 08:25:43 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:58.248 [2024-11-26 08:25:43.868683] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:58.248 08:25:43 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:58.506 08:25:44 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:58.506 [2024-11-26 08:25:44.358020] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:58.506 [2024-11-26 08:25:44.358278] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:58.764 08:25:44 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:59.022 malloc0 00:17:59.022 08:25:44 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:59.283 08:25:44 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.283 08:25:45 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.283 08:25:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:59.283 08:25:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:59.283 08:25:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:59.283 08:25:45 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:59.283 08:25:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:59.542 08:25:45 -- target/tls.sh@28 -- # bdevperf_pid=980070 00:17:59.542 08:25:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:59.542 08:25:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:59.542 08:25:45 -- target/tls.sh@31 -- # waitforlisten 980070 /var/tmp/bdevperf.sock 00:17:59.542 08:25:45 -- common/autotest_common.sh@829 -- # '[' -z 980070 ']' 00:17:59.542 08:25:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.542 08:25:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.542 08:25:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.542 08:25:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.542 08:25:45 -- common/autotest_common.sh@10 -- # set +x 00:17:59.542 [2024-11-26 08:25:45.175344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:59.542 [2024-11-26 08:25:45.175413] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid980070 ] 00:17:59.542 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.542 [2024-11-26 08:25:45.231367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.542 [2024-11-26 08:25:45.336414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.476 08:25:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.476 08:25:46 -- common/autotest_common.sh@862 -- # return 0 00:18:00.476 08:25:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.734 [2024-11-26 08:25:46.352903] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:00.735 TLSTESTn1 00:18:00.735 08:25:46 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:00.735 Running I/O for 10 seconds... 00:18:12.947 00:18:12.948 Latency(us) 00:18:12.948 [2024-11-26T07:25:58.808Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.948 [2024-11-26T07:25:58.808Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:12.948 Verification LBA range: start 0x0 length 0x2000 00:18:12.948 TLSTESTn1 : 10.02 4318.74 16.87 0.00 0.00 29596.28 4660.34 47768.46 00:18:12.948 [2024-11-26T07:25:58.808Z] =================================================================================================================== 00:18:12.948 [2024-11-26T07:25:58.808Z] Total : 4318.74 16.87 0.00 0.00 29596.28 4660.34 47768.46 00:18:12.948 0 00:18:12.948 08:25:56 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:12.948 08:25:56 -- target/tls.sh@45 -- # killprocess 980070 00:18:12.948 08:25:56 -- common/autotest_common.sh@936 -- # '[' -z 980070 ']' 00:18:12.948 08:25:56 -- common/autotest_common.sh@940 -- # kill -0 980070 00:18:12.948 08:25:56 -- common/autotest_common.sh@941 -- # uname 00:18:12.948 08:25:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.948 08:25:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 980070 00:18:12.948 08:25:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:12.948 08:25:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:12.948 08:25:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 980070' 00:18:12.948 killing process with pid 980070 00:18:12.948 08:25:56 -- common/autotest_common.sh@955 -- # kill 980070 00:18:12.948 Received shutdown signal, test time was about 10.000000 seconds 00:18:12.948 00:18:12.948 Latency(us) 00:18:12.948 [2024-11-26T07:25:58.808Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.948 [2024-11-26T07:25:58.808Z] =================================================================================================================== 00:18:12.948 [2024-11-26T07:25:58.808Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:12.948 08:25:56 -- common/autotest_common.sh@960 -- # wait 980070 00:18:12.948 08:25:56 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.948 08:25:56 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.948 08:25:56 -- common/autotest_common.sh@650 -- # local es=0 00:18:12.948 08:25:56 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.948 08:25:56 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:12.948 08:25:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:12.948 08:25:56 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:12.948 08:25:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:12.948 08:25:56 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.948 08:25:56 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:12.948 08:25:56 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:12.948 08:25:56 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:12.948 08:25:56 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:12.948 08:25:56 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:12.948 08:25:56 -- target/tls.sh@28 -- # bdevperf_pid=981458 00:18:12.948 08:25:56 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:12.948 08:25:56 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:12.948 08:25:56 -- target/tls.sh@31 -- # waitforlisten 981458 /var/tmp/bdevperf.sock 00:18:12.948 08:25:56 -- common/autotest_common.sh@829 -- # '[' -z 981458 ']' 00:18:12.948 08:25:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:12.948 08:25:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:12.948 08:25:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:12.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:12.948 08:25:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:12.948 08:25:56 -- common/autotest_common.sh@10 -- # set +x 00:18:12.948 [2024-11-26 08:25:56.951813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:12.948 [2024-11-26 08:25:56.951894] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid981458 ] 00:18:12.948 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.948 [2024-11-26 08:25:57.014295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.948 [2024-11-26 08:25:57.122110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:12.948 08:25:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.948 08:25:57 -- common/autotest_common.sh@862 -- # return 0 00:18:12.948 08:25:57 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.948 [2024-11-26 08:25:58.235926] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:12.948 [2024-11-26 08:25:58.236001] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:12.948 request: 00:18:12.948 { 00:18:12.948 "name": "TLSTEST", 00:18:12.948 "trtype": "tcp", 00:18:12.948 "traddr": "10.0.0.2", 00:18:12.948 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:12.948 "adrfam": "ipv4", 00:18:12.948 "trsvcid": "4420", 00:18:12.948 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.948 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:12.948 "method": "bdev_nvme_attach_controller", 00:18:12.948 "req_id": 1 00:18:12.948 } 00:18:12.948 Got JSON-RPC error response 00:18:12.948 response: 00:18:12.948 { 00:18:12.948 "code": -22, 00:18:12.948 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:12.948 } 00:18:12.948 08:25:58 -- target/tls.sh@36 -- # killprocess 981458 00:18:12.948 08:25:58 -- common/autotest_common.sh@936 -- # '[' -z 981458 ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@940 -- # kill -0 981458 00:18:12.948 08:25:58 -- common/autotest_common.sh@941 -- # uname 00:18:12.948 08:25:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 981458 00:18:12.948 08:25:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:12.948 08:25:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 981458' 00:18:12.948 killing process with pid 981458 00:18:12.948 08:25:58 -- common/autotest_common.sh@955 -- # kill 981458 00:18:12.948 Received shutdown signal, test time was about 10.000000 seconds 00:18:12.948 00:18:12.948 Latency(us) 00:18:12.948 [2024-11-26T07:25:58.808Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.948 [2024-11-26T07:25:58.808Z] =================================================================================================================== 00:18:12.948 [2024-11-26T07:25:58.808Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:12.948 08:25:58 -- common/autotest_common.sh@960 -- # wait 981458 00:18:12.948 08:25:58 -- target/tls.sh@37 -- # return 1 00:18:12.948 08:25:58 -- common/autotest_common.sh@653 -- # es=1 00:18:12.948 08:25:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:12.948 08:25:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:12.948 08:25:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:12.948 08:25:58 -- target/tls.sh@183 -- # killprocess 979771 00:18:12.948 08:25:58 -- common/autotest_common.sh@936 -- # '[' -z 979771 ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@940 -- # kill -0 979771 00:18:12.948 08:25:58 -- common/autotest_common.sh@941 -- # uname 00:18:12.948 08:25:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 979771 00:18:12.948 08:25:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:12.948 08:25:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:12.948 08:25:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 979771' 00:18:12.948 killing process with pid 979771 00:18:12.948 08:25:58 -- common/autotest_common.sh@955 -- # kill 979771 00:18:12.948 08:25:58 -- common/autotest_common.sh@960 -- # wait 979771 00:18:13.206 08:25:58 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:13.206 08:25:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:13.206 08:25:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:13.207 08:25:58 -- common/autotest_common.sh@10 -- # set +x 00:18:13.207 08:25:58 -- nvmf/common.sh@469 -- # nvmfpid=981724 00:18:13.207 08:25:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:13.207 08:25:58 -- nvmf/common.sh@470 -- # waitforlisten 981724 00:18:13.207 08:25:58 -- common/autotest_common.sh@829 -- # '[' -z 981724 ']' 00:18:13.207 08:25:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:13.207 08:25:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:13.207 08:25:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:13.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:13.207 08:25:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:13.207 08:25:58 -- common/autotest_common.sh@10 -- # set +x 00:18:13.207 [2024-11-26 08:25:58.917237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:13.207 [2024-11-26 08:25:58.917337] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:13.207 EAL: No free 2048 kB hugepages reported on node 1 00:18:13.207 [2024-11-26 08:25:58.980802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:13.467 [2024-11-26 08:25:59.084554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:13.467 [2024-11-26 08:25:59.084737] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:13.467 [2024-11-26 08:25:59.084755] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:13.467 [2024-11-26 08:25:59.084767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:13.467 [2024-11-26 08:25:59.084794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:14.036 08:25:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:14.036 08:25:59 -- common/autotest_common.sh@862 -- # return 0 00:18:14.036 08:25:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:14.036 08:25:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:14.037 08:25:59 -- common/autotest_common.sh@10 -- # set +x 00:18:14.296 08:25:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:14.296 08:25:59 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.296 08:25:59 -- common/autotest_common.sh@650 -- # local es=0 00:18:14.296 08:25:59 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.296 08:25:59 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:14.296 08:25:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:14.296 08:25:59 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:14.296 08:25:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:14.296 08:25:59 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.296 08:25:59 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.296 08:25:59 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:14.555 [2024-11-26 08:26:00.192448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:14.555 08:26:00 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:14.813 08:26:00 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:15.072 [2024-11-26 08:26:00.717901] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:15.072 [2024-11-26 08:26:00.718185] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:15.072 08:26:00 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:15.330 malloc0 00:18:15.330 08:26:01 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:15.588 08:26:01 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.847 [2024-11-26 08:26:01.600314] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:15.847 [2024-11-26 08:26:01.600353] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:15.847 [2024-11-26 08:26:01.600391] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:15.847 request: 00:18:15.847 { 00:18:15.847 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.847 "host": "nqn.2016-06.io.spdk:host1", 00:18:15.847 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:15.847 "method": "nvmf_subsystem_add_host", 00:18:15.847 "req_id": 1 00:18:15.847 } 00:18:15.847 Got JSON-RPC error response 00:18:15.847 response: 00:18:15.847 { 00:18:15.847 "code": -32603, 00:18:15.847 "message": "Internal error" 00:18:15.847 } 00:18:15.847 08:26:01 -- common/autotest_common.sh@653 -- # es=1 00:18:15.847 08:26:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:15.847 08:26:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:15.847 08:26:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:15.847 08:26:01 -- target/tls.sh@189 -- # killprocess 981724 00:18:15.847 08:26:01 -- common/autotest_common.sh@936 -- # '[' -z 981724 ']' 00:18:15.847 08:26:01 -- common/autotest_common.sh@940 -- # kill -0 981724 00:18:15.847 08:26:01 -- common/autotest_common.sh@941 -- # uname 00:18:15.847 08:26:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.847 08:26:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 981724 00:18:15.847 08:26:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:15.847 08:26:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:15.847 08:26:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 981724' 00:18:15.847 killing process with pid 981724 00:18:15.847 08:26:01 -- common/autotest_common.sh@955 -- # kill 981724 00:18:15.848 08:26:01 -- common/autotest_common.sh@960 -- # wait 981724 00:18:16.106 08:26:01 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.106 08:26:01 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:16.106 08:26:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:16.106 08:26:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:16.106 08:26:01 -- common/autotest_common.sh@10 -- # set +x 00:18:16.106 08:26:01 -- nvmf/common.sh@469 -- # nvmfpid=982162 00:18:16.106 08:26:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:16.106 08:26:01 -- nvmf/common.sh@470 -- # waitforlisten 982162 00:18:16.106 08:26:01 -- common/autotest_common.sh@829 -- # '[' -z 982162 ']' 00:18:16.106 08:26:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:16.106 08:26:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:16.106 08:26:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:16.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:16.106 08:26:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:16.106 08:26:01 -- common/autotest_common.sh@10 -- # set +x 00:18:16.364 [2024-11-26 08:26:01.995281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:16.364 [2024-11-26 08:26:01.995369] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:16.364 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.364 [2024-11-26 08:26:02.067083] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.364 [2024-11-26 08:26:02.179985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:16.364 [2024-11-26 08:26:02.180150] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:16.364 [2024-11-26 08:26:02.180169] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:16.364 [2024-11-26 08:26:02.180183] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:16.364 [2024-11-26 08:26:02.180214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.302 08:26:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.302 08:26:02 -- common/autotest_common.sh@862 -- # return 0 00:18:17.302 08:26:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.302 08:26:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.302 08:26:02 -- common/autotest_common.sh@10 -- # set +x 00:18:17.302 08:26:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.302 08:26:03 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.302 08:26:03 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.302 08:26:03 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:17.561 [2024-11-26 08:26:03.262230] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.561 08:26:03 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:17.819 08:26:03 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:18.079 [2024-11-26 08:26:03.783652] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:18.079 [2024-11-26 08:26:03.783918] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.079 08:26:03 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:18.339 malloc0 00:18:18.339 08:26:04 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:18.600 08:26:04 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.859 08:26:04 -- target/tls.sh@197 -- # bdevperf_pid=982457 00:18:18.859 08:26:04 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:18.859 08:26:04 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:18.859 08:26:04 -- target/tls.sh@200 -- # waitforlisten 982457 /var/tmp/bdevperf.sock 00:18:18.859 08:26:04 -- common/autotest_common.sh@829 -- # '[' -z 982457 ']' 00:18:18.859 08:26:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.859 08:26:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.859 08:26:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.859 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.859 08:26:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.859 08:26:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.859 [2024-11-26 08:26:04.607255] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.859 [2024-11-26 08:26:04.607346] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid982457 ] 00:18:18.859 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.859 [2024-11-26 08:26:04.664561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.119 [2024-11-26 08:26:04.767304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:20.055 08:26:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.055 08:26:05 -- common/autotest_common.sh@862 -- # return 0 00:18:20.055 08:26:05 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.313 [2024-11-26 08:26:05.955879] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:20.314 TLSTESTn1 00:18:20.314 08:26:06 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:20.572 08:26:06 -- target/tls.sh@205 -- # tgtconf='{ 00:18:20.572 "subsystems": [ 00:18:20.572 { 00:18:20.572 "subsystem": "iobuf", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "iobuf_set_options", 00:18:20.572 "params": { 00:18:20.572 "small_pool_count": 8192, 00:18:20.572 "large_pool_count": 1024, 00:18:20.572 "small_bufsize": 8192, 00:18:20.572 "large_bufsize": 135168 00:18:20.572 } 00:18:20.572 } 00:18:20.572 ] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "sock", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "sock_impl_set_options", 00:18:20.572 "params": { 00:18:20.572 "impl_name": "posix", 00:18:20.572 "recv_buf_size": 2097152, 00:18:20.572 "send_buf_size": 2097152, 00:18:20.572 "enable_recv_pipe": true, 00:18:20.572 "enable_quickack": false, 00:18:20.572 "enable_placement_id": 0, 00:18:20.572 "enable_zerocopy_send_server": true, 00:18:20.572 "enable_zerocopy_send_client": false, 00:18:20.572 "zerocopy_threshold": 0, 00:18:20.572 "tls_version": 0, 00:18:20.572 "enable_ktls": false 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "sock_impl_set_options", 00:18:20.572 "params": { 00:18:20.572 "impl_name": "ssl", 00:18:20.572 "recv_buf_size": 4096, 00:18:20.572 "send_buf_size": 4096, 00:18:20.572 "enable_recv_pipe": true, 00:18:20.572 "enable_quickack": false, 00:18:20.572 "enable_placement_id": 0, 00:18:20.572 "enable_zerocopy_send_server": true, 00:18:20.572 "enable_zerocopy_send_client": false, 00:18:20.572 "zerocopy_threshold": 0, 00:18:20.572 "tls_version": 0, 00:18:20.572 "enable_ktls": false 00:18:20.572 } 00:18:20.572 } 00:18:20.572 ] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "vmd", 00:18:20.572 "config": [] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "accel", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "accel_set_options", 00:18:20.572 "params": { 00:18:20.572 "small_cache_size": 128, 00:18:20.572 "large_cache_size": 16, 00:18:20.572 "task_count": 2048, 00:18:20.572 "sequence_count": 2048, 00:18:20.572 "buf_count": 2048 00:18:20.572 } 00:18:20.572 } 00:18:20.572 ] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "bdev", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "bdev_set_options", 00:18:20.572 "params": { 00:18:20.572 "bdev_io_pool_size": 65535, 00:18:20.572 "bdev_io_cache_size": 256, 00:18:20.572 "bdev_auto_examine": true, 00:18:20.572 "iobuf_small_cache_size": 128, 00:18:20.572 "iobuf_large_cache_size": 16 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_raid_set_options", 00:18:20.572 "params": { 00:18:20.572 "process_window_size_kb": 1024 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_iscsi_set_options", 00:18:20.572 "params": { 00:18:20.572 "timeout_sec": 30 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_nvme_set_options", 00:18:20.572 "params": { 00:18:20.572 "action_on_timeout": "none", 00:18:20.572 "timeout_us": 0, 00:18:20.572 "timeout_admin_us": 0, 00:18:20.572 "keep_alive_timeout_ms": 10000, 00:18:20.572 "transport_retry_count": 4, 00:18:20.572 "arbitration_burst": 0, 00:18:20.572 "low_priority_weight": 0, 00:18:20.572 "medium_priority_weight": 0, 00:18:20.572 "high_priority_weight": 0, 00:18:20.572 "nvme_adminq_poll_period_us": 10000, 00:18:20.572 "nvme_ioq_poll_period_us": 0, 00:18:20.572 "io_queue_requests": 0, 00:18:20.572 "delay_cmd_submit": true, 00:18:20.572 "bdev_retry_count": 3, 00:18:20.572 "transport_ack_timeout": 0, 00:18:20.572 "ctrlr_loss_timeout_sec": 0, 00:18:20.572 "reconnect_delay_sec": 0, 00:18:20.572 "fast_io_fail_timeout_sec": 0, 00:18:20.572 "generate_uuids": false, 00:18:20.572 "transport_tos": 0, 00:18:20.572 "io_path_stat": false, 00:18:20.572 "allow_accel_sequence": false 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_nvme_set_hotplug", 00:18:20.572 "params": { 00:18:20.572 "period_us": 100000, 00:18:20.572 "enable": false 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_malloc_create", 00:18:20.572 "params": { 00:18:20.572 "name": "malloc0", 00:18:20.572 "num_blocks": 8192, 00:18:20.572 "block_size": 4096, 00:18:20.572 "physical_block_size": 4096, 00:18:20.572 "uuid": "89804596-0701-4c3a-a122-437b90f854ac", 00:18:20.572 "optimal_io_boundary": 0 00:18:20.572 } 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "method": "bdev_wait_for_examine" 00:18:20.572 } 00:18:20.572 ] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "nbd", 00:18:20.572 "config": [] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "scheduler", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "framework_set_scheduler", 00:18:20.572 "params": { 00:18:20.572 "name": "static" 00:18:20.572 } 00:18:20.572 } 00:18:20.572 ] 00:18:20.572 }, 00:18:20.572 { 00:18:20.572 "subsystem": "nvmf", 00:18:20.572 "config": [ 00:18:20.572 { 00:18:20.572 "method": "nvmf_set_config", 00:18:20.572 "params": { 00:18:20.573 "discovery_filter": "match_any", 00:18:20.573 "admin_cmd_passthru": { 00:18:20.573 "identify_ctrlr": false 00:18:20.573 } 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_set_max_subsystems", 00:18:20.573 "params": { 00:18:20.573 "max_subsystems": 1024 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_set_crdt", 00:18:20.573 "params": { 00:18:20.573 "crdt1": 0, 00:18:20.573 "crdt2": 0, 00:18:20.573 "crdt3": 0 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_create_transport", 00:18:20.573 "params": { 00:18:20.573 "trtype": "TCP", 00:18:20.573 "max_queue_depth": 128, 00:18:20.573 "max_io_qpairs_per_ctrlr": 127, 00:18:20.573 "in_capsule_data_size": 4096, 00:18:20.573 "max_io_size": 131072, 00:18:20.573 "io_unit_size": 131072, 00:18:20.573 "max_aq_depth": 128, 00:18:20.573 "num_shared_buffers": 511, 00:18:20.573 "buf_cache_size": 4294967295, 00:18:20.573 "dif_insert_or_strip": false, 00:18:20.573 "zcopy": false, 00:18:20.573 "c2h_success": false, 00:18:20.573 "sock_priority": 0, 00:18:20.573 "abort_timeout_sec": 1 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_create_subsystem", 00:18:20.573 "params": { 00:18:20.573 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.573 "allow_any_host": false, 00:18:20.573 "serial_number": "SPDK00000000000001", 00:18:20.573 "model_number": "SPDK bdev Controller", 00:18:20.573 "max_namespaces": 10, 00:18:20.573 "min_cntlid": 1, 00:18:20.573 "max_cntlid": 65519, 00:18:20.573 "ana_reporting": false 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_subsystem_add_host", 00:18:20.573 "params": { 00:18:20.573 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.573 "host": "nqn.2016-06.io.spdk:host1", 00:18:20.573 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_subsystem_add_ns", 00:18:20.573 "params": { 00:18:20.573 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.573 "namespace": { 00:18:20.573 "nsid": 1, 00:18:20.573 "bdev_name": "malloc0", 00:18:20.573 "nguid": "8980459607014C3AA122437B90F854AC", 00:18:20.573 "uuid": "89804596-0701-4c3a-a122-437b90f854ac" 00:18:20.573 } 00:18:20.573 } 00:18:20.573 }, 00:18:20.573 { 00:18:20.573 "method": "nvmf_subsystem_add_listener", 00:18:20.573 "params": { 00:18:20.573 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.573 "listen_address": { 00:18:20.573 "trtype": "TCP", 00:18:20.573 "adrfam": "IPv4", 00:18:20.573 "traddr": "10.0.0.2", 00:18:20.573 "trsvcid": "4420" 00:18:20.573 }, 00:18:20.573 "secure_channel": true 00:18:20.573 } 00:18:20.573 } 00:18:20.573 ] 00:18:20.573 } 00:18:20.573 ] 00:18:20.573 }' 00:18:20.573 08:26:06 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:20.832 08:26:06 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:20.832 "subsystems": [ 00:18:20.832 { 00:18:20.832 "subsystem": "iobuf", 00:18:20.832 "config": [ 00:18:20.832 { 00:18:20.832 "method": "iobuf_set_options", 00:18:20.832 "params": { 00:18:20.832 "small_pool_count": 8192, 00:18:20.832 "large_pool_count": 1024, 00:18:20.832 "small_bufsize": 8192, 00:18:20.832 "large_bufsize": 135168 00:18:20.832 } 00:18:20.832 } 00:18:20.832 ] 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "subsystem": "sock", 00:18:20.832 "config": [ 00:18:20.832 { 00:18:20.832 "method": "sock_impl_set_options", 00:18:20.832 "params": { 00:18:20.832 "impl_name": "posix", 00:18:20.832 "recv_buf_size": 2097152, 00:18:20.832 "send_buf_size": 2097152, 00:18:20.832 "enable_recv_pipe": true, 00:18:20.832 "enable_quickack": false, 00:18:20.832 "enable_placement_id": 0, 00:18:20.832 "enable_zerocopy_send_server": true, 00:18:20.832 "enable_zerocopy_send_client": false, 00:18:20.832 "zerocopy_threshold": 0, 00:18:20.832 "tls_version": 0, 00:18:20.832 "enable_ktls": false 00:18:20.832 } 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "method": "sock_impl_set_options", 00:18:20.832 "params": { 00:18:20.832 "impl_name": "ssl", 00:18:20.832 "recv_buf_size": 4096, 00:18:20.832 "send_buf_size": 4096, 00:18:20.832 "enable_recv_pipe": true, 00:18:20.832 "enable_quickack": false, 00:18:20.832 "enable_placement_id": 0, 00:18:20.832 "enable_zerocopy_send_server": true, 00:18:20.832 "enable_zerocopy_send_client": false, 00:18:20.832 "zerocopy_threshold": 0, 00:18:20.832 "tls_version": 0, 00:18:20.832 "enable_ktls": false 00:18:20.832 } 00:18:20.832 } 00:18:20.832 ] 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "subsystem": "vmd", 00:18:20.832 "config": [] 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "subsystem": "accel", 00:18:20.832 "config": [ 00:18:20.832 { 00:18:20.832 "method": "accel_set_options", 00:18:20.832 "params": { 00:18:20.832 "small_cache_size": 128, 00:18:20.832 "large_cache_size": 16, 00:18:20.832 "task_count": 2048, 00:18:20.832 "sequence_count": 2048, 00:18:20.832 "buf_count": 2048 00:18:20.832 } 00:18:20.832 } 00:18:20.832 ] 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "subsystem": "bdev", 00:18:20.832 "config": [ 00:18:20.832 { 00:18:20.832 "method": "bdev_set_options", 00:18:20.832 "params": { 00:18:20.832 "bdev_io_pool_size": 65535, 00:18:20.832 "bdev_io_cache_size": 256, 00:18:20.832 "bdev_auto_examine": true, 00:18:20.832 "iobuf_small_cache_size": 128, 00:18:20.832 "iobuf_large_cache_size": 16 00:18:20.832 } 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "method": "bdev_raid_set_options", 00:18:20.832 "params": { 00:18:20.832 "process_window_size_kb": 1024 00:18:20.832 } 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "method": "bdev_iscsi_set_options", 00:18:20.832 "params": { 00:18:20.832 "timeout_sec": 30 00:18:20.832 } 00:18:20.832 }, 00:18:20.832 { 00:18:20.832 "method": "bdev_nvme_set_options", 00:18:20.832 "params": { 00:18:20.832 "action_on_timeout": "none", 00:18:20.832 "timeout_us": 0, 00:18:20.832 "timeout_admin_us": 0, 00:18:20.832 "keep_alive_timeout_ms": 10000, 00:18:20.832 "transport_retry_count": 4, 00:18:20.832 "arbitration_burst": 0, 00:18:20.833 "low_priority_weight": 0, 00:18:20.833 "medium_priority_weight": 0, 00:18:20.833 "high_priority_weight": 0, 00:18:20.833 "nvme_adminq_poll_period_us": 10000, 00:18:20.833 "nvme_ioq_poll_period_us": 0, 00:18:20.833 "io_queue_requests": 512, 00:18:20.833 "delay_cmd_submit": true, 00:18:20.833 "bdev_retry_count": 3, 00:18:20.833 "transport_ack_timeout": 0, 00:18:20.833 "ctrlr_loss_timeout_sec": 0, 00:18:20.833 "reconnect_delay_sec": 0, 00:18:20.833 "fast_io_fail_timeout_sec": 0, 00:18:20.833 "generate_uuids": false, 00:18:20.833 "transport_tos": 0, 00:18:20.833 "io_path_stat": false, 00:18:20.833 "allow_accel_sequence": false 00:18:20.833 } 00:18:20.833 }, 00:18:20.833 { 00:18:20.833 "method": "bdev_nvme_attach_controller", 00:18:20.833 "params": { 00:18:20.833 "name": "TLSTEST", 00:18:20.833 "trtype": "TCP", 00:18:20.833 "adrfam": "IPv4", 00:18:20.833 "traddr": "10.0.0.2", 00:18:20.833 "trsvcid": "4420", 00:18:20.833 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.833 "prchk_reftag": false, 00:18:20.833 "prchk_guard": false, 00:18:20.833 "ctrlr_loss_timeout_sec": 0, 00:18:20.833 "reconnect_delay_sec": 0, 00:18:20.833 "fast_io_fail_timeout_sec": 0, 00:18:20.833 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:20.833 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:20.833 "hdgst": false, 00:18:20.833 "ddgst": false 00:18:20.833 } 00:18:20.833 }, 00:18:20.833 { 00:18:20.833 "method": "bdev_nvme_set_hotplug", 00:18:20.833 "params": { 00:18:20.833 "period_us": 100000, 00:18:20.833 "enable": false 00:18:20.833 } 00:18:20.833 }, 00:18:20.833 { 00:18:20.833 "method": "bdev_wait_for_examine" 00:18:20.833 } 00:18:20.833 ] 00:18:20.833 }, 00:18:20.833 { 00:18:20.833 "subsystem": "nbd", 00:18:20.833 "config": [] 00:18:20.833 } 00:18:20.833 ] 00:18:20.833 }' 00:18:20.833 08:26:06 -- target/tls.sh@208 -- # killprocess 982457 00:18:20.833 08:26:06 -- common/autotest_common.sh@936 -- # '[' -z 982457 ']' 00:18:20.833 08:26:06 -- common/autotest_common.sh@940 -- # kill -0 982457 00:18:20.833 08:26:06 -- common/autotest_common.sh@941 -- # uname 00:18:20.833 08:26:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.833 08:26:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 982457 00:18:21.092 08:26:06 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:21.092 08:26:06 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:21.092 08:26:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 982457' 00:18:21.092 killing process with pid 982457 00:18:21.092 08:26:06 -- common/autotest_common.sh@955 -- # kill 982457 00:18:21.092 Received shutdown signal, test time was about 10.000000 seconds 00:18:21.092 00:18:21.092 Latency(us) 00:18:21.092 [2024-11-26T07:26:06.952Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.092 [2024-11-26T07:26:06.952Z] =================================================================================================================== 00:18:21.092 [2024-11-26T07:26:06.952Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:21.092 08:26:06 -- common/autotest_common.sh@960 -- # wait 982457 00:18:21.351 08:26:06 -- target/tls.sh@209 -- # killprocess 982162 00:18:21.351 08:26:06 -- common/autotest_common.sh@936 -- # '[' -z 982162 ']' 00:18:21.351 08:26:06 -- common/autotest_common.sh@940 -- # kill -0 982162 00:18:21.351 08:26:06 -- common/autotest_common.sh@941 -- # uname 00:18:21.351 08:26:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.351 08:26:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 982162 00:18:21.351 08:26:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:21.351 08:26:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:21.351 08:26:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 982162' 00:18:21.351 killing process with pid 982162 00:18:21.351 08:26:06 -- common/autotest_common.sh@955 -- # kill 982162 00:18:21.351 08:26:06 -- common/autotest_common.sh@960 -- # wait 982162 00:18:21.611 08:26:07 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:21.611 08:26:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.611 08:26:07 -- target/tls.sh@212 -- # echo '{ 00:18:21.611 "subsystems": [ 00:18:21.611 { 00:18:21.611 "subsystem": "iobuf", 00:18:21.611 "config": [ 00:18:21.611 { 00:18:21.611 "method": "iobuf_set_options", 00:18:21.611 "params": { 00:18:21.611 "small_pool_count": 8192, 00:18:21.611 "large_pool_count": 1024, 00:18:21.611 "small_bufsize": 8192, 00:18:21.611 "large_bufsize": 135168 00:18:21.611 } 00:18:21.611 } 00:18:21.611 ] 00:18:21.611 }, 00:18:21.611 { 00:18:21.611 "subsystem": "sock", 00:18:21.611 "config": [ 00:18:21.611 { 00:18:21.611 "method": "sock_impl_set_options", 00:18:21.611 "params": { 00:18:21.611 "impl_name": "posix", 00:18:21.611 "recv_buf_size": 2097152, 00:18:21.611 "send_buf_size": 2097152, 00:18:21.611 "enable_recv_pipe": true, 00:18:21.611 "enable_quickack": false, 00:18:21.611 "enable_placement_id": 0, 00:18:21.611 "enable_zerocopy_send_server": true, 00:18:21.611 "enable_zerocopy_send_client": false, 00:18:21.611 "zerocopy_threshold": 0, 00:18:21.611 "tls_version": 0, 00:18:21.611 "enable_ktls": false 00:18:21.611 } 00:18:21.611 }, 00:18:21.611 { 00:18:21.611 "method": "sock_impl_set_options", 00:18:21.611 "params": { 00:18:21.611 "impl_name": "ssl", 00:18:21.611 "recv_buf_size": 4096, 00:18:21.611 "send_buf_size": 4096, 00:18:21.611 "enable_recv_pipe": true, 00:18:21.611 "enable_quickack": false, 00:18:21.611 "enable_placement_id": 0, 00:18:21.611 "enable_zerocopy_send_server": true, 00:18:21.611 "enable_zerocopy_send_client": false, 00:18:21.611 "zerocopy_threshold": 0, 00:18:21.611 "tls_version": 0, 00:18:21.611 "enable_ktls": false 00:18:21.611 } 00:18:21.611 } 00:18:21.611 ] 00:18:21.611 }, 00:18:21.611 { 00:18:21.611 "subsystem": "vmd", 00:18:21.611 "config": [] 00:18:21.611 }, 00:18:21.611 { 00:18:21.611 "subsystem": "accel", 00:18:21.611 "config": [ 00:18:21.611 { 00:18:21.611 "method": "accel_set_options", 00:18:21.611 "params": { 00:18:21.611 "small_cache_size": 128, 00:18:21.611 "large_cache_size": 16, 00:18:21.611 "task_count": 2048, 00:18:21.611 "sequence_count": 2048, 00:18:21.611 "buf_count": 2048 00:18:21.611 } 00:18:21.611 } 00:18:21.611 ] 00:18:21.611 }, 00:18:21.611 { 00:18:21.611 "subsystem": "bdev", 00:18:21.611 "config": [ 00:18:21.611 { 00:18:21.611 "method": "bdev_set_options", 00:18:21.612 "params": { 00:18:21.612 "bdev_io_pool_size": 65535, 00:18:21.612 "bdev_io_cache_size": 256, 00:18:21.612 "bdev_auto_examine": true, 00:18:21.612 "iobuf_small_cache_size": 128, 00:18:21.612 "iobuf_large_cache_size": 16 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_raid_set_options", 00:18:21.612 "params": { 00:18:21.612 "process_window_size_kb": 1024 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_iscsi_set_options", 00:18:21.612 "params": { 00:18:21.612 "timeout_sec": 30 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_nvme_set_options", 00:18:21.612 "params": { 00:18:21.612 "action_on_timeout": "none", 00:18:21.612 "timeout_us": 0, 00:18:21.612 "timeout_admin_us": 0, 00:18:21.612 "keep_alive_timeout_ms": 10000, 00:18:21.612 "transport_retry_count": 4, 00:18:21.612 "arbitration_burst": 0, 00:18:21.612 "low_priority_weight": 0, 00:18:21.612 "medium_priority_weight": 0, 00:18:21.612 "high_priority_weight": 0, 00:18:21.612 "nvme_adminq_poll_period_us": 10000, 00:18:21.612 "nvme_ioq_poll_period_us": 0, 00:18:21.612 "io_queue_requests": 0, 00:18:21.612 "delay_cmd_submit": true, 00:18:21.612 "bdev_retry_count": 3, 00:18:21.612 "transport_ack_timeout": 0, 00:18:21.612 "ctrlr_loss_timeout_sec": 0, 00:18:21.612 "reconnect_delay_sec": 0, 00:18:21.612 "fast_io_fail_timeout_sec": 0, 00:18:21.612 "generate_uuids": false, 00:18:21.612 "transport_tos": 0, 00:18:21.612 "io_path_stat": false, 00:18:21.612 "allow_accel_sequence": false 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_nvme_set_hotplug", 00:18:21.612 "params": { 00:18:21.612 "period_us": 100000, 00:18:21.612 "enable": false 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_malloc_create", 00:18:21.612 "params": { 00:18:21.612 "name": "malloc0", 00:18:21.612 "num_blocks": 8192, 00:18:21.612 "block_size": 4096, 00:18:21.612 "physical_block_size": 4096, 00:18:21.612 "uuid": "89804596-0701-4c3a-a122-437b90f854ac", 00:18:21.612 "optimal_io_boundary": 0 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "bdev_wait_for_examine" 00:18:21.612 } 00:18:21.612 ] 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "subsystem": "nbd", 00:18:21.612 "config": [] 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "subsystem": "scheduler", 00:18:21.612 "config": [ 00:18:21.612 { 00:18:21.612 "method": "framework_set_scheduler", 00:18:21.612 "params": { 00:18:21.612 "name": "static" 00:18:21.612 } 00:18:21.612 } 00:18:21.612 ] 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "subsystem": "nvmf", 00:18:21.612 "config": [ 00:18:21.612 { 00:18:21.612 "method": "nvmf_set_config", 00:18:21.612 "params": { 00:18:21.612 "discovery_filter": "match_any", 00:18:21.612 "admin_cmd_passthru": { 00:18:21.612 "identify_ctrlr": false 00:18:21.612 } 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_set_max_subsystems", 00:18:21.612 "params": { 00:18:21.612 "max_subsystems": 1024 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_set_crdt", 00:18:21.612 "params": { 00:18:21.612 "crdt1": 0, 00:18:21.612 "crdt2": 0, 00:18:21.612 "crdt3": 0 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_create_transport", 00:18:21.612 "params": { 00:18:21.612 "trtype": "TCP", 00:18:21.612 "max_queue_depth": 128, 00:18:21.612 "max_io_qpairs_per_ctrlr": 127, 00:18:21.612 "in_capsule_data_size": 4096, 00:18:21.612 "max_io_size": 131072, 00:18:21.612 "io_unit_size": 131072, 00:18:21.612 "max_aq_depth": 128, 00:18:21.612 "num_shared_buffers": 511, 00:18:21.612 "buf_cache_size": 4294967295, 00:18:21.612 "dif_insert_or_strip": false, 00:18:21.612 "zcopy": false, 00:18:21.612 "c2h_success": false, 00:18:21.612 "sock_priority": 0, 00:18:21.612 "abort_timeout_sec": 1 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_create_subsystem", 00:18:21.612 "params": { 00:18:21.612 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.612 "allow_any_host": false, 00:18:21.612 "serial_number": "SPDK00000000000001", 00:18:21.612 "model_number": "SPDK bdev Controller", 00:18:21.612 "max_namespaces": 10, 00:18:21.612 "min_cntlid": 1, 00:18:21.612 "max_cntlid": 65519, 00:18:21.612 "ana_reporting": false 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_subsystem_add_host", 00:18:21.612 "params": { 00:18:21.612 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.612 "host": "nqn.2016-06.io.spdk:host1", 00:18:21.612 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_subsystem_add_ns", 00:18:21.612 "params": { 00:18:21.612 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.612 "namespace": { 00:18:21.612 "nsid": 1, 00:18:21.612 "bdev_name": "malloc0", 00:18:21.612 "nguid": "8980459607014C3AA122437B90F854AC", 00:18:21.612 "uuid": "89804596-0701-4c3a-a122-437b90f854ac" 00:18:21.612 } 00:18:21.612 } 00:18:21.612 }, 00:18:21.612 { 00:18:21.612 "method": "nvmf_subsystem_add_listener", 00:18:21.612 "params": { 00:18:21.612 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.612 "listen_address": { 00:18:21.612 "trtype": "TCP", 00:18:21.612 "adrfam": "IPv4", 00:18:21.612 "traddr": "10.0.0.2", 00:18:21.612 "trsvcid": "4420" 00:18:21.612 }, 00:18:21.612 "secure_channel": true 00:18:21.612 } 00:18:21.612 } 00:18:21.612 ] 00:18:21.612 } 00:18:21.612 ] 00:18:21.612 }' 00:18:21.612 08:26:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.612 08:26:07 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 08:26:07 -- nvmf/common.sh@469 -- # nvmfpid=982880 00:18:21.612 08:26:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:21.612 08:26:07 -- nvmf/common.sh@470 -- # waitforlisten 982880 00:18:21.612 08:26:07 -- common/autotest_common.sh@829 -- # '[' -z 982880 ']' 00:18:21.612 08:26:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.612 08:26:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.612 08:26:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.612 08:26:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.612 08:26:07 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 [2024-11-26 08:26:07.329562] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.612 [2024-11-26 08:26:07.329668] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:21.612 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.612 [2024-11-26 08:26:07.393342] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.873 [2024-11-26 08:26:07.500639] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:21.873 [2024-11-26 08:26:07.500854] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:21.873 [2024-11-26 08:26:07.500872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:21.873 [2024-11-26 08:26:07.500885] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:21.873 [2024-11-26 08:26:07.500919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:22.132 [2024-11-26 08:26:07.732369] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:22.132 [2024-11-26 08:26:07.764383] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:22.132 [2024-11-26 08:26:07.764683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:22.700 08:26:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.700 08:26:08 -- common/autotest_common.sh@862 -- # return 0 00:18:22.700 08:26:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:22.700 08:26:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:22.700 08:26:08 -- common/autotest_common.sh@10 -- # set +x 00:18:22.700 08:26:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:22.700 08:26:08 -- target/tls.sh@216 -- # bdevperf_pid=983035 00:18:22.700 08:26:08 -- target/tls.sh@217 -- # waitforlisten 983035 /var/tmp/bdevperf.sock 00:18:22.700 08:26:08 -- common/autotest_common.sh@829 -- # '[' -z 983035 ']' 00:18:22.700 08:26:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:22.700 08:26:08 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:22.700 08:26:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:22.700 08:26:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:22.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:22.700 08:26:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:22.700 08:26:08 -- target/tls.sh@213 -- # echo '{ 00:18:22.700 "subsystems": [ 00:18:22.700 { 00:18:22.700 "subsystem": "iobuf", 00:18:22.700 "config": [ 00:18:22.700 { 00:18:22.700 "method": "iobuf_set_options", 00:18:22.700 "params": { 00:18:22.700 "small_pool_count": 8192, 00:18:22.700 "large_pool_count": 1024, 00:18:22.700 "small_bufsize": 8192, 00:18:22.700 "large_bufsize": 135168 00:18:22.700 } 00:18:22.700 } 00:18:22.700 ] 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "subsystem": "sock", 00:18:22.700 "config": [ 00:18:22.700 { 00:18:22.700 "method": "sock_impl_set_options", 00:18:22.700 "params": { 00:18:22.700 "impl_name": "posix", 00:18:22.700 "recv_buf_size": 2097152, 00:18:22.700 "send_buf_size": 2097152, 00:18:22.700 "enable_recv_pipe": true, 00:18:22.700 "enable_quickack": false, 00:18:22.700 "enable_placement_id": 0, 00:18:22.700 "enable_zerocopy_send_server": true, 00:18:22.700 "enable_zerocopy_send_client": false, 00:18:22.700 "zerocopy_threshold": 0, 00:18:22.700 "tls_version": 0, 00:18:22.700 "enable_ktls": false 00:18:22.700 } 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "method": "sock_impl_set_options", 00:18:22.700 "params": { 00:18:22.700 "impl_name": "ssl", 00:18:22.700 "recv_buf_size": 4096, 00:18:22.700 "send_buf_size": 4096, 00:18:22.700 "enable_recv_pipe": true, 00:18:22.700 "enable_quickack": false, 00:18:22.700 "enable_placement_id": 0, 00:18:22.700 "enable_zerocopy_send_server": true, 00:18:22.700 "enable_zerocopy_send_client": false, 00:18:22.700 "zerocopy_threshold": 0, 00:18:22.700 "tls_version": 0, 00:18:22.700 "enable_ktls": false 00:18:22.700 } 00:18:22.700 } 00:18:22.700 ] 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "subsystem": "vmd", 00:18:22.700 "config": [] 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "subsystem": "accel", 00:18:22.700 "config": [ 00:18:22.700 { 00:18:22.700 "method": "accel_set_options", 00:18:22.700 "params": { 00:18:22.700 "small_cache_size": 128, 00:18:22.700 "large_cache_size": 16, 00:18:22.700 "task_count": 2048, 00:18:22.700 "sequence_count": 2048, 00:18:22.700 "buf_count": 2048 00:18:22.700 } 00:18:22.700 } 00:18:22.700 ] 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "subsystem": "bdev", 00:18:22.700 "config": [ 00:18:22.700 { 00:18:22.700 "method": "bdev_set_options", 00:18:22.700 "params": { 00:18:22.700 "bdev_io_pool_size": 65535, 00:18:22.700 "bdev_io_cache_size": 256, 00:18:22.700 "bdev_auto_examine": true, 00:18:22.700 "iobuf_small_cache_size": 128, 00:18:22.700 "iobuf_large_cache_size": 16 00:18:22.700 } 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "method": "bdev_raid_set_options", 00:18:22.700 "params": { 00:18:22.700 "process_window_size_kb": 1024 00:18:22.700 } 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "method": "bdev_iscsi_set_options", 00:18:22.700 "params": { 00:18:22.700 "timeout_sec": 30 00:18:22.700 } 00:18:22.700 }, 00:18:22.700 { 00:18:22.700 "method": "bdev_nvme_set_options", 00:18:22.700 "params": { 00:18:22.700 "action_on_timeout": "none", 00:18:22.700 "timeout_us": 0, 00:18:22.700 "timeout_admin_us": 0, 00:18:22.700 "keep_alive_timeout_ms": 10000, 00:18:22.700 "transport_retry_count": 4, 00:18:22.700 "arbitration_burst": 0, 00:18:22.700 "low_priority_weight": 0, 00:18:22.700 "medium_priority_weight": 0, 00:18:22.700 "high_priority_weight": 0, 00:18:22.700 "nvme_adminq_poll_period_us": 10000, 00:18:22.700 "nvme_ioq_poll_period_us": 0, 00:18:22.700 "io_queue_requests": 512, 00:18:22.700 "delay_cmd_submit": true, 00:18:22.700 "bdev_retry_count": 3, 00:18:22.700 "transport_ack_timeout": 0, 00:18:22.700 "ctrlr_loss_timeout_sec": 0, 00:18:22.700 "reconnect_delay_sec": 0, 00:18:22.700 "fast_io_fail_timeout_sec": 0, 00:18:22.701 "generate_uuids": false, 00:18:22.701 "transport_tos": 0, 00:18:22.701 "io_path_stat": false, 00:18:22.701 "allow_accel_sequence": false 00:18:22.701 } 00:18:22.701 }, 00:18:22.701 { 00:18:22.701 "method": "bdev_nvme_attach_controller", 00:18:22.701 "params": { 00:18:22.701 "name": "TLSTEST", 00:18:22.701 "trtype": "TCP", 00:18:22.701 "adrfam": "IPv4", 00:18:22.701 "traddr": "10.0.0.2", 00:18:22.701 "trsvcid": "4420", 00:18:22.701 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:22.701 "prchk_reftag": false, 00:18:22.701 "prchk_guard": false, 00:18:22.701 "ctrlr_loss_timeout_sec": 0, 00:18:22.701 "reconnect_delay_sec": 0, 00:18:22.701 "fast_io_fail_timeout_sec": 0, 00:18:22.701 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:22.701 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:22.701 "hdgst": false, 00:18:22.701 "ddgst": false 00:18:22.701 } 00:18:22.701 }, 00:18:22.701 { 00:18:22.701 "method": "bdev_nvme_set_hotplug", 00:18:22.701 "params": { 00:18:22.701 "period_us": 100000, 00:18:22.701 "enable": false 00:18:22.701 } 00:18:22.701 }, 00:18:22.701 { 00:18:22.701 "method": "bdev_wait_for_examine" 00:18:22.701 } 00:18:22.701 ] 00:18:22.701 }, 00:18:22.701 { 00:18:22.701 "subsystem": "nbd", 00:18:22.701 "config": [] 00:18:22.701 } 00:18:22.701 ] 00:18:22.701 }' 00:18:22.701 08:26:08 -- common/autotest_common.sh@10 -- # set +x 00:18:22.701 [2024-11-26 08:26:08.360377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:22.701 [2024-11-26 08:26:08.360453] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid983035 ] 00:18:22.701 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.701 [2024-11-26 08:26:08.419759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.701 [2024-11-26 08:26:08.525676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:22.961 [2024-11-26 08:26:08.686951] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:23.899 08:26:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.899 08:26:09 -- common/autotest_common.sh@862 -- # return 0 00:18:23.899 08:26:09 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:23.899 Running I/O for 10 seconds... 00:18:33.863 00:18:33.863 Latency(us) 00:18:33.863 [2024-11-26T07:26:19.723Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.863 [2024-11-26T07:26:19.723Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:33.863 Verification LBA range: start 0x0 length 0x2000 00:18:33.863 TLSTESTn1 : 10.01 4432.70 17.32 0.00 0.00 28841.01 4733.16 46409.20 00:18:33.863 [2024-11-26T07:26:19.723Z] =================================================================================================================== 00:18:33.863 [2024-11-26T07:26:19.723Z] Total : 4432.70 17.32 0.00 0.00 28841.01 4733.16 46409.20 00:18:33.863 0 00:18:33.863 08:26:19 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:33.863 08:26:19 -- target/tls.sh@223 -- # killprocess 983035 00:18:33.864 08:26:19 -- common/autotest_common.sh@936 -- # '[' -z 983035 ']' 00:18:33.864 08:26:19 -- common/autotest_common.sh@940 -- # kill -0 983035 00:18:33.864 08:26:19 -- common/autotest_common.sh@941 -- # uname 00:18:33.864 08:26:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:33.864 08:26:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 983035 00:18:33.864 08:26:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:33.864 08:26:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:33.864 08:26:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 983035' 00:18:33.864 killing process with pid 983035 00:18:33.864 08:26:19 -- common/autotest_common.sh@955 -- # kill 983035 00:18:33.864 Received shutdown signal, test time was about 10.000000 seconds 00:18:33.864 00:18:33.864 Latency(us) 00:18:33.864 [2024-11-26T07:26:19.724Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.864 [2024-11-26T07:26:19.724Z] =================================================================================================================== 00:18:33.864 [2024-11-26T07:26:19.724Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:33.864 08:26:19 -- common/autotest_common.sh@960 -- # wait 983035 00:18:34.122 08:26:19 -- target/tls.sh@224 -- # killprocess 982880 00:18:34.122 08:26:19 -- common/autotest_common.sh@936 -- # '[' -z 982880 ']' 00:18:34.122 08:26:19 -- common/autotest_common.sh@940 -- # kill -0 982880 00:18:34.122 08:26:19 -- common/autotest_common.sh@941 -- # uname 00:18:34.122 08:26:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:34.122 08:26:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 982880 00:18:34.122 08:26:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:34.122 08:26:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:34.122 08:26:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 982880' 00:18:34.122 killing process with pid 982880 00:18:34.122 08:26:19 -- common/autotest_common.sh@955 -- # kill 982880 00:18:34.122 08:26:19 -- common/autotest_common.sh@960 -- # wait 982880 00:18:34.381 08:26:20 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:34.381 08:26:20 -- target/tls.sh@227 -- # cleanup 00:18:34.381 08:26:20 -- target/tls.sh@15 -- # process_shm --id 0 00:18:34.381 08:26:20 -- common/autotest_common.sh@806 -- # type=--id 00:18:34.381 08:26:20 -- common/autotest_common.sh@807 -- # id=0 00:18:34.381 08:26:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:34.381 08:26:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:34.381 08:26:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:34.381 08:26:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:34.381 08:26:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:34.381 08:26:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:34.381 nvmf_trace.0 00:18:34.648 08:26:20 -- common/autotest_common.sh@821 -- # return 0 00:18:34.648 08:26:20 -- target/tls.sh@16 -- # killprocess 983035 00:18:34.648 08:26:20 -- common/autotest_common.sh@936 -- # '[' -z 983035 ']' 00:18:34.648 08:26:20 -- common/autotest_common.sh@940 -- # kill -0 983035 00:18:34.649 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (983035) - No such process 00:18:34.649 08:26:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 983035 is not found' 00:18:34.649 Process with pid 983035 is not found 00:18:34.649 08:26:20 -- target/tls.sh@17 -- # nvmftestfini 00:18:34.649 08:26:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:34.649 08:26:20 -- nvmf/common.sh@116 -- # sync 00:18:34.649 08:26:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:34.649 08:26:20 -- nvmf/common.sh@119 -- # set +e 00:18:34.649 08:26:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:34.649 08:26:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:34.649 rmmod nvme_tcp 00:18:34.649 rmmod nvme_fabrics 00:18:34.649 rmmod nvme_keyring 00:18:34.649 08:26:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:34.649 08:26:20 -- nvmf/common.sh@123 -- # set -e 00:18:34.649 08:26:20 -- nvmf/common.sh@124 -- # return 0 00:18:34.649 08:26:20 -- nvmf/common.sh@477 -- # '[' -n 982880 ']' 00:18:34.649 08:26:20 -- nvmf/common.sh@478 -- # killprocess 982880 00:18:34.649 08:26:20 -- common/autotest_common.sh@936 -- # '[' -z 982880 ']' 00:18:34.649 08:26:20 -- common/autotest_common.sh@940 -- # kill -0 982880 00:18:34.649 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (982880) - No such process 00:18:34.649 08:26:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 982880 is not found' 00:18:34.649 Process with pid 982880 is not found 00:18:34.649 08:26:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:34.649 08:26:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:34.649 08:26:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:34.649 08:26:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:34.649 08:26:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:34.649 08:26:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.650 08:26:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:34.650 08:26:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.559 08:26:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:36.559 08:26:22 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:36.559 00:18:36.559 real 1m16.030s 00:18:36.559 user 2m3.977s 00:18:36.559 sys 0m23.569s 00:18:36.559 08:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:36.559 08:26:22 -- common/autotest_common.sh@10 -- # set +x 00:18:36.559 ************************************ 00:18:36.559 END TEST nvmf_tls 00:18:36.559 ************************************ 00:18:36.559 08:26:22 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.559 08:26:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:36.559 08:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:36.559 08:26:22 -- common/autotest_common.sh@10 -- # set +x 00:18:36.559 ************************************ 00:18:36.559 START TEST nvmf_fips 00:18:36.559 ************************************ 00:18:36.559 08:26:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.559 * Looking for test storage... 00:18:36.818 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:36.818 08:26:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:36.818 08:26:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:36.818 08:26:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:36.818 08:26:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:36.818 08:26:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:36.818 08:26:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.818 08:26:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.818 08:26:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.818 08:26:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.818 08:26:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.818 08:26:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.818 08:26:22 -- scripts/common.sh@337 -- # local 'op=<' 00:18:36.818 08:26:22 -- scripts/common.sh@339 -- # ver1_l=2 00:18:36.818 08:26:22 -- scripts/common.sh@340 -- # ver2_l=1 00:18:36.818 08:26:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.818 08:26:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.818 08:26:22 -- scripts/common.sh@344 -- # : 1 00:18:36.818 08:26:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.818 08:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.818 08:26:22 -- scripts/common.sh@364 -- # decimal 1 00:18:36.818 08:26:22 -- scripts/common.sh@352 -- # local d=1 00:18:36.818 08:26:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.818 08:26:22 -- scripts/common.sh@354 -- # echo 1 00:18:36.818 08:26:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.818 08:26:22 -- scripts/common.sh@365 -- # decimal 2 00:18:36.818 08:26:22 -- scripts/common.sh@352 -- # local d=2 00:18:36.818 08:26:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:36.818 08:26:22 -- scripts/common.sh@354 -- # echo 2 00:18:36.818 08:26:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:36.818 08:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.818 08:26:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.818 08:26:22 -- scripts/common.sh@367 -- # return 0 00:18:36.818 08:26:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:36.818 08:26:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:36.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.818 --rc genhtml_branch_coverage=1 00:18:36.818 --rc genhtml_function_coverage=1 00:18:36.818 --rc genhtml_legend=1 00:18:36.818 --rc geninfo_all_blocks=1 00:18:36.818 --rc geninfo_unexecuted_blocks=1 00:18:36.818 00:18:36.818 ' 00:18:36.818 08:26:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:36.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.818 --rc genhtml_branch_coverage=1 00:18:36.818 --rc genhtml_function_coverage=1 00:18:36.818 --rc genhtml_legend=1 00:18:36.818 --rc geninfo_all_blocks=1 00:18:36.818 --rc geninfo_unexecuted_blocks=1 00:18:36.818 00:18:36.818 ' 00:18:36.818 08:26:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:36.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.818 --rc genhtml_branch_coverage=1 00:18:36.818 --rc genhtml_function_coverage=1 00:18:36.818 --rc genhtml_legend=1 00:18:36.818 --rc geninfo_all_blocks=1 00:18:36.818 --rc geninfo_unexecuted_blocks=1 00:18:36.818 00:18:36.818 ' 00:18:36.819 08:26:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:36.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.819 --rc genhtml_branch_coverage=1 00:18:36.819 --rc genhtml_function_coverage=1 00:18:36.819 --rc genhtml_legend=1 00:18:36.819 --rc geninfo_all_blocks=1 00:18:36.819 --rc geninfo_unexecuted_blocks=1 00:18:36.819 00:18:36.819 ' 00:18:36.819 08:26:22 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:36.819 08:26:22 -- nvmf/common.sh@7 -- # uname -s 00:18:36.819 08:26:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:36.819 08:26:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:36.819 08:26:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:36.819 08:26:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:36.819 08:26:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:36.819 08:26:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:36.819 08:26:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:36.819 08:26:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:36.819 08:26:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:36.819 08:26:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:36.819 08:26:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.819 08:26:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.819 08:26:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:36.819 08:26:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:36.819 08:26:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:36.819 08:26:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:36.819 08:26:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:36.819 08:26:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:36.819 08:26:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:36.819 08:26:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.819 08:26:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.819 08:26:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.819 08:26:22 -- paths/export.sh@5 -- # export PATH 00:18:36.819 08:26:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.819 08:26:22 -- nvmf/common.sh@46 -- # : 0 00:18:36.819 08:26:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:36.819 08:26:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:36.819 08:26:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:36.819 08:26:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:36.819 08:26:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:36.819 08:26:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:36.819 08:26:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:36.819 08:26:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:36.819 08:26:22 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:36.819 08:26:22 -- fips/fips.sh@89 -- # check_openssl_version 00:18:36.819 08:26:22 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:36.819 08:26:22 -- fips/fips.sh@85 -- # openssl version 00:18:36.819 08:26:22 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:36.819 08:26:22 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:36.819 08:26:22 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:36.819 08:26:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.819 08:26:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.819 08:26:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.819 08:26:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.819 08:26:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.819 08:26:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.819 08:26:22 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:36.819 08:26:22 -- scripts/common.sh@339 -- # ver1_l=3 00:18:36.819 08:26:22 -- scripts/common.sh@340 -- # ver2_l=3 00:18:36.819 08:26:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.819 08:26:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.819 08:26:22 -- scripts/common.sh@347 -- # : 1 00:18:36.819 08:26:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.819 08:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.819 08:26:22 -- scripts/common.sh@364 -- # decimal 3 00:18:36.819 08:26:22 -- scripts/common.sh@352 -- # local d=3 00:18:36.819 08:26:22 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.819 08:26:22 -- scripts/common.sh@354 -- # echo 3 00:18:36.819 08:26:22 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:36.819 08:26:22 -- scripts/common.sh@365 -- # decimal 3 00:18:36.819 08:26:22 -- scripts/common.sh@352 -- # local d=3 00:18:36.819 08:26:22 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.819 08:26:22 -- scripts/common.sh@354 -- # echo 3 00:18:36.819 08:26:22 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:36.819 08:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.819 08:26:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.819 08:26:22 -- scripts/common.sh@363 -- # (( v++ )) 00:18:36.819 08:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.819 08:26:22 -- scripts/common.sh@364 -- # decimal 1 00:18:36.819 08:26:22 -- scripts/common.sh@352 -- # local d=1 00:18:36.819 08:26:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.819 08:26:22 -- scripts/common.sh@354 -- # echo 1 00:18:36.819 08:26:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.819 08:26:22 -- scripts/common.sh@365 -- # decimal 0 00:18:36.819 08:26:22 -- scripts/common.sh@352 -- # local d=0 00:18:36.819 08:26:22 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:36.819 08:26:22 -- scripts/common.sh@354 -- # echo 0 00:18:36.819 08:26:22 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:36.819 08:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.819 08:26:22 -- scripts/common.sh@366 -- # return 0 00:18:36.819 08:26:22 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:36.819 08:26:22 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:36.819 08:26:22 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:36.819 08:26:22 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:36.819 08:26:22 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:36.819 08:26:22 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:36.819 08:26:22 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:36.819 08:26:22 -- fips/fips.sh@113 -- # build_openssl_config 00:18:36.819 08:26:22 -- fips/fips.sh@37 -- # cat 00:18:36.819 08:26:22 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:36.819 08:26:22 -- fips/fips.sh@58 -- # cat - 00:18:36.819 08:26:22 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:36.819 08:26:22 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:36.819 08:26:22 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:36.820 08:26:22 -- fips/fips.sh@116 -- # openssl list -providers 00:18:36.820 08:26:22 -- fips/fips.sh@116 -- # grep name 00:18:36.820 08:26:22 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:36.820 08:26:22 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:36.820 08:26:22 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:36.820 08:26:22 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:36.820 08:26:22 -- fips/fips.sh@127 -- # : 00:18:36.820 08:26:22 -- common/autotest_common.sh@650 -- # local es=0 00:18:36.820 08:26:22 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:36.820 08:26:22 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:36.820 08:26:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.820 08:26:22 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:36.820 08:26:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.820 08:26:22 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:36.820 08:26:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.820 08:26:22 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:36.820 08:26:22 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:36.820 08:26:22 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:36.820 Error setting digest 00:18:36.820 4092360E3C7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:36.820 4092360E3C7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:36.820 08:26:22 -- common/autotest_common.sh@653 -- # es=1 00:18:36.820 08:26:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:36.820 08:26:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:36.820 08:26:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:36.820 08:26:22 -- fips/fips.sh@130 -- # nvmftestinit 00:18:36.820 08:26:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:36.820 08:26:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:36.820 08:26:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:36.820 08:26:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:36.820 08:26:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:36.820 08:26:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.820 08:26:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.820 08:26:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.820 08:26:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:36.820 08:26:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:36.820 08:26:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:36.820 08:26:22 -- common/autotest_common.sh@10 -- # set +x 00:18:39.391 08:26:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:39.391 08:26:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:39.391 08:26:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:39.391 08:26:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:39.391 08:26:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:39.391 08:26:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:39.391 08:26:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:39.391 08:26:24 -- nvmf/common.sh@294 -- # net_devs=() 00:18:39.391 08:26:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:39.391 08:26:24 -- nvmf/common.sh@295 -- # e810=() 00:18:39.391 08:26:24 -- nvmf/common.sh@295 -- # local -ga e810 00:18:39.391 08:26:24 -- nvmf/common.sh@296 -- # x722=() 00:18:39.391 08:26:24 -- nvmf/common.sh@296 -- # local -ga x722 00:18:39.391 08:26:24 -- nvmf/common.sh@297 -- # mlx=() 00:18:39.391 08:26:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:39.391 08:26:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:39.391 08:26:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:39.391 08:26:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:39.391 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:39.391 08:26:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:39.391 08:26:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:39.391 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:39.391 08:26:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:39.391 08:26:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.391 08:26:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.391 08:26:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:39.391 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:39.391 08:26:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:39.391 08:26:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.391 08:26:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.391 08:26:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:39.391 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:39.391 08:26:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:39.391 08:26:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:39.391 08:26:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:39.391 08:26:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:39.391 08:26:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:39.391 08:26:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:39.391 08:26:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:39.391 08:26:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:39.391 08:26:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:39.391 08:26:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:39.391 08:26:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:39.391 08:26:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:39.391 08:26:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:39.391 08:26:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:39.391 08:26:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:39.391 08:26:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:39.391 08:26:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:39.391 08:26:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:39.391 08:26:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:39.391 08:26:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:39.391 08:26:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:39.391 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:39.391 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:18:39.391 00:18:39.391 --- 10.0.0.2 ping statistics --- 00:18:39.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:39.391 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:18:39.391 08:26:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:39.391 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:39.391 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:18:39.391 00:18:39.391 --- 10.0.0.1 ping statistics --- 00:18:39.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:39.391 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:18:39.391 08:26:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:39.391 08:26:24 -- nvmf/common.sh@410 -- # return 0 00:18:39.391 08:26:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:39.391 08:26:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:39.391 08:26:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:39.391 08:26:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:39.391 08:26:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:39.391 08:26:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:39.391 08:26:24 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:39.391 08:26:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:39.391 08:26:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:39.391 08:26:24 -- common/autotest_common.sh@10 -- # set +x 00:18:39.391 08:26:24 -- nvmf/common.sh@469 -- # nvmfpid=986378 00:18:39.391 08:26:24 -- nvmf/common.sh@470 -- # waitforlisten 986378 00:18:39.391 08:26:24 -- common/autotest_common.sh@829 -- # '[' -z 986378 ']' 00:18:39.391 08:26:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:39.391 08:26:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:39.391 08:26:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:39.391 08:26:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:39.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:39.392 08:26:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:39.392 08:26:24 -- common/autotest_common.sh@10 -- # set +x 00:18:39.392 [2024-11-26 08:26:24.966759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:39.392 [2024-11-26 08:26:24.966834] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:39.392 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.392 [2024-11-26 08:26:25.035843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.392 [2024-11-26 08:26:25.151704] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:39.392 [2024-11-26 08:26:25.151880] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:39.392 [2024-11-26 08:26:25.151899] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:39.392 [2024-11-26 08:26:25.151912] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:39.392 [2024-11-26 08:26:25.151940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:40.333 08:26:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.333 08:26:25 -- common/autotest_common.sh@862 -- # return 0 00:18:40.333 08:26:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:40.333 08:26:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:40.333 08:26:25 -- common/autotest_common.sh@10 -- # set +x 00:18:40.333 08:26:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:40.333 08:26:25 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:40.333 08:26:25 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:40.333 08:26:25 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.333 08:26:25 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:40.333 08:26:25 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.333 08:26:25 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.333 08:26:25 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.333 08:26:25 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.333 [2024-11-26 08:26:26.164005] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:40.333 [2024-11-26 08:26:26.179967] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:40.333 [2024-11-26 08:26:26.180251] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:40.591 malloc0 00:18:40.591 08:26:26 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:40.591 08:26:26 -- fips/fips.sh@147 -- # bdevperf_pid=986545 00:18:40.591 08:26:26 -- fips/fips.sh@148 -- # waitforlisten 986545 /var/tmp/bdevperf.sock 00:18:40.591 08:26:26 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:40.591 08:26:26 -- common/autotest_common.sh@829 -- # '[' -z 986545 ']' 00:18:40.591 08:26:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:40.591 08:26:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:40.591 08:26:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:40.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:40.591 08:26:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:40.591 08:26:26 -- common/autotest_common.sh@10 -- # set +x 00:18:40.591 [2024-11-26 08:26:26.296267] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:40.591 [2024-11-26 08:26:26.296345] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid986545 ] 00:18:40.591 EAL: No free 2048 kB hugepages reported on node 1 00:18:40.591 [2024-11-26 08:26:26.355059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:40.849 [2024-11-26 08:26:26.460489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:41.418 08:26:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:41.418 08:26:27 -- common/autotest_common.sh@862 -- # return 0 00:18:41.418 08:26:27 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:41.985 [2024-11-26 08:26:27.532225] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:41.985 TLSTESTn1 00:18:41.985 08:26:27 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:41.985 Running I/O for 10 seconds... 00:18:51.973 00:18:51.973 Latency(us) 00:18:51.973 [2024-11-26T07:26:37.833Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.973 [2024-11-26T07:26:37.833Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:51.973 Verification LBA range: start 0x0 length 0x2000 00:18:51.973 TLSTESTn1 : 10.03 2815.28 11.00 0.00 0.00 45374.63 11893.57 55147.33 00:18:51.973 [2024-11-26T07:26:37.833Z] =================================================================================================================== 00:18:51.973 [2024-11-26T07:26:37.833Z] Total : 2815.28 11.00 0.00 0.00 45374.63 11893.57 55147.33 00:18:51.973 0 00:18:51.973 08:26:37 -- fips/fips.sh@1 -- # cleanup 00:18:51.973 08:26:37 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:51.973 08:26:37 -- common/autotest_common.sh@806 -- # type=--id 00:18:51.973 08:26:37 -- common/autotest_common.sh@807 -- # id=0 00:18:51.973 08:26:37 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:51.973 08:26:37 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:51.973 08:26:37 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:51.973 08:26:37 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:51.973 08:26:37 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:51.973 08:26:37 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:51.973 nvmf_trace.0 00:18:52.234 08:26:37 -- common/autotest_common.sh@821 -- # return 0 00:18:52.234 08:26:37 -- fips/fips.sh@16 -- # killprocess 986545 00:18:52.234 08:26:37 -- common/autotest_common.sh@936 -- # '[' -z 986545 ']' 00:18:52.234 08:26:37 -- common/autotest_common.sh@940 -- # kill -0 986545 00:18:52.234 08:26:37 -- common/autotest_common.sh@941 -- # uname 00:18:52.234 08:26:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.234 08:26:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 986545 00:18:52.234 08:26:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:52.234 08:26:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:52.234 08:26:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 986545' 00:18:52.234 killing process with pid 986545 00:18:52.234 08:26:37 -- common/autotest_common.sh@955 -- # kill 986545 00:18:52.234 Received shutdown signal, test time was about 10.000000 seconds 00:18:52.234 00:18:52.234 Latency(us) 00:18:52.234 [2024-11-26T07:26:38.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:52.234 [2024-11-26T07:26:38.094Z] =================================================================================================================== 00:18:52.234 [2024-11-26T07:26:38.094Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:52.234 08:26:37 -- common/autotest_common.sh@960 -- # wait 986545 00:18:52.493 08:26:38 -- fips/fips.sh@17 -- # nvmftestfini 00:18:52.493 08:26:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:52.493 08:26:38 -- nvmf/common.sh@116 -- # sync 00:18:52.493 08:26:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:52.493 08:26:38 -- nvmf/common.sh@119 -- # set +e 00:18:52.493 08:26:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:52.493 08:26:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:52.493 rmmod nvme_tcp 00:18:52.493 rmmod nvme_fabrics 00:18:52.493 rmmod nvme_keyring 00:18:52.493 08:26:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:52.493 08:26:38 -- nvmf/common.sh@123 -- # set -e 00:18:52.493 08:26:38 -- nvmf/common.sh@124 -- # return 0 00:18:52.493 08:26:38 -- nvmf/common.sh@477 -- # '[' -n 986378 ']' 00:18:52.493 08:26:38 -- nvmf/common.sh@478 -- # killprocess 986378 00:18:52.493 08:26:38 -- common/autotest_common.sh@936 -- # '[' -z 986378 ']' 00:18:52.493 08:26:38 -- common/autotest_common.sh@940 -- # kill -0 986378 00:18:52.493 08:26:38 -- common/autotest_common.sh@941 -- # uname 00:18:52.493 08:26:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.493 08:26:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 986378 00:18:52.493 08:26:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:52.493 08:26:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:52.493 08:26:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 986378' 00:18:52.493 killing process with pid 986378 00:18:52.493 08:26:38 -- common/autotest_common.sh@955 -- # kill 986378 00:18:52.493 08:26:38 -- common/autotest_common.sh@960 -- # wait 986378 00:18:52.751 08:26:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:52.751 08:26:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:52.751 08:26:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:52.751 08:26:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:52.751 08:26:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:52.751 08:26:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.751 08:26:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.751 08:26:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.287 08:26:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.287 08:26:40 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:55.287 00:18:55.287 real 0m18.194s 00:18:55.287 user 0m18.387s 00:18:55.287 sys 0m7.436s 00:18:55.287 08:26:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:55.287 08:26:40 -- common/autotest_common.sh@10 -- # set +x 00:18:55.287 ************************************ 00:18:55.287 END TEST nvmf_fips 00:18:55.287 ************************************ 00:18:55.287 08:26:40 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:55.287 08:26:40 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:55.287 08:26:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:55.287 08:26:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:55.287 08:26:40 -- common/autotest_common.sh@10 -- # set +x 00:18:55.287 ************************************ 00:18:55.287 START TEST nvmf_fuzz 00:18:55.287 ************************************ 00:18:55.287 08:26:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:55.287 * Looking for test storage... 00:18:55.287 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:55.287 08:26:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:55.287 08:26:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:55.287 08:26:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:55.287 08:26:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:55.287 08:26:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:55.287 08:26:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:55.287 08:26:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:55.287 08:26:40 -- scripts/common.sh@335 -- # IFS=.-: 00:18:55.287 08:26:40 -- scripts/common.sh@335 -- # read -ra ver1 00:18:55.287 08:26:40 -- scripts/common.sh@336 -- # IFS=.-: 00:18:55.287 08:26:40 -- scripts/common.sh@336 -- # read -ra ver2 00:18:55.287 08:26:40 -- scripts/common.sh@337 -- # local 'op=<' 00:18:55.287 08:26:40 -- scripts/common.sh@339 -- # ver1_l=2 00:18:55.288 08:26:40 -- scripts/common.sh@340 -- # ver2_l=1 00:18:55.288 08:26:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:55.288 08:26:40 -- scripts/common.sh@343 -- # case "$op" in 00:18:55.288 08:26:40 -- scripts/common.sh@344 -- # : 1 00:18:55.288 08:26:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:55.288 08:26:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:55.288 08:26:40 -- scripts/common.sh@364 -- # decimal 1 00:18:55.288 08:26:40 -- scripts/common.sh@352 -- # local d=1 00:18:55.288 08:26:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:55.288 08:26:40 -- scripts/common.sh@354 -- # echo 1 00:18:55.288 08:26:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:55.288 08:26:40 -- scripts/common.sh@365 -- # decimal 2 00:18:55.288 08:26:40 -- scripts/common.sh@352 -- # local d=2 00:18:55.288 08:26:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:55.288 08:26:40 -- scripts/common.sh@354 -- # echo 2 00:18:55.288 08:26:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:55.288 08:26:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:55.288 08:26:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:55.288 08:26:40 -- scripts/common.sh@367 -- # return 0 00:18:55.288 08:26:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:55.288 08:26:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:55.288 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.288 --rc genhtml_branch_coverage=1 00:18:55.288 --rc genhtml_function_coverage=1 00:18:55.288 --rc genhtml_legend=1 00:18:55.288 --rc geninfo_all_blocks=1 00:18:55.288 --rc geninfo_unexecuted_blocks=1 00:18:55.288 00:18:55.288 ' 00:18:55.288 08:26:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:55.288 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.288 --rc genhtml_branch_coverage=1 00:18:55.288 --rc genhtml_function_coverage=1 00:18:55.288 --rc genhtml_legend=1 00:18:55.288 --rc geninfo_all_blocks=1 00:18:55.288 --rc geninfo_unexecuted_blocks=1 00:18:55.288 00:18:55.288 ' 00:18:55.288 08:26:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:55.288 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.288 --rc genhtml_branch_coverage=1 00:18:55.288 --rc genhtml_function_coverage=1 00:18:55.288 --rc genhtml_legend=1 00:18:55.288 --rc geninfo_all_blocks=1 00:18:55.288 --rc geninfo_unexecuted_blocks=1 00:18:55.288 00:18:55.288 ' 00:18:55.288 08:26:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:55.288 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.288 --rc genhtml_branch_coverage=1 00:18:55.288 --rc genhtml_function_coverage=1 00:18:55.288 --rc genhtml_legend=1 00:18:55.288 --rc geninfo_all_blocks=1 00:18:55.288 --rc geninfo_unexecuted_blocks=1 00:18:55.288 00:18:55.288 ' 00:18:55.288 08:26:40 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:55.288 08:26:40 -- nvmf/common.sh@7 -- # uname -s 00:18:55.288 08:26:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:55.288 08:26:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:55.288 08:26:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:55.288 08:26:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:55.288 08:26:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:55.288 08:26:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:55.288 08:26:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:55.288 08:26:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:55.288 08:26:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:55.288 08:26:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:55.288 08:26:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.288 08:26:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.288 08:26:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:55.288 08:26:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:55.288 08:26:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:55.288 08:26:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:55.288 08:26:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:55.288 08:26:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:55.288 08:26:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:55.288 08:26:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.288 08:26:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.288 08:26:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.288 08:26:40 -- paths/export.sh@5 -- # export PATH 00:18:55.288 08:26:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.288 08:26:40 -- nvmf/common.sh@46 -- # : 0 00:18:55.288 08:26:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:55.288 08:26:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:55.288 08:26:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:55.288 08:26:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:55.288 08:26:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:55.288 08:26:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:55.288 08:26:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:55.288 08:26:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:55.288 08:26:40 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:55.288 08:26:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:55.288 08:26:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:55.288 08:26:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:55.288 08:26:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:55.288 08:26:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:55.288 08:26:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.288 08:26:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.288 08:26:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.288 08:26:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:55.288 08:26:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:55.288 08:26:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:55.288 08:26:40 -- common/autotest_common.sh@10 -- # set +x 00:18:57.194 08:26:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.194 08:26:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:57.194 08:26:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:57.194 08:26:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:57.194 08:26:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:57.194 08:26:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:57.194 08:26:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:57.194 08:26:42 -- nvmf/common.sh@294 -- # net_devs=() 00:18:57.194 08:26:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:57.194 08:26:42 -- nvmf/common.sh@295 -- # e810=() 00:18:57.194 08:26:42 -- nvmf/common.sh@295 -- # local -ga e810 00:18:57.194 08:26:42 -- nvmf/common.sh@296 -- # x722=() 00:18:57.194 08:26:42 -- nvmf/common.sh@296 -- # local -ga x722 00:18:57.194 08:26:42 -- nvmf/common.sh@297 -- # mlx=() 00:18:57.194 08:26:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:57.194 08:26:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.195 08:26:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.195 08:26:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:57.195 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:57.195 08:26:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.195 08:26:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:57.195 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:57.195 08:26:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.195 08:26:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.195 08:26:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.195 08:26:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:57.195 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:57.195 08:26:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.195 08:26:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.195 08:26:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.195 08:26:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:57.195 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:57.195 08:26:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:57.195 08:26:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:57.195 08:26:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:57.195 08:26:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:57.195 08:26:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:57.195 08:26:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:57.195 08:26:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:57.195 08:26:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:57.195 08:26:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:57.195 08:26:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:57.195 08:26:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:57.195 08:26:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:57.195 08:26:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:57.195 08:26:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:57.195 08:26:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:57.195 08:26:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:57.195 08:26:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:57.195 08:26:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:57.195 08:26:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:57.195 08:26:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:57.195 08:26:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:57.195 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:57.195 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:18:57.195 00:18:57.195 --- 10.0.0.2 ping statistics --- 00:18:57.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.195 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:18:57.195 08:26:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:57.195 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:57.195 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:18:57.195 00:18:57.195 --- 10.0.0.1 ping statistics --- 00:18:57.195 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.195 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:18:57.195 08:26:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:57.195 08:26:42 -- nvmf/common.sh@410 -- # return 0 00:18:57.195 08:26:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:57.195 08:26:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:57.195 08:26:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:57.195 08:26:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:57.195 08:26:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:57.195 08:26:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:57.195 08:26:42 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=989981 00:18:57.195 08:26:42 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:57.195 08:26:42 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 989981 00:18:57.195 08:26:42 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:57.195 08:26:42 -- common/autotest_common.sh@829 -- # '[' -z 989981 ']' 00:18:57.195 08:26:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:57.195 08:26:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:57.195 08:26:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:57.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:57.195 08:26:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:57.195 08:26:42 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 08:26:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:58.576 08:26:44 -- common/autotest_common.sh@862 -- # return 0 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:58.576 08:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.576 08:26:44 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 08:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:58.576 08:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.576 08:26:44 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 Malloc0 00:18:58.576 08:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:58.576 08:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.576 08:26:44 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 08:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:58.576 08:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.576 08:26:44 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 08:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:58.576 08:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.576 08:26:44 -- common/autotest_common.sh@10 -- # set +x 00:18:58.576 08:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:58.576 08:26:44 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:30.693 Fuzzing completed. Shutting down the fuzz application 00:19:30.693 00:19:30.693 Dumping successful admin opcodes: 00:19:30.693 8, 9, 10, 24, 00:19:30.693 Dumping successful io opcodes: 00:19:30.693 0, 9, 00:19:30.693 NS: 0x200003aeff00 I/O qp, Total commands completed: 483370, total successful commands: 2788, random_seed: 3471616192 00:19:30.693 NS: 0x200003aeff00 admin qp, Total commands completed: 58336, total successful commands: 464, random_seed: 3419718720 00:19:30.693 08:27:14 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:30.693 Fuzzing completed. Shutting down the fuzz application 00:19:30.693 00:19:30.693 Dumping successful admin opcodes: 00:19:30.693 24, 00:19:30.693 Dumping successful io opcodes: 00:19:30.693 00:19:30.693 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1800334161 00:19:30.693 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1800479697 00:19:30.693 08:27:16 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:30.693 08:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:30.693 08:27:16 -- common/autotest_common.sh@10 -- # set +x 00:19:30.693 08:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:30.693 08:27:16 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:30.693 08:27:16 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:30.693 08:27:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:30.693 08:27:16 -- nvmf/common.sh@116 -- # sync 00:19:30.693 08:27:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:30.693 08:27:16 -- nvmf/common.sh@119 -- # set +e 00:19:30.693 08:27:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:30.693 08:27:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:30.693 rmmod nvme_tcp 00:19:30.693 rmmod nvme_fabrics 00:19:30.693 rmmod nvme_keyring 00:19:30.693 08:27:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:30.693 08:27:16 -- nvmf/common.sh@123 -- # set -e 00:19:30.693 08:27:16 -- nvmf/common.sh@124 -- # return 0 00:19:30.693 08:27:16 -- nvmf/common.sh@477 -- # '[' -n 989981 ']' 00:19:30.693 08:27:16 -- nvmf/common.sh@478 -- # killprocess 989981 00:19:30.693 08:27:16 -- common/autotest_common.sh@936 -- # '[' -z 989981 ']' 00:19:30.693 08:27:16 -- common/autotest_common.sh@940 -- # kill -0 989981 00:19:30.693 08:27:16 -- common/autotest_common.sh@941 -- # uname 00:19:30.693 08:27:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:30.693 08:27:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 989981 00:19:30.693 08:27:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:30.693 08:27:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:30.693 08:27:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 989981' 00:19:30.693 killing process with pid 989981 00:19:30.693 08:27:16 -- common/autotest_common.sh@955 -- # kill 989981 00:19:30.693 08:27:16 -- common/autotest_common.sh@960 -- # wait 989981 00:19:30.951 08:27:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:30.951 08:27:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:30.951 08:27:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:30.951 08:27:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:30.951 08:27:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:30.951 08:27:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.951 08:27:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.951 08:27:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.856 08:27:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.856 08:27:18 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:32.856 00:19:32.856 real 0m38.063s 00:19:32.856 user 0m53.155s 00:19:32.856 sys 0m14.536s 00:19:32.856 08:27:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.856 08:27:18 -- common/autotest_common.sh@10 -- # set +x 00:19:32.856 ************************************ 00:19:32.856 END TEST nvmf_fuzz 00:19:32.856 ************************************ 00:19:32.856 08:27:18 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.856 08:27:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.856 08:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.856 08:27:18 -- common/autotest_common.sh@10 -- # set +x 00:19:32.856 ************************************ 00:19:32.856 START TEST nvmf_multiconnection 00:19:32.856 ************************************ 00:19:32.856 08:27:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:33.116 * Looking for test storage... 00:19:33.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:33.116 08:27:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:33.116 08:27:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:33.116 08:27:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:33.116 08:27:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:33.116 08:27:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:33.116 08:27:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:33.116 08:27:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:33.116 08:27:18 -- scripts/common.sh@335 -- # IFS=.-: 00:19:33.116 08:27:18 -- scripts/common.sh@335 -- # read -ra ver1 00:19:33.116 08:27:18 -- scripts/common.sh@336 -- # IFS=.-: 00:19:33.116 08:27:18 -- scripts/common.sh@336 -- # read -ra ver2 00:19:33.116 08:27:18 -- scripts/common.sh@337 -- # local 'op=<' 00:19:33.116 08:27:18 -- scripts/common.sh@339 -- # ver1_l=2 00:19:33.116 08:27:18 -- scripts/common.sh@340 -- # ver2_l=1 00:19:33.116 08:27:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:33.116 08:27:18 -- scripts/common.sh@343 -- # case "$op" in 00:19:33.116 08:27:18 -- scripts/common.sh@344 -- # : 1 00:19:33.116 08:27:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:33.116 08:27:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:33.116 08:27:18 -- scripts/common.sh@364 -- # decimal 1 00:19:33.116 08:27:18 -- scripts/common.sh@352 -- # local d=1 00:19:33.116 08:27:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:33.116 08:27:18 -- scripts/common.sh@354 -- # echo 1 00:19:33.116 08:27:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:33.116 08:27:18 -- scripts/common.sh@365 -- # decimal 2 00:19:33.116 08:27:18 -- scripts/common.sh@352 -- # local d=2 00:19:33.116 08:27:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:33.116 08:27:18 -- scripts/common.sh@354 -- # echo 2 00:19:33.116 08:27:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:33.116 08:27:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:33.116 08:27:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:33.116 08:27:18 -- scripts/common.sh@367 -- # return 0 00:19:33.116 08:27:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:33.116 08:27:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:33.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:33.116 --rc genhtml_branch_coverage=1 00:19:33.116 --rc genhtml_function_coverage=1 00:19:33.116 --rc genhtml_legend=1 00:19:33.116 --rc geninfo_all_blocks=1 00:19:33.116 --rc geninfo_unexecuted_blocks=1 00:19:33.116 00:19:33.116 ' 00:19:33.116 08:27:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:33.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:33.116 --rc genhtml_branch_coverage=1 00:19:33.116 --rc genhtml_function_coverage=1 00:19:33.116 --rc genhtml_legend=1 00:19:33.116 --rc geninfo_all_blocks=1 00:19:33.116 --rc geninfo_unexecuted_blocks=1 00:19:33.116 00:19:33.116 ' 00:19:33.116 08:27:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:33.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:33.116 --rc genhtml_branch_coverage=1 00:19:33.116 --rc genhtml_function_coverage=1 00:19:33.116 --rc genhtml_legend=1 00:19:33.116 --rc geninfo_all_blocks=1 00:19:33.116 --rc geninfo_unexecuted_blocks=1 00:19:33.116 00:19:33.116 ' 00:19:33.116 08:27:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:33.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:33.116 --rc genhtml_branch_coverage=1 00:19:33.116 --rc genhtml_function_coverage=1 00:19:33.116 --rc genhtml_legend=1 00:19:33.116 --rc geninfo_all_blocks=1 00:19:33.116 --rc geninfo_unexecuted_blocks=1 00:19:33.116 00:19:33.116 ' 00:19:33.116 08:27:18 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:33.116 08:27:18 -- nvmf/common.sh@7 -- # uname -s 00:19:33.116 08:27:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:33.116 08:27:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:33.116 08:27:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:33.116 08:27:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:33.117 08:27:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:33.117 08:27:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:33.117 08:27:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:33.117 08:27:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:33.117 08:27:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:33.117 08:27:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:33.117 08:27:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:33.117 08:27:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:33.117 08:27:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:33.117 08:27:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:33.117 08:27:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:33.117 08:27:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:33.117 08:27:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:33.117 08:27:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:33.117 08:27:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:33.117 08:27:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:33.117 08:27:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:33.117 08:27:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:33.117 08:27:18 -- paths/export.sh@5 -- # export PATH 00:19:33.117 08:27:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:33.117 08:27:18 -- nvmf/common.sh@46 -- # : 0 00:19:33.117 08:27:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:33.117 08:27:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:33.117 08:27:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:33.117 08:27:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:33.117 08:27:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:33.117 08:27:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:33.117 08:27:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:33.117 08:27:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:33.117 08:27:18 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:33.117 08:27:18 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:33.117 08:27:18 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:33.117 08:27:18 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:33.117 08:27:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:33.117 08:27:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:33.117 08:27:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:33.117 08:27:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:33.117 08:27:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:33.117 08:27:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:33.117 08:27:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:33.117 08:27:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:33.117 08:27:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:33.117 08:27:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:33.117 08:27:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:33.117 08:27:18 -- common/autotest_common.sh@10 -- # set +x 00:19:35.025 08:27:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:35.025 08:27:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:35.025 08:27:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:35.025 08:27:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:35.025 08:27:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:35.025 08:27:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:35.025 08:27:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:35.025 08:27:20 -- nvmf/common.sh@294 -- # net_devs=() 00:19:35.025 08:27:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:35.025 08:27:20 -- nvmf/common.sh@295 -- # e810=() 00:19:35.025 08:27:20 -- nvmf/common.sh@295 -- # local -ga e810 00:19:35.025 08:27:20 -- nvmf/common.sh@296 -- # x722=() 00:19:35.025 08:27:20 -- nvmf/common.sh@296 -- # local -ga x722 00:19:35.025 08:27:20 -- nvmf/common.sh@297 -- # mlx=() 00:19:35.025 08:27:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:35.025 08:27:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:35.025 08:27:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:35.025 08:27:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:35.025 08:27:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:35.025 08:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:35.025 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:35.025 08:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:35.025 08:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:35.025 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:35.025 08:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:35.025 08:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:35.025 08:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:35.025 08:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:35.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:35.025 08:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:35.025 08:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:35.025 08:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:35.025 08:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:35.025 08:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:35.025 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:35.025 08:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:35.025 08:27:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:35.025 08:27:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:35.025 08:27:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:35.025 08:27:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:35.025 08:27:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:35.025 08:27:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:35.025 08:27:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:35.025 08:27:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:35.025 08:27:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:35.025 08:27:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:35.025 08:27:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:35.025 08:27:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:35.025 08:27:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:35.026 08:27:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:35.026 08:27:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:35.026 08:27:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:35.026 08:27:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:35.026 08:27:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:35.026 08:27:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:35.026 08:27:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:35.286 08:27:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:35.286 08:27:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:35.286 08:27:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:35.286 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:35.286 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:19:35.286 00:19:35.286 --- 10.0.0.2 ping statistics --- 00:19:35.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.286 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:19:35.286 08:27:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:35.286 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:35.286 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:19:35.286 00:19:35.286 --- 10.0.0.1 ping statistics --- 00:19:35.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.286 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:19:35.286 08:27:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:35.286 08:27:20 -- nvmf/common.sh@410 -- # return 0 00:19:35.286 08:27:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:35.286 08:27:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:35.286 08:27:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:35.286 08:27:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:35.286 08:27:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:35.286 08:27:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:35.286 08:27:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:35.286 08:27:20 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:35.286 08:27:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:35.286 08:27:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:35.286 08:27:20 -- common/autotest_common.sh@10 -- # set +x 00:19:35.286 08:27:20 -- nvmf/common.sh@469 -- # nvmfpid=996604 00:19:35.286 08:27:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:35.286 08:27:20 -- nvmf/common.sh@470 -- # waitforlisten 996604 00:19:35.286 08:27:20 -- common/autotest_common.sh@829 -- # '[' -z 996604 ']' 00:19:35.286 08:27:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:35.286 08:27:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:35.286 08:27:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:35.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:35.286 08:27:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:35.286 08:27:20 -- common/autotest_common.sh@10 -- # set +x 00:19:35.286 [2024-11-26 08:27:21.000638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:35.286 [2024-11-26 08:27:21.000757] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:35.286 EAL: No free 2048 kB hugepages reported on node 1 00:19:35.286 [2024-11-26 08:27:21.065467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:35.545 [2024-11-26 08:27:21.176809] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:35.545 [2024-11-26 08:27:21.176965] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:35.545 [2024-11-26 08:27:21.176982] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:35.545 [2024-11-26 08:27:21.176994] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:35.545 [2024-11-26 08:27:21.177046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:35.545 [2024-11-26 08:27:21.177107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:35.545 [2024-11-26 08:27:21.177172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:35.545 [2024-11-26 08:27:21.177175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:36.481 08:27:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:36.481 08:27:21 -- common/autotest_common.sh@862 -- # return 0 00:19:36.481 08:27:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:36.481 08:27:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:36.481 08:27:21 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:36.481 08:27:22 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 [2024-11-26 08:27:22.023339] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:36.481 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.481 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 Malloc1 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 [2024-11-26 08:27:22.079732] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.481 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 Malloc2 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.481 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 Malloc3 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:36.481 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.481 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.481 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.481 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.481 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 Malloc4 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.482 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 Malloc5 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.482 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 Malloc6 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.482 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.482 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.482 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:36.482 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.482 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 Malloc7 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.741 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 Malloc8 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.741 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 Malloc9 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.741 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 Malloc10 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.741 08:27:22 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 Malloc11 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:36.741 08:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.741 08:27:22 -- common/autotest_common.sh@10 -- # set +x 00:19:36.741 08:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.741 08:27:22 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:36.741 08:27:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.741 08:27:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:37.677 08:27:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:37.677 08:27:23 -- common/autotest_common.sh@1187 -- # local i=0 00:19:37.677 08:27:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:37.677 08:27:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:37.677 08:27:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.589 08:27:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.589 08:27:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.589 08:27:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:39.589 08:27:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.589 08:27:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.589 08:27:25 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.589 08:27:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.589 08:27:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:40.528 08:27:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:40.528 08:27:26 -- common/autotest_common.sh@1187 -- # local i=0 00:19:40.528 08:27:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:40.528 08:27:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:40.528 08:27:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:42.433 08:27:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:42.433 08:27:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:42.433 08:27:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:42.433 08:27:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:42.433 08:27:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.433 08:27:28 -- common/autotest_common.sh@1197 -- # return 0 00:19:42.433 08:27:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.433 08:27:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:43.003 08:27:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:43.003 08:27:28 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.003 08:27:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.003 08:27:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.003 08:27:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:44.919 08:27:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:44.919 08:27:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:44.919 08:27:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:44.919 08:27:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:44.919 08:27:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:44.919 08:27:30 -- common/autotest_common.sh@1197 -- # return 0 00:19:44.919 08:27:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:44.919 08:27:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:45.856 08:27:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:45.856 08:27:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:45.856 08:27:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:45.856 08:27:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:45.856 08:27:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:47.823 08:27:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:47.823 08:27:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:47.823 08:27:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:47.823 08:27:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:47.823 08:27:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:47.823 08:27:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:47.823 08:27:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:47.823 08:27:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:48.392 08:27:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:48.392 08:27:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.392 08:27:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.392 08:27:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.392 08:27:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:50.925 08:27:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:50.925 08:27:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:50.925 08:27:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:50.925 08:27:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:50.925 08:27:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:50.925 08:27:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:50.925 08:27:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:50.925 08:27:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:51.184 08:27:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:51.184 08:27:36 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.184 08:27:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.184 08:27:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.185 08:27:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.719 08:27:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.719 08:27:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.719 08:27:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:53.719 08:27:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.719 08:27:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.719 08:27:38 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.719 08:27:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.719 08:27:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:53.979 08:27:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:53.979 08:27:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:53.979 08:27:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:53.979 08:27:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:53.979 08:27:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:55.886 08:27:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:55.886 08:27:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:55.886 08:27:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:55.886 08:27:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:55.886 08:27:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:55.886 08:27:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:55.886 08:27:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:55.886 08:27:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:56.822 08:27:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:56.822 08:27:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:56.822 08:27:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:56.822 08:27:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:56.822 08:27:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:58.730 08:27:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:58.730 08:27:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:58.730 08:27:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:58.730 08:27:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:58.730 08:27:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.730 08:27:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:58.730 08:27:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.730 08:27:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:59.700 08:27:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:59.700 08:27:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:59.700 08:27:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:59.700 08:27:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:59.700 08:27:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:01.607 08:27:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:01.607 08:27:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:01.607 08:27:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:20:01.607 08:27:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:01.607 08:27:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:01.607 08:27:47 -- common/autotest_common.sh@1197 -- # return 0 00:20:01.607 08:27:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:01.607 08:27:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:02.545 08:27:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:02.545 08:27:48 -- common/autotest_common.sh@1187 -- # local i=0 00:20:02.545 08:27:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:02.545 08:27:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:02.545 08:27:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:04.445 08:27:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:04.445 08:27:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:04.445 08:27:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:04.445 08:27:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:04.445 08:27:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:04.445 08:27:50 -- common/autotest_common.sh@1197 -- # return 0 00:20:04.445 08:27:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:04.446 08:27:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:05.379 08:27:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:05.379 08:27:51 -- common/autotest_common.sh@1187 -- # local i=0 00:20:05.379 08:27:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:05.379 08:27:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:05.379 08:27:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:07.913 08:27:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:07.913 08:27:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:07.913 08:27:53 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:07.913 08:27:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:07.913 08:27:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:07.913 08:27:53 -- common/autotest_common.sh@1197 -- # return 0 00:20:07.913 08:27:53 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:07.913 [global] 00:20:07.913 thread=1 00:20:07.913 invalidate=1 00:20:07.913 rw=read 00:20:07.913 time_based=1 00:20:07.913 runtime=10 00:20:07.913 ioengine=libaio 00:20:07.913 direct=1 00:20:07.913 bs=262144 00:20:07.913 iodepth=64 00:20:07.913 norandommap=1 00:20:07.913 numjobs=1 00:20:07.913 00:20:07.913 [job0] 00:20:07.913 filename=/dev/nvme0n1 00:20:07.913 [job1] 00:20:07.913 filename=/dev/nvme10n1 00:20:07.913 [job2] 00:20:07.913 filename=/dev/nvme1n1 00:20:07.913 [job3] 00:20:07.913 filename=/dev/nvme2n1 00:20:07.913 [job4] 00:20:07.913 filename=/dev/nvme3n1 00:20:07.913 [job5] 00:20:07.913 filename=/dev/nvme4n1 00:20:07.913 [job6] 00:20:07.913 filename=/dev/nvme5n1 00:20:07.913 [job7] 00:20:07.913 filename=/dev/nvme6n1 00:20:07.913 [job8] 00:20:07.913 filename=/dev/nvme7n1 00:20:07.913 [job9] 00:20:07.913 filename=/dev/nvme8n1 00:20:07.913 [job10] 00:20:07.913 filename=/dev/nvme9n1 00:20:07.913 Could not set queue depth (nvme0n1) 00:20:07.913 Could not set queue depth (nvme10n1) 00:20:07.913 Could not set queue depth (nvme1n1) 00:20:07.913 Could not set queue depth (nvme2n1) 00:20:07.913 Could not set queue depth (nvme3n1) 00:20:07.913 Could not set queue depth (nvme4n1) 00:20:07.913 Could not set queue depth (nvme5n1) 00:20:07.913 Could not set queue depth (nvme6n1) 00:20:07.913 Could not set queue depth (nvme7n1) 00:20:07.913 Could not set queue depth (nvme8n1) 00:20:07.913 Could not set queue depth (nvme9n1) 00:20:07.913 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.913 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.914 fio-3.35 00:20:07.914 Starting 11 threads 00:20:20.125 00:20:20.125 job0: (groupid=0, jobs=1): err= 0: pid=1001066: Tue Nov 26 08:28:03 2024 00:20:20.125 read: IOPS=846, BW=212MiB/s (222MB/s)(2140MiB/10115msec) 00:20:20.125 slat (usec): min=9, max=105454, avg=1005.80, stdev=4244.73 00:20:20.125 clat (usec): min=1216, max=453398, avg=74554.39, stdev=59428.57 00:20:20.125 lat (usec): min=1243, max=453466, avg=75560.19, stdev=60181.13 00:20:20.125 clat percentiles (msec): 00:20:20.125 | 1.00th=[ 9], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 31], 00:20:20.125 | 30.00th=[ 36], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 74], 00:20:20.125 | 70.00th=[ 85], 80.00th=[ 96], 90.00th=[ 146], 95.00th=[ 199], 00:20:20.125 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 401], 99.95th=[ 409], 00:20:20.125 | 99.99th=[ 456] 00:20:20.125 bw ( KiB/s): min=46592, max=543232, per=11.54%, avg=217534.65, stdev=132921.88, samples=20 00:20:20.125 iops : min= 182, max= 2122, avg=849.70, stdev=519.25, samples=20 00:20:20.125 lat (msec) : 2=0.05%, 4=0.20%, 10=0.96%, 20=2.46%, 50=37.16% 00:20:20.125 lat (msec) : 100=41.28%, 250=15.79%, 500=2.10% 00:20:20.125 cpu : usr=0.48%, sys=2.67%, ctx=1526, majf=0, minf=4097 00:20:20.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:20.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.125 issued rwts: total=8561,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.125 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.125 job1: (groupid=0, jobs=1): err= 0: pid=1001093: Tue Nov 26 08:28:03 2024 00:20:20.125 read: IOPS=543, BW=136MiB/s (142MB/s)(1363MiB/10033msec) 00:20:20.125 slat (usec): min=9, max=116570, avg=1166.73, stdev=5896.45 00:20:20.125 clat (usec): min=812, max=410655, avg=116506.27, stdev=70774.27 00:20:20.125 lat (usec): min=845, max=472544, avg=117673.00, stdev=71865.45 00:20:20.125 clat percentiles (msec): 00:20:20.125 | 1.00th=[ 6], 5.00th=[ 21], 10.00th=[ 30], 20.00th=[ 51], 00:20:20.125 | 30.00th=[ 71], 40.00th=[ 92], 50.00th=[ 112], 60.00th=[ 131], 00:20:20.125 | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 199], 95.00th=[ 220], 00:20:20.125 | 99.00th=[ 355], 99.50th=[ 372], 99.90th=[ 405], 99.95th=[ 409], 00:20:20.125 | 99.99th=[ 409] 00:20:20.125 bw ( KiB/s): min=43520, max=250880, per=7.32%, avg=137956.80, stdev=50432.93, samples=20 00:20:20.125 iops : min= 170, max= 980, avg=538.85, stdev=197.00, samples=20 00:20:20.125 lat (usec) : 1000=0.04% 00:20:20.125 lat (msec) : 2=0.09%, 4=0.07%, 10=1.85%, 20=2.82%, 50=14.85% 00:20:20.125 lat (msec) : 100=24.30%, 250=52.50%, 500=3.47% 00:20:20.125 cpu : usr=0.18%, sys=1.41%, ctx=1280, majf=0, minf=4097 00:20:20.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:20.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.125 issued rwts: total=5453,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.125 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.125 job2: (groupid=0, jobs=1): err= 0: pid=1001122: Tue Nov 26 08:28:03 2024 00:20:20.125 read: IOPS=458, BW=115MiB/s (120MB/s)(1161MiB/10120msec) 00:20:20.125 slat (usec): min=9, max=104050, avg=1994.80, stdev=6483.63 00:20:20.125 clat (msec): min=4, max=401, avg=137.36, stdev=61.62 00:20:20.125 lat (msec): min=5, max=470, avg=139.35, stdev=62.53 00:20:20.125 clat percentiles (msec): 00:20:20.125 | 1.00th=[ 17], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 85], 00:20:20.125 | 30.00th=[ 101], 40.00th=[ 115], 50.00th=[ 130], 60.00th=[ 146], 00:20:20.125 | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 207], 95.00th=[ 234], 00:20:20.125 | 99.00th=[ 363], 99.50th=[ 376], 99.90th=[ 388], 99.95th=[ 393], 00:20:20.125 | 99.99th=[ 401] 00:20:20.125 bw ( KiB/s): min=57856, max=217600, per=6.22%, avg=117253.30, stdev=40428.44, samples=20 00:20:20.125 iops : min= 226, max= 850, avg=458.00, stdev=157.94, samples=20 00:20:20.125 lat (msec) : 10=0.15%, 20=1.18%, 50=0.84%, 100=27.61%, 250=66.11% 00:20:20.125 lat (msec) : 500=4.11% 00:20:20.125 cpu : usr=0.30%, sys=1.62%, ctx=945, majf=0, minf=4097 00:20:20.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:20:20.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.125 issued rwts: total=4644,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.125 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.125 job3: (groupid=0, jobs=1): err= 0: pid=1001123: Tue Nov 26 08:28:03 2024 00:20:20.125 read: IOPS=542, BW=136MiB/s (142MB/s)(1372MiB/10117msec) 00:20:20.125 slat (usec): min=9, max=94515, avg=1243.33, stdev=5475.29 00:20:20.125 clat (msec): min=2, max=425, avg=116.64, stdev=66.76 00:20:20.125 lat (msec): min=2, max=484, avg=117.88, stdev=67.83 00:20:20.125 clat percentiles (msec): 00:20:20.125 | 1.00th=[ 7], 5.00th=[ 26], 10.00th=[ 42], 20.00th=[ 66], 00:20:20.125 | 30.00th=[ 82], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 121], 00:20:20.125 | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 230], 00:20:20.125 | 99.00th=[ 355], 99.50th=[ 368], 99.90th=[ 393], 99.95th=[ 397], 00:20:20.125 | 99.99th=[ 426] 00:20:20.125 bw ( KiB/s): min=41984, max=237568, per=7.37%, avg=138851.85, stdev=54605.81, samples=20 00:20:20.125 iops : min= 164, max= 928, avg=542.35, stdev=213.30, samples=20 00:20:20.125 lat (msec) : 4=0.35%, 10=1.18%, 20=2.64%, 50=8.38%, 100=32.98% 00:20:20.125 lat (msec) : 250=50.79%, 500=3.68% 00:20:20.125 cpu : usr=0.40%, sys=1.78%, ctx=1202, majf=0, minf=4097 00:20:20.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:20.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.125 issued rwts: total=5489,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.125 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.125 job4: (groupid=0, jobs=1): err= 0: pid=1001124: Tue Nov 26 08:28:03 2024 00:20:20.125 read: IOPS=670, BW=168MiB/s (176MB/s)(1696MiB/10119msec) 00:20:20.125 slat (usec): min=9, max=103004, avg=1116.52, stdev=4770.37 00:20:20.125 clat (usec): min=964, max=388033, avg=94269.87, stdev=66136.33 00:20:20.125 lat (usec): min=983, max=388084, avg=95386.38, stdev=66984.42 00:20:20.125 clat percentiles (msec): 00:20:20.125 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 28], 20.00th=[ 34], 00:20:20.125 | 30.00th=[ 39], 40.00th=[ 60], 50.00th=[ 85], 60.00th=[ 103], 00:20:20.125 | 70.00th=[ 123], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 209], 00:20:20.126 | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 388], 00:20:20.126 | 99.99th=[ 388] 00:20:20.126 bw ( KiB/s): min=64000, max=389120, per=9.13%, avg=172037.20, stdev=98079.61, samples=20 00:20:20.126 iops : min= 250, max= 1520, avg=671.95, stdev=383.17, samples=20 00:20:20.126 lat (usec) : 1000=0.01% 00:20:20.126 lat (msec) : 2=0.18%, 4=1.03%, 10=1.59%, 20=2.59%, 50=30.87% 00:20:20.126 lat (msec) : 100=22.23%, 250=40.08%, 500=1.42% 00:20:20.126 cpu : usr=0.43%, sys=2.34%, ctx=1368, majf=0, minf=4098 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=6784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job5: (groupid=0, jobs=1): err= 0: pid=1001137: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=553, BW=138MiB/s (145MB/s)(1391MiB/10045msec) 00:20:20.126 slat (usec): min=10, max=122492, avg=1650.28, stdev=5727.31 00:20:20.126 clat (usec): min=1607, max=465311, avg=113819.10, stdev=70866.90 00:20:20.126 lat (usec): min=1641, max=465361, avg=115469.38, stdev=71985.33 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 5], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 48], 00:20:20.126 | 30.00th=[ 71], 40.00th=[ 86], 50.00th=[ 106], 60.00th=[ 127], 00:20:20.126 | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 197], 95.00th=[ 218], 00:20:20.126 | 99.00th=[ 359], 99.50th=[ 376], 99.90th=[ 405], 99.95th=[ 443], 00:20:20.126 | 99.99th=[ 464] 00:20:20.126 bw ( KiB/s): min=57856, max=354304, per=7.47%, avg=140793.25, stdev=72042.44, samples=20 00:20:20.126 iops : min= 226, max= 1384, avg=549.95, stdev=281.43, samples=20 00:20:20.126 lat (msec) : 2=0.04%, 4=0.83%, 10=1.42%, 20=1.78%, 50=16.50% 00:20:20.126 lat (msec) : 100=27.46%, 250=48.80%, 500=3.18% 00:20:20.126 cpu : usr=0.50%, sys=1.78%, ctx=1129, majf=0, minf=4097 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=5564,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job6: (groupid=0, jobs=1): err= 0: pid=1001138: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=854, BW=214MiB/s (224MB/s)(2140MiB/10016msec) 00:20:20.126 slat (usec): min=11, max=236858, avg=1008.53, stdev=5617.00 00:20:20.126 clat (usec): min=1877, max=519623, avg=73818.66, stdev=60423.10 00:20:20.126 lat (usec): min=1901, max=573482, avg=74827.19, stdev=61372.46 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 26], 20.00th=[ 35], 00:20:20.126 | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 64], 00:20:20.126 | 70.00th=[ 72], 80.00th=[ 97], 90.00th=[ 155], 95.00th=[ 197], 00:20:20.126 | 99.00th=[ 326], 99.50th=[ 388], 99.90th=[ 414], 99.95th=[ 422], 00:20:20.126 | 99.99th=[ 518] 00:20:20.126 bw ( KiB/s): min=50176, max=384000, per=11.54%, avg=217511.60, stdev=88547.79, samples=20 00:20:20.126 iops : min= 196, max= 1500, avg=849.60, stdev=345.88, samples=20 00:20:20.126 lat (msec) : 2=0.01%, 4=0.39%, 10=1.76%, 20=4.58%, 50=34.54% 00:20:20.126 lat (msec) : 100=39.39%, 250=17.10%, 500=2.21%, 750=0.02% 00:20:20.126 cpu : usr=0.54%, sys=2.96%, ctx=1539, majf=0, minf=4097 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=8561,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job7: (groupid=0, jobs=1): err= 0: pid=1001139: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=869, BW=217MiB/s (228MB/s)(2180MiB/10034msec) 00:20:20.126 slat (usec): min=10, max=73071, avg=899.50, stdev=3143.99 00:20:20.126 clat (usec): min=1418, max=212840, avg=72685.51, stdev=40318.52 00:20:20.126 lat (usec): min=1469, max=250967, avg=73585.01, stdev=40720.55 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 5], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 37], 00:20:20.126 | 30.00th=[ 50], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 74], 00:20:20.126 | 70.00th=[ 83], 80.00th=[ 94], 90.00th=[ 136], 95.00th=[ 161], 00:20:20.126 | 99.00th=[ 190], 99.50th=[ 192], 99.90th=[ 209], 99.95th=[ 209], 00:20:20.126 | 99.99th=[ 213] 00:20:20.126 bw ( KiB/s): min=101376, max=393216, per=11.75%, avg=221589.40, stdev=93355.05, samples=20 00:20:20.126 iops : min= 396, max= 1536, avg=865.55, stdev=364.64, samples=20 00:20:20.126 lat (msec) : 2=0.07%, 4=0.76%, 10=0.70%, 20=0.76%, 50=28.46% 00:20:20.126 lat (msec) : 100=51.66%, 250=17.60% 00:20:20.126 cpu : usr=0.51%, sys=3.02%, ctx=1702, majf=0, minf=4097 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=8721,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job8: (groupid=0, jobs=1): err= 0: pid=1001144: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=692, BW=173MiB/s (182MB/s)(1753MiB/10121msec) 00:20:20.126 slat (usec): min=9, max=200388, avg=1286.90, stdev=4982.15 00:20:20.126 clat (usec): min=1791, max=360665, avg=90997.79, stdev=53660.51 00:20:20.126 lat (usec): min=1827, max=360684, avg=92284.68, stdev=54474.80 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 6], 5.00th=[ 23], 10.00th=[ 30], 20.00th=[ 36], 00:20:20.126 | 30.00th=[ 55], 40.00th=[ 75], 50.00th=[ 89], 60.00th=[ 101], 00:20:20.126 | 70.00th=[ 114], 80.00th=[ 131], 90.00th=[ 163], 95.00th=[ 190], 00:20:20.126 | 99.00th=[ 245], 99.50th=[ 266], 99.90th=[ 296], 99.95th=[ 296], 00:20:20.126 | 99.99th=[ 359] 00:20:20.126 bw ( KiB/s): min=76800, max=455680, per=9.44%, avg=177901.30, stdev=89739.47, samples=20 00:20:20.126 iops : min= 300, max= 1780, avg=694.90, stdev=350.57, samples=20 00:20:20.126 lat (msec) : 2=0.03%, 4=0.29%, 10=1.87%, 20=2.28%, 50=24.30% 00:20:20.126 lat (msec) : 100=31.43%, 250=39.06%, 500=0.76% 00:20:20.126 cpu : usr=0.61%, sys=2.28%, ctx=1283, majf=0, minf=4097 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=7013,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job9: (groupid=0, jobs=1): err= 0: pid=1001145: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=702, BW=176MiB/s (184MB/s)(1764MiB/10042msec) 00:20:20.126 slat (usec): min=9, max=288080, avg=1091.05, stdev=5796.19 00:20:20.126 clat (msec): min=2, max=429, avg=89.94, stdev=65.53 00:20:20.126 lat (msec): min=2, max=633, avg=91.03, stdev=66.25 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 37], 00:20:20.126 | 30.00th=[ 53], 40.00th=[ 67], 50.00th=[ 78], 60.00th=[ 86], 00:20:20.126 | 70.00th=[ 96], 80.00th=[ 122], 90.00th=[ 178], 95.00th=[ 213], 00:20:20.126 | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 418], 99.95th=[ 422], 00:20:20.126 | 99.99th=[ 430] 00:20:20.126 bw ( KiB/s): min=50688, max=460288, per=9.49%, avg=178992.45, stdev=90440.80, samples=20 00:20:20.126 iops : min= 198, max= 1798, avg=699.15, stdev=353.29, samples=20 00:20:20.126 lat (msec) : 4=0.07%, 10=0.84%, 20=1.76%, 50=26.23%, 100=43.71% 00:20:20.126 lat (msec) : 250=23.88%, 500=3.51% 00:20:20.126 cpu : usr=0.41%, sys=2.23%, ctx=1396, majf=0, minf=3723 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=7056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 job10: (groupid=0, jobs=1): err= 0: pid=1001146: Tue Nov 26 08:28:03 2024 00:20:20.126 read: IOPS=661, BW=165MiB/s (173MB/s)(1672MiB/10116msec) 00:20:20.126 slat (usec): min=9, max=129251, avg=917.22, stdev=4711.43 00:20:20.126 clat (usec): min=1800, max=484378, avg=95824.43, stdev=60430.31 00:20:20.126 lat (usec): min=1848, max=484406, avg=96741.65, stdev=61131.29 00:20:20.126 clat percentiles (msec): 00:20:20.126 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 31], 20.00th=[ 53], 00:20:20.126 | 30.00th=[ 67], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 95], 00:20:20.126 | 70.00th=[ 107], 80.00th=[ 125], 90.00th=[ 184], 95.00th=[ 211], 00:20:20.126 | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 405], 99.95th=[ 418], 00:20:20.126 | 99.99th=[ 485] 00:20:20.126 bw ( KiB/s): min=64512, max=231936, per=8.99%, avg=169544.80, stdev=45965.08, samples=20 00:20:20.126 iops : min= 252, max= 906, avg=662.25, stdev=179.56, samples=20 00:20:20.126 lat (msec) : 2=0.04%, 4=0.36%, 10=1.93%, 20=2.74%, 50=13.73% 00:20:20.126 lat (msec) : 100=46.63%, 250=32.39%, 500=2.18% 00:20:20.126 cpu : usr=0.34%, sys=2.36%, ctx=1424, majf=0, minf=4097 00:20:20.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:20.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.126 issued rwts: total=6687,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.126 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.126 00:20:20.126 Run status group 0 (all jobs): 00:20:20.126 READ: bw=1841MiB/s (1930MB/s), 115MiB/s-217MiB/s (120MB/s-228MB/s), io=18.2GiB (19.5GB), run=10016-10121msec 00:20:20.126 00:20:20.126 Disk stats (read/write): 00:20:20.126 nvme0n1: ios=16956/0, merge=0/0, ticks=1233026/0, in_queue=1233026, util=97.22% 00:20:20.126 nvme10n1: ios=10634/0, merge=0/0, ticks=1243661/0, in_queue=1243661, util=97.45% 00:20:20.126 nvme1n1: ios=9118/0, merge=0/0, ticks=1228880/0, in_queue=1228880, util=97.73% 00:20:20.126 nvme2n1: ios=10800/0, merge=0/0, ticks=1236131/0, in_queue=1236131, util=97.86% 00:20:20.126 nvme3n1: ios=13413/0, merge=0/0, ticks=1236722/0, in_queue=1236722, util=97.94% 00:20:20.126 nvme4n1: ios=10898/0, merge=0/0, ticks=1233189/0, in_queue=1233189, util=98.26% 00:20:20.126 nvme5n1: ios=16805/0, merge=0/0, ticks=1238478/0, in_queue=1238478, util=98.42% 00:20:20.127 nvme6n1: ios=17153/0, merge=0/0, ticks=1240337/0, in_queue=1240337, util=98.54% 00:20:20.127 nvme7n1: ios=13810/0, merge=0/0, ticks=1228662/0, in_queue=1228662, util=98.95% 00:20:20.127 nvme8n1: ios=13900/0, merge=0/0, ticks=1243261/0, in_queue=1243261, util=99.13% 00:20:20.127 nvme9n1: ios=13239/0, merge=0/0, ticks=1240633/0, in_queue=1240633, util=99.25% 00:20:20.127 08:28:03 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:20.127 [global] 00:20:20.127 thread=1 00:20:20.127 invalidate=1 00:20:20.127 rw=randwrite 00:20:20.127 time_based=1 00:20:20.127 runtime=10 00:20:20.127 ioengine=libaio 00:20:20.127 direct=1 00:20:20.127 bs=262144 00:20:20.127 iodepth=64 00:20:20.127 norandommap=1 00:20:20.127 numjobs=1 00:20:20.127 00:20:20.127 [job0] 00:20:20.127 filename=/dev/nvme0n1 00:20:20.127 [job1] 00:20:20.127 filename=/dev/nvme10n1 00:20:20.127 [job2] 00:20:20.127 filename=/dev/nvme1n1 00:20:20.127 [job3] 00:20:20.127 filename=/dev/nvme2n1 00:20:20.127 [job4] 00:20:20.127 filename=/dev/nvme3n1 00:20:20.127 [job5] 00:20:20.127 filename=/dev/nvme4n1 00:20:20.127 [job6] 00:20:20.127 filename=/dev/nvme5n1 00:20:20.127 [job7] 00:20:20.127 filename=/dev/nvme6n1 00:20:20.127 [job8] 00:20:20.127 filename=/dev/nvme7n1 00:20:20.127 [job9] 00:20:20.127 filename=/dev/nvme8n1 00:20:20.127 [job10] 00:20:20.127 filename=/dev/nvme9n1 00:20:20.127 Could not set queue depth (nvme0n1) 00:20:20.127 Could not set queue depth (nvme10n1) 00:20:20.127 Could not set queue depth (nvme1n1) 00:20:20.127 Could not set queue depth (nvme2n1) 00:20:20.127 Could not set queue depth (nvme3n1) 00:20:20.127 Could not set queue depth (nvme4n1) 00:20:20.127 Could not set queue depth (nvme5n1) 00:20:20.127 Could not set queue depth (nvme6n1) 00:20:20.127 Could not set queue depth (nvme7n1) 00:20:20.127 Could not set queue depth (nvme8n1) 00:20:20.127 Could not set queue depth (nvme9n1) 00:20:20.127 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.127 fio-3.35 00:20:20.127 Starting 11 threads 00:20:30.106 00:20:30.106 job0: (groupid=0, jobs=1): err= 0: pid=1002338: Tue Nov 26 08:28:14 2024 00:20:30.106 write: IOPS=654, BW=164MiB/s (172MB/s)(1656MiB/10124msec); 0 zone resets 00:20:30.106 slat (usec): min=18, max=58611, avg=1023.95, stdev=2816.96 00:20:30.106 clat (msec): min=2, max=325, avg=96.75, stdev=57.63 00:20:30.106 lat (msec): min=2, max=325, avg=97.78, stdev=58.21 00:20:30.106 clat percentiles (msec): 00:20:30.106 | 1.00th=[ 9], 5.00th=[ 28], 10.00th=[ 41], 20.00th=[ 45], 00:20:30.106 | 30.00th=[ 51], 40.00th=[ 72], 50.00th=[ 88], 60.00th=[ 103], 00:20:30.106 | 70.00th=[ 118], 80.00th=[ 138], 90.00th=[ 180], 95.00th=[ 211], 00:20:30.106 | 99.00th=[ 259], 99.50th=[ 279], 99.90th=[ 313], 99.95th=[ 313], 00:20:30.106 | 99.99th=[ 326] 00:20:30.106 bw ( KiB/s): min=69632, max=311296, per=11.32%, avg=167976.60, stdev=69959.19, samples=20 00:20:30.107 iops : min= 272, max= 1216, avg=656.10, stdev=273.29, samples=20 00:20:30.107 lat (msec) : 4=0.17%, 10=1.18%, 20=2.04%, 50=26.24%, 100=28.61% 00:20:30.107 lat (msec) : 250=40.05%, 500=1.72% 00:20:30.107 cpu : usr=2.16%, sys=2.51%, ctx=3263, majf=0, minf=2 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,6624,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job1: (groupid=0, jobs=1): err= 0: pid=1002350: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=540, BW=135MiB/s (142MB/s)(1367MiB/10121msec); 0 zone resets 00:20:30.107 slat (usec): min=20, max=115713, avg=1216.97, stdev=3947.80 00:20:30.107 clat (msec): min=2, max=331, avg=117.19, stdev=65.84 00:20:30.107 lat (msec): min=2, max=331, avg=118.40, stdev=66.54 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 9], 5.00th=[ 23], 10.00th=[ 39], 20.00th=[ 54], 00:20:30.107 | 30.00th=[ 74], 40.00th=[ 92], 50.00th=[ 110], 60.00th=[ 127], 00:20:30.107 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 207], 95.00th=[ 226], 00:20:30.107 | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 330], 00:20:30.107 | 99.99th=[ 334] 00:20:30.107 bw ( KiB/s): min=55296, max=259072, per=9.33%, avg=138344.60, stdev=51705.35, samples=20 00:20:30.107 iops : min= 216, max= 1012, avg=540.40, stdev=201.96, samples=20 00:20:30.107 lat (msec) : 4=0.16%, 10=1.12%, 20=2.80%, 50=13.17%, 100=27.91% 00:20:30.107 lat (msec) : 250=51.34%, 500=3.51% 00:20:30.107 cpu : usr=1.95%, sys=2.03%, ctx=3107, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,5468,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job2: (groupid=0, jobs=1): err= 0: pid=1002351: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=541, BW=135MiB/s (142MB/s)(1368MiB/10098msec); 0 zone resets 00:20:30.107 slat (usec): min=20, max=124129, avg=1288.02, stdev=3867.40 00:20:30.107 clat (msec): min=3, max=302, avg=116.75, stdev=57.84 00:20:30.107 lat (msec): min=3, max=303, avg=118.04, stdev=58.54 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 16], 5.00th=[ 37], 10.00th=[ 46], 20.00th=[ 52], 00:20:30.107 | 30.00th=[ 77], 40.00th=[ 97], 50.00th=[ 116], 60.00th=[ 136], 00:20:30.107 | 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 194], 95.00th=[ 215], 00:20:30.107 | 99.00th=[ 251], 99.50th=[ 266], 99.90th=[ 296], 99.95th=[ 305], 00:20:30.107 | 99.99th=[ 305] 00:20:30.107 bw ( KiB/s): min=77824, max=248832, per=9.34%, avg=138470.30, stdev=51081.63, samples=20 00:20:30.107 iops : min= 304, max= 972, avg=540.85, stdev=199.59, samples=20 00:20:30.107 lat (msec) : 4=0.02%, 10=0.33%, 20=1.28%, 50=17.54%, 100=23.79% 00:20:30.107 lat (msec) : 250=56.01%, 500=1.02% 00:20:30.107 cpu : usr=1.95%, sys=1.94%, ctx=2751, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,5472,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job3: (groupid=0, jobs=1): err= 0: pid=1002352: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=462, BW=116MiB/s (121MB/s)(1170MiB/10117msec); 0 zone resets 00:20:30.107 slat (usec): min=17, max=130187, avg=1489.14, stdev=4564.28 00:20:30.107 clat (msec): min=3, max=348, avg=136.82, stdev=63.37 00:20:30.107 lat (msec): min=4, max=363, avg=138.31, stdev=64.27 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 16], 5.00th=[ 36], 10.00th=[ 53], 20.00th=[ 79], 00:20:30.107 | 30.00th=[ 99], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 153], 00:20:30.107 | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 226], 95.00th=[ 245], 00:20:30.107 | 99.00th=[ 268], 99.50th=[ 279], 99.90th=[ 288], 99.95th=[ 321], 00:20:30.107 | 99.99th=[ 351] 00:20:30.107 bw ( KiB/s): min=67584, max=198259, per=7.97%, avg=118165.35, stdev=39487.26, samples=20 00:20:30.107 iops : min= 264, max= 774, avg=461.55, stdev=154.19, samples=20 00:20:30.107 lat (msec) : 4=0.02%, 10=0.34%, 20=1.47%, 50=7.33%, 100=22.01% 00:20:30.107 lat (msec) : 250=65.14%, 500=3.68% 00:20:30.107 cpu : usr=1.55%, sys=1.76%, ctx=2661, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,4679,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job4: (groupid=0, jobs=1): err= 0: pid=1002354: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=407, BW=102MiB/s (107MB/s)(1034MiB/10157msec); 0 zone resets 00:20:30.107 slat (usec): min=23, max=86352, avg=2128.15, stdev=4741.71 00:20:30.107 clat (msec): min=11, max=321, avg=154.91, stdev=59.54 00:20:30.107 lat (msec): min=11, max=322, avg=157.04, stdev=60.33 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 31], 5.00th=[ 47], 10.00th=[ 60], 20.00th=[ 103], 00:20:30.107 | 30.00th=[ 131], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 171], 00:20:30.107 | 70.00th=[ 188], 80.00th=[ 203], 90.00th=[ 230], 95.00th=[ 247], 00:20:30.107 | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 313], 99.95th=[ 321], 00:20:30.107 | 99.99th=[ 321] 00:20:30.107 bw ( KiB/s): min=67584, max=231984, per=7.03%, avg=104249.10, stdev=36385.35, samples=20 00:20:30.107 iops : min= 264, max= 906, avg=407.20, stdev=142.10, samples=20 00:20:30.107 lat (msec) : 20=0.34%, 50=6.36%, 100=12.79%, 250=75.95%, 500=4.57% 00:20:30.107 cpu : usr=1.47%, sys=1.49%, ctx=1520, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,4137,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job5: (groupid=0, jobs=1): err= 0: pid=1002360: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=493, BW=123MiB/s (129MB/s)(1254MiB/10154msec); 0 zone resets 00:20:30.107 slat (usec): min=17, max=124274, avg=1091.90, stdev=3681.34 00:20:30.107 clat (msec): min=2, max=316, avg=128.11, stdev=60.22 00:20:30.107 lat (msec): min=2, max=316, avg=129.20, stdev=61.02 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 41], 20.00th=[ 68], 00:20:30.107 | 30.00th=[ 94], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 146], 00:20:30.107 | 70.00th=[ 165], 80.00th=[ 184], 90.00th=[ 203], 95.00th=[ 224], 00:20:30.107 | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 292], 99.95th=[ 305], 00:20:30.107 | 99.99th=[ 317] 00:20:30.107 bw ( KiB/s): min=73216, max=214016, per=8.55%, avg=126789.30, stdev=37996.63, samples=20 00:20:30.107 iops : min= 286, max= 836, avg=495.20, stdev=148.43, samples=20 00:20:30.107 lat (msec) : 4=0.16%, 10=0.56%, 20=2.59%, 50=9.41%, 100=19.08% 00:20:30.107 lat (msec) : 250=67.01%, 500=1.20% 00:20:30.107 cpu : usr=1.63%, sys=1.82%, ctx=3344, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,5016,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job6: (groupid=0, jobs=1): err= 0: pid=1002361: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=577, BW=144MiB/s (151MB/s)(1461MiB/10121msec); 0 zone resets 00:20:30.107 slat (usec): min=25, max=73072, avg=1486.38, stdev=3595.51 00:20:30.107 clat (msec): min=6, max=278, avg=109.29, stdev=58.61 00:20:30.107 lat (msec): min=8, max=278, avg=110.77, stdev=59.28 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 31], 5.00th=[ 41], 10.00th=[ 44], 20.00th=[ 47], 00:20:30.107 | 30.00th=[ 63], 40.00th=[ 79], 50.00th=[ 94], 60.00th=[ 128], 00:20:30.107 | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 192], 95.00th=[ 215], 00:20:30.107 | 99.00th=[ 239], 99.50th=[ 247], 99.90th=[ 268], 99.95th=[ 275], 00:20:30.107 | 99.99th=[ 279] 00:20:30.107 bw ( KiB/s): min=65536, max=300032, per=9.98%, avg=148008.75, stdev=77356.82, samples=20 00:20:30.107 iops : min= 256, max= 1172, avg=578.15, stdev=302.18, samples=20 00:20:30.107 lat (msec) : 10=0.07%, 20=0.56%, 50=22.65%, 100=29.12%, 250=47.24% 00:20:30.107 lat (msec) : 500=0.36% 00:20:30.107 cpu : usr=1.98%, sys=2.02%, ctx=1966, majf=0, minf=1 00:20:30.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:30.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.107 issued rwts: total=0,5845,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.107 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.107 job7: (groupid=0, jobs=1): err= 0: pid=1002362: Tue Nov 26 08:28:14 2024 00:20:30.107 write: IOPS=537, BW=134MiB/s (141MB/s)(1361MiB/10124msec); 0 zone resets 00:20:30.107 slat (usec): min=19, max=73635, avg=1129.38, stdev=3433.82 00:20:30.107 clat (msec): min=2, max=256, avg=117.86, stdev=57.37 00:20:30.107 lat (msec): min=2, max=259, avg=118.99, stdev=58.14 00:20:30.107 clat percentiles (msec): 00:20:30.107 | 1.00th=[ 13], 5.00th=[ 28], 10.00th=[ 39], 20.00th=[ 62], 00:20:30.107 | 30.00th=[ 85], 40.00th=[ 102], 50.00th=[ 116], 60.00th=[ 132], 00:20:30.107 | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 194], 95.00th=[ 207], 00:20:30.107 | 99.00th=[ 243], 99.50th=[ 247], 99.90th=[ 253], 99.95th=[ 255], 00:20:30.107 | 99.99th=[ 257] 00:20:30.107 bw ( KiB/s): min=71680, max=221184, per=9.28%, avg=137672.60, stdev=41367.75, samples=20 00:20:30.107 iops : min= 280, max= 864, avg=537.75, stdev=161.56, samples=20 00:20:30.108 lat (msec) : 4=0.09%, 10=0.61%, 20=2.54%, 50=12.00%, 100=24.26% 00:20:30.108 lat (msec) : 250=60.36%, 500=0.15% 00:20:30.108 cpu : usr=1.69%, sys=2.19%, ctx=3282, majf=0, minf=1 00:20:30.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.108 issued rwts: total=0,5442,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.108 job8: (groupid=0, jobs=1): err= 0: pid=1002363: Tue Nov 26 08:28:14 2024 00:20:30.108 write: IOPS=514, BW=129MiB/s (135MB/s)(1303MiB/10125msec); 0 zone resets 00:20:30.108 slat (usec): min=23, max=102849, avg=1248.85, stdev=3692.74 00:20:30.108 clat (msec): min=2, max=340, avg=123.02, stdev=57.34 00:20:30.108 lat (msec): min=2, max=340, avg=124.26, stdev=57.93 00:20:30.108 clat percentiles (msec): 00:20:30.108 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 39], 20.00th=[ 75], 00:20:30.108 | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 140], 00:20:30.108 | 70.00th=[ 153], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 218], 00:20:30.108 | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 342], 00:20:30.108 | 99.99th=[ 342] 00:20:30.108 bw ( KiB/s): min=89600, max=218112, per=8.88%, avg=131773.85, stdev=36229.15, samples=20 00:20:30.108 iops : min= 350, max= 852, avg=514.70, stdev=141.50, samples=20 00:20:30.108 lat (msec) : 4=0.23%, 10=1.19%, 20=2.74%, 50=9.29%, 100=16.50% 00:20:30.108 lat (msec) : 250=68.39%, 500=1.65% 00:20:30.108 cpu : usr=1.66%, sys=2.19%, ctx=2999, majf=0, minf=1 00:20:30.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.108 issued rwts: total=0,5211,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.108 job9: (groupid=0, jobs=1): err= 0: pid=1002364: Tue Nov 26 08:28:14 2024 00:20:30.108 write: IOPS=595, BW=149MiB/s (156MB/s)(1505MiB/10114msec); 0 zone resets 00:20:30.108 slat (usec): min=15, max=74353, avg=1014.10, stdev=3331.40 00:20:30.108 clat (usec): min=1145, max=297801, avg=106459.38, stdev=68726.76 00:20:30.108 lat (usec): min=1202, max=305993, avg=107473.47, stdev=69538.36 00:20:30.108 clat percentiles (msec): 00:20:30.108 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 23], 20.00th=[ 39], 00:20:30.108 | 30.00th=[ 51], 40.00th=[ 83], 50.00th=[ 100], 60.00th=[ 123], 00:20:30.108 | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 236], 00:20:30.108 | 99.00th=[ 262], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 296], 00:20:30.108 | 99.99th=[ 300] 00:20:30.108 bw ( KiB/s): min=69632, max=365056, per=10.28%, avg=152495.35, stdev=66685.11, samples=20 00:20:30.108 iops : min= 272, max= 1426, avg=595.60, stdev=260.53, samples=20 00:20:30.108 lat (msec) : 2=0.20%, 4=0.96%, 10=2.92%, 20=5.00%, 50=20.75% 00:20:30.108 lat (msec) : 100=20.95%, 250=46.93%, 500=2.29% 00:20:30.108 cpu : usr=1.95%, sys=2.16%, ctx=3789, majf=0, minf=1 00:20:30.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:30.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.108 issued rwts: total=0,6020,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.108 job10: (groupid=0, jobs=1): err= 0: pid=1002365: Tue Nov 26 08:28:14 2024 00:20:30.108 write: IOPS=485, BW=121MiB/s (127MB/s)(1234MiB/10156msec); 0 zone resets 00:20:30.108 slat (usec): min=15, max=39844, avg=1356.32, stdev=3687.18 00:20:30.108 clat (usec): min=1130, max=312788, avg=130275.33, stdev=59411.91 00:20:30.108 lat (usec): min=1177, max=312827, avg=131631.65, stdev=60305.84 00:20:30.108 clat percentiles (msec): 00:20:30.108 | 1.00th=[ 12], 5.00th=[ 31], 10.00th=[ 50], 20.00th=[ 78], 00:20:30.108 | 30.00th=[ 96], 40.00th=[ 120], 50.00th=[ 131], 60.00th=[ 146], 00:20:30.108 | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 234], 00:20:30.108 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 300], 99.95th=[ 313], 00:20:30.108 | 99.99th=[ 313] 00:20:30.108 bw ( KiB/s): min=71680, max=187392, per=8.41%, avg=124724.15, stdev=37352.14, samples=20 00:20:30.108 iops : min= 280, max= 732, avg=487.15, stdev=145.93, samples=20 00:20:30.108 lat (msec) : 2=0.06%, 4=0.12%, 10=0.53%, 20=1.93%, 50=7.54% 00:20:30.108 lat (msec) : 100=21.01%, 250=65.88%, 500=2.94% 00:20:30.108 cpu : usr=1.64%, sys=1.75%, ctx=2777, majf=0, minf=2 00:20:30.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:30.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.108 issued rwts: total=0,4935,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.108 00:20:30.108 Run status group 0 (all jobs): 00:20:30.108 WRITE: bw=1448MiB/s (1519MB/s), 102MiB/s-164MiB/s (107MB/s-172MB/s), io=14.4GiB (15.4GB), run=10098-10157msec 00:20:30.108 00:20:30.108 Disk stats (read/write): 00:20:30.108 nvme0n1: ios=50/13075, merge=0/0, ticks=2465/1215167, in_queue=1217632, util=99.87% 00:20:30.108 nvme10n1: ios=45/10737, merge=0/0, ticks=118/1222563, in_queue=1222681, util=98.25% 00:20:30.108 nvme1n1: ios=33/10762, merge=0/0, ticks=2578/1209725, in_queue=1212303, util=100.00% 00:20:30.108 nvme2n1: ios=48/9180, merge=0/0, ticks=2635/1217188, in_queue=1219823, util=100.00% 00:20:30.108 nvme3n1: ios=30/8087, merge=0/0, ticks=75/1208796, in_queue=1208871, util=98.33% 00:20:30.108 nvme4n1: ios=50/9845, merge=0/0, ticks=2473/1221660, in_queue=1224133, util=100.00% 00:20:30.108 nvme5n1: ios=45/11437, merge=0/0, ticks=2340/1208078, in_queue=1210418, util=100.00% 00:20:30.108 nvme6n1: ios=48/10663, merge=0/0, ticks=2061/1225244, in_queue=1227305, util=100.00% 00:20:30.108 nvme7n1: ios=44/10232, merge=0/0, ticks=2967/1221252, in_queue=1224219, util=100.00% 00:20:30.108 nvme8n1: ios=0/11777, merge=0/0, ticks=0/1223784, in_queue=1223784, util=99.00% 00:20:30.108 nvme9n1: ios=0/9633, merge=0/0, ticks=0/1218871, in_queue=1218871, util=99.11% 00:20:30.108 08:28:14 -- target/multiconnection.sh@36 -- # sync 00:20:30.108 08:28:14 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:30.108 08:28:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.108 08:28:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:30.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:30.108 08:28:15 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:30.108 08:28:15 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:30.108 08:28:15 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.108 08:28:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:30.108 08:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.108 08:28:15 -- common/autotest_common.sh@10 -- # set +x 00:20:30.108 08:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.108 08:28:15 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.108 08:28:15 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:30.108 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:30.108 08:28:15 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:30.108 08:28:15 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:30.108 08:28:15 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.108 08:28:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:30.108 08:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.108 08:28:15 -- common/autotest_common.sh@10 -- # set +x 00:20:30.108 08:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.108 08:28:15 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.108 08:28:15 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:30.108 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:30.108 08:28:15 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:30.108 08:28:15 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.108 08:28:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:30.108 08:28:15 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.108 08:28:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:30.108 08:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.108 08:28:15 -- common/autotest_common.sh@10 -- # set +x 00:20:30.108 08:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.108 08:28:15 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.108 08:28:15 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:30.367 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:30.367 08:28:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:30.368 08:28:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.368 08:28:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.368 08:28:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:30.368 08:28:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.368 08:28:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:30.368 08:28:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.368 08:28:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:30.368 08:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.368 08:28:16 -- common/autotest_common.sh@10 -- # set +x 00:20:30.368 08:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.368 08:28:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.368 08:28:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:30.626 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:30.626 08:28:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:30.626 08:28:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.626 08:28:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.626 08:28:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:30.626 08:28:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.626 08:28:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:30.626 08:28:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.626 08:28:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:30.626 08:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.626 08:28:16 -- common/autotest_common.sh@10 -- # set +x 00:20:30.626 08:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.626 08:28:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.626 08:28:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:30.626 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:30.626 08:28:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:30.626 08:28:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.626 08:28:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.626 08:28:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:30.886 08:28:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.886 08:28:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:30.886 08:28:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.886 08:28:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:30.886 08:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.886 08:28:16 -- common/autotest_common.sh@10 -- # set +x 00:20:30.886 08:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.886 08:28:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.886 08:28:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:31.146 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:31.146 08:28:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:31.146 08:28:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.146 08:28:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.146 08:28:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:31.146 08:28:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.146 08:28:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:31.146 08:28:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.146 08:28:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:31.146 08:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.146 08:28:16 -- common/autotest_common.sh@10 -- # set +x 00:20:31.146 08:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.146 08:28:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.146 08:28:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:31.146 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:31.146 08:28:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:31.146 08:28:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.146 08:28:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.146 08:28:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:31.146 08:28:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.146 08:28:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:31.146 08:28:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.146 08:28:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:31.146 08:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.146 08:28:16 -- common/autotest_common.sh@10 -- # set +x 00:20:31.146 08:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.146 08:28:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.146 08:28:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:31.407 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:31.407 08:28:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:31.407 08:28:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.407 08:28:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.407 08:28:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:31.407 08:28:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.407 08:28:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:31.407 08:28:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.407 08:28:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:31.407 08:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.407 08:28:17 -- common/autotest_common.sh@10 -- # set +x 00:20:31.407 08:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.407 08:28:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.407 08:28:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:31.407 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:31.407 08:28:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:31.407 08:28:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.407 08:28:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.407 08:28:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:31.407 08:28:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.407 08:28:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:31.407 08:28:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.407 08:28:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:31.407 08:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.407 08:28:17 -- common/autotest_common.sh@10 -- # set +x 00:20:31.407 08:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.407 08:28:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.407 08:28:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:31.666 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:31.666 08:28:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:31.666 08:28:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.666 08:28:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.666 08:28:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:31.666 08:28:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.666 08:28:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:31.666 08:28:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.666 08:28:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:31.666 08:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.666 08:28:17 -- common/autotest_common.sh@10 -- # set +x 00:20:31.666 08:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.666 08:28:17 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:31.666 08:28:17 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:31.666 08:28:17 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:31.666 08:28:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:31.666 08:28:17 -- nvmf/common.sh@116 -- # sync 00:20:31.666 08:28:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:31.666 08:28:17 -- nvmf/common.sh@119 -- # set +e 00:20:31.666 08:28:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:31.666 08:28:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:31.666 rmmod nvme_tcp 00:20:31.666 rmmod nvme_fabrics 00:20:31.666 rmmod nvme_keyring 00:20:31.666 08:28:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:31.666 08:28:17 -- nvmf/common.sh@123 -- # set -e 00:20:31.666 08:28:17 -- nvmf/common.sh@124 -- # return 0 00:20:31.666 08:28:17 -- nvmf/common.sh@477 -- # '[' -n 996604 ']' 00:20:31.666 08:28:17 -- nvmf/common.sh@478 -- # killprocess 996604 00:20:31.666 08:28:17 -- common/autotest_common.sh@936 -- # '[' -z 996604 ']' 00:20:31.666 08:28:17 -- common/autotest_common.sh@940 -- # kill -0 996604 00:20:31.666 08:28:17 -- common/autotest_common.sh@941 -- # uname 00:20:31.666 08:28:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:31.666 08:28:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 996604 00:20:31.666 08:28:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:31.666 08:28:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:31.666 08:28:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 996604' 00:20:31.666 killing process with pid 996604 00:20:31.666 08:28:17 -- common/autotest_common.sh@955 -- # kill 996604 00:20:31.666 08:28:17 -- common/autotest_common.sh@960 -- # wait 996604 00:20:32.233 08:28:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:32.233 08:28:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:32.233 08:28:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:32.233 08:28:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:32.233 08:28:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:32.233 08:28:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:32.233 08:28:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:32.233 08:28:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:34.773 08:28:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:34.773 00:20:34.773 real 1m1.363s 00:20:34.773 user 3m22.419s 00:20:34.773 sys 0m27.331s 00:20:34.773 08:28:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:34.773 08:28:20 -- common/autotest_common.sh@10 -- # set +x 00:20:34.773 ************************************ 00:20:34.773 END TEST nvmf_multiconnection 00:20:34.773 ************************************ 00:20:34.773 08:28:20 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:34.773 08:28:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:34.773 08:28:20 -- common/autotest_common.sh@10 -- # set +x 00:20:34.773 ************************************ 00:20:34.773 START TEST nvmf_initiator_timeout 00:20:34.773 ************************************ 00:20:34.773 08:28:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:34.773 * Looking for test storage... 00:20:34.773 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:34.773 08:28:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:34.773 08:28:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:34.773 08:28:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:34.773 08:28:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:34.773 08:28:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:34.773 08:28:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:34.773 08:28:20 -- scripts/common.sh@335 -- # IFS=.-: 00:20:34.773 08:28:20 -- scripts/common.sh@335 -- # read -ra ver1 00:20:34.773 08:28:20 -- scripts/common.sh@336 -- # IFS=.-: 00:20:34.773 08:28:20 -- scripts/common.sh@336 -- # read -ra ver2 00:20:34.773 08:28:20 -- scripts/common.sh@337 -- # local 'op=<' 00:20:34.773 08:28:20 -- scripts/common.sh@339 -- # ver1_l=2 00:20:34.773 08:28:20 -- scripts/common.sh@340 -- # ver2_l=1 00:20:34.773 08:28:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:34.773 08:28:20 -- scripts/common.sh@343 -- # case "$op" in 00:20:34.773 08:28:20 -- scripts/common.sh@344 -- # : 1 00:20:34.773 08:28:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:34.773 08:28:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:34.773 08:28:20 -- scripts/common.sh@364 -- # decimal 1 00:20:34.773 08:28:20 -- scripts/common.sh@352 -- # local d=1 00:20:34.773 08:28:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:34.773 08:28:20 -- scripts/common.sh@354 -- # echo 1 00:20:34.773 08:28:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:34.773 08:28:20 -- scripts/common.sh@365 -- # decimal 2 00:20:34.773 08:28:20 -- scripts/common.sh@352 -- # local d=2 00:20:34.773 08:28:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:34.773 08:28:20 -- scripts/common.sh@354 -- # echo 2 00:20:34.773 08:28:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:34.773 08:28:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:34.773 08:28:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:34.773 08:28:20 -- scripts/common.sh@367 -- # return 0 00:20:34.773 08:28:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.773 --rc genhtml_branch_coverage=1 00:20:34.773 --rc genhtml_function_coverage=1 00:20:34.773 --rc genhtml_legend=1 00:20:34.773 --rc geninfo_all_blocks=1 00:20:34.773 --rc geninfo_unexecuted_blocks=1 00:20:34.773 00:20:34.773 ' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.773 --rc genhtml_branch_coverage=1 00:20:34.773 --rc genhtml_function_coverage=1 00:20:34.773 --rc genhtml_legend=1 00:20:34.773 --rc geninfo_all_blocks=1 00:20:34.773 --rc geninfo_unexecuted_blocks=1 00:20:34.773 00:20:34.773 ' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.773 --rc genhtml_branch_coverage=1 00:20:34.773 --rc genhtml_function_coverage=1 00:20:34.773 --rc genhtml_legend=1 00:20:34.773 --rc geninfo_all_blocks=1 00:20:34.773 --rc geninfo_unexecuted_blocks=1 00:20:34.773 00:20:34.773 ' 00:20:34.773 08:28:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.773 --rc genhtml_branch_coverage=1 00:20:34.773 --rc genhtml_function_coverage=1 00:20:34.773 --rc genhtml_legend=1 00:20:34.773 --rc geninfo_all_blocks=1 00:20:34.773 --rc geninfo_unexecuted_blocks=1 00:20:34.773 00:20:34.773 ' 00:20:34.773 08:28:20 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:34.773 08:28:20 -- nvmf/common.sh@7 -- # uname -s 00:20:34.773 08:28:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:34.773 08:28:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:34.773 08:28:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:34.773 08:28:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:34.773 08:28:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:34.773 08:28:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:34.773 08:28:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:34.773 08:28:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:34.773 08:28:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:34.773 08:28:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:34.773 08:28:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:34.773 08:28:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:34.773 08:28:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:34.773 08:28:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:34.773 08:28:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:34.773 08:28:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:34.773 08:28:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:34.773 08:28:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:34.773 08:28:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:34.773 08:28:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.774 08:28:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.774 08:28:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.774 08:28:20 -- paths/export.sh@5 -- # export PATH 00:20:34.774 08:28:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.774 08:28:20 -- nvmf/common.sh@46 -- # : 0 00:20:34.774 08:28:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:34.774 08:28:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:34.774 08:28:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:34.774 08:28:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:34.774 08:28:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:34.774 08:28:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:34.774 08:28:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:34.774 08:28:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:34.774 08:28:20 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:34.774 08:28:20 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:34.774 08:28:20 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:34.774 08:28:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:34.774 08:28:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:34.774 08:28:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:34.774 08:28:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:34.774 08:28:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:34.774 08:28:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:34.774 08:28:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:34.774 08:28:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:34.774 08:28:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:34.774 08:28:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:34.774 08:28:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:34.774 08:28:20 -- common/autotest_common.sh@10 -- # set +x 00:20:36.677 08:28:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:36.677 08:28:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:36.677 08:28:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:36.677 08:28:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:36.677 08:28:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:36.677 08:28:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:36.677 08:28:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:36.677 08:28:22 -- nvmf/common.sh@294 -- # net_devs=() 00:20:36.677 08:28:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:36.677 08:28:22 -- nvmf/common.sh@295 -- # e810=() 00:20:36.677 08:28:22 -- nvmf/common.sh@295 -- # local -ga e810 00:20:36.677 08:28:22 -- nvmf/common.sh@296 -- # x722=() 00:20:36.677 08:28:22 -- nvmf/common.sh@296 -- # local -ga x722 00:20:36.677 08:28:22 -- nvmf/common.sh@297 -- # mlx=() 00:20:36.677 08:28:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:36.677 08:28:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:36.677 08:28:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:36.677 08:28:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:36.677 08:28:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:36.677 08:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:36.677 08:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:36.677 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:36.677 08:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:36.677 08:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:36.677 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:36.677 08:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:36.677 08:28:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:36.677 08:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:36.677 08:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.677 08:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:36.677 08:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.678 08:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:36.678 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:36.678 08:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.678 08:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:36.678 08:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.678 08:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:36.678 08:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.678 08:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:36.678 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:36.678 08:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.678 08:28:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:36.678 08:28:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:36.678 08:28:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:36.678 08:28:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:36.678 08:28:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:36.678 08:28:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:36.678 08:28:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:36.678 08:28:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:36.678 08:28:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:36.678 08:28:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:36.678 08:28:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:36.678 08:28:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:36.678 08:28:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:36.678 08:28:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:36.678 08:28:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:36.678 08:28:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:36.678 08:28:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:36.678 08:28:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:36.678 08:28:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:36.678 08:28:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:36.678 08:28:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:36.678 08:28:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:36.678 08:28:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:36.678 08:28:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:36.678 08:28:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:36.678 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:36.678 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:20:36.678 00:20:36.678 --- 10.0.0.2 ping statistics --- 00:20:36.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:36.678 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:20:36.678 08:28:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:36.678 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:36.678 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:36.678 00:20:36.678 --- 10.0.0.1 ping statistics --- 00:20:36.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:36.678 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:36.678 08:28:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:36.678 08:28:22 -- nvmf/common.sh@410 -- # return 0 00:20:36.678 08:28:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:36.678 08:28:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:36.678 08:28:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:36.678 08:28:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:36.678 08:28:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:36.678 08:28:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:36.678 08:28:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:36.936 08:28:22 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:36.936 08:28:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:36.936 08:28:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:36.936 08:28:22 -- common/autotest_common.sh@10 -- # set +x 00:20:36.936 08:28:22 -- nvmf/common.sh@469 -- # nvmfpid=1005759 00:20:36.936 08:28:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:36.936 08:28:22 -- nvmf/common.sh@470 -- # waitforlisten 1005759 00:20:36.936 08:28:22 -- common/autotest_common.sh@829 -- # '[' -z 1005759 ']' 00:20:36.936 08:28:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:36.936 08:28:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.936 08:28:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:36.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:36.936 08:28:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.936 08:28:22 -- common/autotest_common.sh@10 -- # set +x 00:20:36.936 [2024-11-26 08:28:22.576996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:36.936 [2024-11-26 08:28:22.577080] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:36.936 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.936 [2024-11-26 08:28:22.639445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:36.936 [2024-11-26 08:28:22.748167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:36.936 [2024-11-26 08:28:22.748319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:36.936 [2024-11-26 08:28:22.748351] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:36.936 [2024-11-26 08:28:22.748365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:36.936 [2024-11-26 08:28:22.748428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.936 [2024-11-26 08:28:22.748492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.936 [2024-11-26 08:28:22.748542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:36.936 [2024-11-26 08:28:22.748544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:37.873 08:28:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.873 08:28:23 -- common/autotest_common.sh@862 -- # return 0 00:20:37.873 08:28:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:37.873 08:28:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 08:28:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 Malloc0 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 Delay0 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 [2024-11-26 08:28:23.622901] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:37.873 08:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.873 08:28:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.873 [2024-11-26 08:28:23.651243] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:37.873 08:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.873 08:28:23 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:38.868 08:28:24 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:38.868 08:28:24 -- common/autotest_common.sh@1187 -- # local i=0 00:20:38.869 08:28:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:38.869 08:28:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:38.869 08:28:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:40.772 08:28:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:40.772 08:28:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:40.772 08:28:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:40.772 08:28:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:40.772 08:28:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:40.772 08:28:26 -- common/autotest_common.sh@1197 -- # return 0 00:20:40.772 08:28:26 -- target/initiator_timeout.sh@35 -- # fio_pid=1006329 00:20:40.772 08:28:26 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:40.772 08:28:26 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:40.772 [global] 00:20:40.772 thread=1 00:20:40.772 invalidate=1 00:20:40.772 rw=write 00:20:40.772 time_based=1 00:20:40.772 runtime=60 00:20:40.772 ioengine=libaio 00:20:40.772 direct=1 00:20:40.772 bs=4096 00:20:40.772 iodepth=1 00:20:40.772 norandommap=0 00:20:40.772 numjobs=1 00:20:40.772 00:20:40.772 verify_dump=1 00:20:40.772 verify_backlog=512 00:20:40.772 verify_state_save=0 00:20:40.772 do_verify=1 00:20:40.772 verify=crc32c-intel 00:20:40.772 [job0] 00:20:40.772 filename=/dev/nvme0n1 00:20:40.772 Could not set queue depth (nvme0n1) 00:20:40.772 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:40.772 fio-3.35 00:20:40.772 Starting 1 thread 00:20:44.105 08:28:29 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:44.105 08:28:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.105 08:28:29 -- common/autotest_common.sh@10 -- # set +x 00:20:44.105 true 00:20:44.105 08:28:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.105 08:28:29 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:44.105 08:28:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.105 08:28:29 -- common/autotest_common.sh@10 -- # set +x 00:20:44.105 true 00:20:44.105 08:28:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.105 08:28:29 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:44.105 08:28:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.105 08:28:29 -- common/autotest_common.sh@10 -- # set +x 00:20:44.105 true 00:20:44.106 08:28:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.106 08:28:29 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:44.106 08:28:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.106 08:28:29 -- common/autotest_common.sh@10 -- # set +x 00:20:44.106 true 00:20:44.106 08:28:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.106 08:28:29 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:46.641 08:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.641 08:28:32 -- common/autotest_common.sh@10 -- # set +x 00:20:46.641 true 00:20:46.641 08:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:46.641 08:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.641 08:28:32 -- common/autotest_common.sh@10 -- # set +x 00:20:46.641 true 00:20:46.641 08:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:46.641 08:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.641 08:28:32 -- common/autotest_common.sh@10 -- # set +x 00:20:46.641 true 00:20:46.641 08:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:46.641 08:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.641 08:28:32 -- common/autotest_common.sh@10 -- # set +x 00:20:46.641 true 00:20:46.641 08:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:46.641 08:28:32 -- target/initiator_timeout.sh@54 -- # wait 1006329 00:21:42.875 00:21:42.875 job0: (groupid=0, jobs=1): err= 0: pid=1006401: Tue Nov 26 08:29:26 2024 00:21:42.875 read: IOPS=7, BW=30.4KiB/s (31.1kB/s)(1824KiB/60004msec) 00:21:42.875 slat (usec): min=12, max=12364, avg=68.13, stdev=676.11 00:21:42.875 clat (usec): min=354, max=41081k, avg=131182.36, stdev=1921847.49 00:21:42.875 lat (usec): min=376, max=41081k, avg=131250.49, stdev=1921844.59 00:21:42.876 clat percentiles (msec): 00:21:42.876 | 1.00th=[ 41], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], 00:21:42.876 | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 42], 60.00th=[ 42], 00:21:42.876 | 70.00th=[ 43], 80.00th=[ 43], 90.00th=[ 43], 95.00th=[ 43], 00:21:42.876 | 99.00th=[ 43], 99.50th=[ 43], 99.90th=[17113], 99.95th=[17113], 00:21:42.876 | 99.99th=[17113] 00:21:42.876 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(2048KiB/60004msec); 0 zone resets 00:21:42.876 slat (usec): min=7, max=29472, avg=70.26, stdev=1301.99 00:21:42.876 clat (usec): min=184, max=427, avg=219.06, stdev=25.29 00:21:42.876 lat (usec): min=192, max=29732, avg=289.32, stdev=1304.10 00:21:42.876 clat percentiles (usec): 00:21:42.876 | 1.00th=[ 190], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 202], 00:21:42.876 | 30.00th=[ 204], 40.00th=[ 208], 50.00th=[ 212], 60.00th=[ 219], 00:21:42.876 | 70.00th=[ 229], 80.00th=[ 235], 90.00th=[ 245], 95.00th=[ 255], 00:21:42.876 | 99.00th=[ 330], 99.50th=[ 367], 99.90th=[ 429], 99.95th=[ 429], 00:21:42.876 | 99.99th=[ 429] 00:21:42.876 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:21:42.876 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:21:42.876 lat (usec) : 250=48.97%, 500=4.24% 00:21:42.876 lat (msec) : 50=46.69%, >=2000=0.10% 00:21:42.876 cpu : usr=0.01%, sys=0.05%, ctx=973, majf=0, minf=1 00:21:42.876 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:42.876 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:42.876 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:42.876 issued rwts: total=456,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:42.876 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:42.876 00:21:42.876 Run status group 0 (all jobs): 00:21:42.876 READ: bw=30.4KiB/s (31.1kB/s), 30.4KiB/s-30.4KiB/s (31.1kB/s-31.1kB/s), io=1824KiB (1868kB), run=60004-60004msec 00:21:42.876 WRITE: bw=34.1KiB/s (34.9kB/s), 34.1KiB/s-34.1KiB/s (34.9kB/s-34.9kB/s), io=2048KiB (2097kB), run=60004-60004msec 00:21:42.876 00:21:42.876 Disk stats (read/write): 00:21:42.876 nvme0n1: ios=505/512, merge=0/0, ticks=19889/105, in_queue=19994, util=99.75% 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:42.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:42.876 08:29:26 -- common/autotest_common.sh@1208 -- # local i=0 00:21:42.876 08:29:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:42.876 08:29:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:42.876 08:29:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:42.876 08:29:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:42.876 08:29:26 -- common/autotest_common.sh@1220 -- # return 0 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:42.876 nvmf hotplug test: fio successful as expected 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:42.876 08:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.876 08:29:26 -- common/autotest_common.sh@10 -- # set +x 00:21:42.876 08:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:42.876 08:29:26 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:42.876 08:29:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:42.876 08:29:26 -- nvmf/common.sh@116 -- # sync 00:21:42.876 08:29:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:42.876 08:29:26 -- nvmf/common.sh@119 -- # set +e 00:21:42.876 08:29:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:42.876 08:29:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:42.876 rmmod nvme_tcp 00:21:42.876 rmmod nvme_fabrics 00:21:42.876 rmmod nvme_keyring 00:21:42.876 08:29:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:42.876 08:29:26 -- nvmf/common.sh@123 -- # set -e 00:21:42.876 08:29:26 -- nvmf/common.sh@124 -- # return 0 00:21:42.876 08:29:26 -- nvmf/common.sh@477 -- # '[' -n 1005759 ']' 00:21:42.876 08:29:26 -- nvmf/common.sh@478 -- # killprocess 1005759 00:21:42.876 08:29:26 -- common/autotest_common.sh@936 -- # '[' -z 1005759 ']' 00:21:42.876 08:29:26 -- common/autotest_common.sh@940 -- # kill -0 1005759 00:21:42.876 08:29:26 -- common/autotest_common.sh@941 -- # uname 00:21:42.876 08:29:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:42.876 08:29:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1005759 00:21:42.876 08:29:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:42.876 08:29:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:42.876 08:29:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1005759' 00:21:42.876 killing process with pid 1005759 00:21:42.876 08:29:26 -- common/autotest_common.sh@955 -- # kill 1005759 00:21:42.876 08:29:26 -- common/autotest_common.sh@960 -- # wait 1005759 00:21:42.876 08:29:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:42.876 08:29:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:42.876 08:29:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:42.876 08:29:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:42.876 08:29:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:42.876 08:29:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:42.876 08:29:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:42.876 08:29:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:43.451 08:29:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:43.451 00:21:43.451 real 1m9.215s 00:21:43.451 user 4m14.541s 00:21:43.451 sys 0m6.330s 00:21:43.451 08:29:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:43.451 08:29:29 -- common/autotest_common.sh@10 -- # set +x 00:21:43.451 ************************************ 00:21:43.451 END TEST nvmf_initiator_timeout 00:21:43.451 ************************************ 00:21:43.709 08:29:29 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:43.709 08:29:29 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:43.709 08:29:29 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:43.709 08:29:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:43.709 08:29:29 -- common/autotest_common.sh@10 -- # set +x 00:21:45.613 08:29:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:45.613 08:29:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:45.613 08:29:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:45.614 08:29:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:45.614 08:29:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:45.614 08:29:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:45.614 08:29:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:45.614 08:29:31 -- nvmf/common.sh@294 -- # net_devs=() 00:21:45.614 08:29:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:45.614 08:29:31 -- nvmf/common.sh@295 -- # e810=() 00:21:45.614 08:29:31 -- nvmf/common.sh@295 -- # local -ga e810 00:21:45.614 08:29:31 -- nvmf/common.sh@296 -- # x722=() 00:21:45.614 08:29:31 -- nvmf/common.sh@296 -- # local -ga x722 00:21:45.614 08:29:31 -- nvmf/common.sh@297 -- # mlx=() 00:21:45.614 08:29:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:45.614 08:29:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:45.614 08:29:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:45.614 08:29:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:45.614 08:29:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:45.614 08:29:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.614 08:29:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:45.614 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:45.614 08:29:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.614 08:29:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:45.614 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:45.614 08:29:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:45.614 08:29:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:45.614 08:29:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.614 08:29:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.614 08:29:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.614 08:29:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.614 08:29:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:45.614 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:45.614 08:29:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.614 08:29:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.614 08:29:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.614 08:29:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.614 08:29:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.614 08:29:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:45.614 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:45.614 08:29:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.614 08:29:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:45.614 08:29:31 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:45.614 08:29:31 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:45.614 08:29:31 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:45.614 08:29:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:45.614 08:29:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:45.614 08:29:31 -- common/autotest_common.sh@10 -- # set +x 00:21:45.614 ************************************ 00:21:45.614 START TEST nvmf_perf_adq 00:21:45.614 ************************************ 00:21:45.614 08:29:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:45.614 * Looking for test storage... 00:21:45.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:45.614 08:29:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:45.614 08:29:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:45.614 08:29:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:45.873 08:29:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:45.873 08:29:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:45.873 08:29:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:45.873 08:29:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:45.873 08:29:31 -- scripts/common.sh@335 -- # IFS=.-: 00:21:45.873 08:29:31 -- scripts/common.sh@335 -- # read -ra ver1 00:21:45.873 08:29:31 -- scripts/common.sh@336 -- # IFS=.-: 00:21:45.873 08:29:31 -- scripts/common.sh@336 -- # read -ra ver2 00:21:45.873 08:29:31 -- scripts/common.sh@337 -- # local 'op=<' 00:21:45.873 08:29:31 -- scripts/common.sh@339 -- # ver1_l=2 00:21:45.873 08:29:31 -- scripts/common.sh@340 -- # ver2_l=1 00:21:45.873 08:29:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:45.873 08:29:31 -- scripts/common.sh@343 -- # case "$op" in 00:21:45.873 08:29:31 -- scripts/common.sh@344 -- # : 1 00:21:45.873 08:29:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:45.873 08:29:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:45.873 08:29:31 -- scripts/common.sh@364 -- # decimal 1 00:21:45.873 08:29:31 -- scripts/common.sh@352 -- # local d=1 00:21:45.873 08:29:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:45.873 08:29:31 -- scripts/common.sh@354 -- # echo 1 00:21:45.873 08:29:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:45.873 08:29:31 -- scripts/common.sh@365 -- # decimal 2 00:21:45.873 08:29:31 -- scripts/common.sh@352 -- # local d=2 00:21:45.873 08:29:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:45.873 08:29:31 -- scripts/common.sh@354 -- # echo 2 00:21:45.873 08:29:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:45.873 08:29:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:45.873 08:29:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:45.873 08:29:31 -- scripts/common.sh@367 -- # return 0 00:21:45.873 08:29:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:45.873 08:29:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:45.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.873 --rc genhtml_branch_coverage=1 00:21:45.873 --rc genhtml_function_coverage=1 00:21:45.873 --rc genhtml_legend=1 00:21:45.873 --rc geninfo_all_blocks=1 00:21:45.873 --rc geninfo_unexecuted_blocks=1 00:21:45.873 00:21:45.873 ' 00:21:45.873 08:29:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:45.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.873 --rc genhtml_branch_coverage=1 00:21:45.873 --rc genhtml_function_coverage=1 00:21:45.873 --rc genhtml_legend=1 00:21:45.873 --rc geninfo_all_blocks=1 00:21:45.873 --rc geninfo_unexecuted_blocks=1 00:21:45.873 00:21:45.873 ' 00:21:45.873 08:29:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:45.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.873 --rc genhtml_branch_coverage=1 00:21:45.873 --rc genhtml_function_coverage=1 00:21:45.873 --rc genhtml_legend=1 00:21:45.873 --rc geninfo_all_blocks=1 00:21:45.873 --rc geninfo_unexecuted_blocks=1 00:21:45.873 00:21:45.873 ' 00:21:45.873 08:29:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:45.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.873 --rc genhtml_branch_coverage=1 00:21:45.873 --rc genhtml_function_coverage=1 00:21:45.873 --rc genhtml_legend=1 00:21:45.873 --rc geninfo_all_blocks=1 00:21:45.873 --rc geninfo_unexecuted_blocks=1 00:21:45.873 00:21:45.873 ' 00:21:45.873 08:29:31 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:45.873 08:29:31 -- nvmf/common.sh@7 -- # uname -s 00:21:45.873 08:29:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:45.873 08:29:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:45.873 08:29:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:45.873 08:29:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:45.873 08:29:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:45.873 08:29:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:45.873 08:29:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:45.873 08:29:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:45.873 08:29:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:45.873 08:29:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:45.873 08:29:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:45.873 08:29:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:45.873 08:29:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:45.873 08:29:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:45.873 08:29:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:45.873 08:29:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:45.873 08:29:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:45.873 08:29:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:45.873 08:29:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:45.873 08:29:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.873 08:29:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.873 08:29:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.873 08:29:31 -- paths/export.sh@5 -- # export PATH 00:21:45.874 08:29:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.874 08:29:31 -- nvmf/common.sh@46 -- # : 0 00:21:45.874 08:29:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:45.874 08:29:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:45.874 08:29:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:45.874 08:29:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:45.874 08:29:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:45.874 08:29:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:45.874 08:29:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:45.874 08:29:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:45.874 08:29:31 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:45.874 08:29:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:45.874 08:29:31 -- common/autotest_common.sh@10 -- # set +x 00:21:47.781 08:29:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:47.781 08:29:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:47.781 08:29:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:47.781 08:29:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:47.781 08:29:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:47.781 08:29:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:47.781 08:29:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:47.781 08:29:33 -- nvmf/common.sh@294 -- # net_devs=() 00:21:47.781 08:29:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:47.781 08:29:33 -- nvmf/common.sh@295 -- # e810=() 00:21:47.781 08:29:33 -- nvmf/common.sh@295 -- # local -ga e810 00:21:47.781 08:29:33 -- nvmf/common.sh@296 -- # x722=() 00:21:47.781 08:29:33 -- nvmf/common.sh@296 -- # local -ga x722 00:21:47.781 08:29:33 -- nvmf/common.sh@297 -- # mlx=() 00:21:47.781 08:29:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:47.781 08:29:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:47.781 08:29:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:47.781 08:29:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:47.781 08:29:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:47.781 08:29:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:47.781 08:29:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:47.781 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:47.781 08:29:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:47.781 08:29:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:47.781 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:47.781 08:29:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:47.781 08:29:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:47.781 08:29:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:47.781 08:29:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:47.781 08:29:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:47.781 08:29:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:47.781 08:29:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:47.781 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:47.781 08:29:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:47.781 08:29:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:47.781 08:29:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:47.781 08:29:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:47.781 08:29:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:47.781 08:29:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:47.781 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:47.781 08:29:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:47.781 08:29:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:47.781 08:29:33 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:47.781 08:29:33 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:47.781 08:29:33 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:47.781 08:29:33 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:47.781 08:29:33 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:48.721 08:29:34 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:51.264 08:29:36 -- target/perf_adq.sh@54 -- # sleep 5 00:21:56.550 08:29:41 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:56.550 08:29:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:56.550 08:29:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:56.550 08:29:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:56.550 08:29:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:56.550 08:29:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:56.550 08:29:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:56.550 08:29:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:56.550 08:29:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:56.550 08:29:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:56.550 08:29:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:56.550 08:29:41 -- common/autotest_common.sh@10 -- # set +x 00:21:56.550 08:29:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:56.550 08:29:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:56.550 08:29:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:56.550 08:29:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:56.550 08:29:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:56.550 08:29:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:56.550 08:29:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:56.550 08:29:41 -- nvmf/common.sh@294 -- # net_devs=() 00:21:56.550 08:29:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:56.550 08:29:41 -- nvmf/common.sh@295 -- # e810=() 00:21:56.550 08:29:41 -- nvmf/common.sh@295 -- # local -ga e810 00:21:56.550 08:29:41 -- nvmf/common.sh@296 -- # x722=() 00:21:56.550 08:29:41 -- nvmf/common.sh@296 -- # local -ga x722 00:21:56.550 08:29:41 -- nvmf/common.sh@297 -- # mlx=() 00:21:56.550 08:29:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:56.550 08:29:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:56.550 08:29:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:56.550 08:29:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:56.550 08:29:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.550 08:29:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:56.550 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:56.550 08:29:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.550 08:29:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:56.550 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:56.550 08:29:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.550 08:29:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.550 08:29:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.550 08:29:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:56.550 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:56.550 08:29:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.550 08:29:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.550 08:29:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.550 08:29:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.550 08:29:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:56.550 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:56.550 08:29:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.550 08:29:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:56.550 08:29:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:56.550 08:29:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:56.550 08:29:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:56.550 08:29:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:56.550 08:29:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:56.550 08:29:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:56.550 08:29:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:56.550 08:29:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:56.550 08:29:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:56.550 08:29:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:56.550 08:29:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:56.550 08:29:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:56.550 08:29:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:56.550 08:29:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:56.550 08:29:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:56.550 08:29:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:56.550 08:29:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:56.550 08:29:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:56.550 08:29:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:56.550 08:29:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:56.550 08:29:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:56.550 08:29:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:56.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:56.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:21:56.550 00:21:56.550 --- 10.0.0.2 ping statistics --- 00:21:56.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.551 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:21:56.551 08:29:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:56.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:56.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:21:56.551 00:21:56.551 --- 10.0.0.1 ping statistics --- 00:21:56.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.551 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:21:56.551 08:29:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:56.551 08:29:41 -- nvmf/common.sh@410 -- # return 0 00:21:56.551 08:29:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:56.551 08:29:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:56.551 08:29:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:56.551 08:29:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:56.551 08:29:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:56.551 08:29:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:56.551 08:29:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:56.551 08:29:41 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:56.551 08:29:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:56.551 08:29:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:56.551 08:29:41 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:41 -- nvmf/common.sh@469 -- # nvmfpid=1018332 00:21:56.551 08:29:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:56.551 08:29:41 -- nvmf/common.sh@470 -- # waitforlisten 1018332 00:21:56.551 08:29:41 -- common/autotest_common.sh@829 -- # '[' -z 1018332 ']' 00:21:56.551 08:29:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:56.551 08:29:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:56.551 08:29:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:56.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:56.551 08:29:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:56.551 08:29:41 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 [2024-11-26 08:29:41.901551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:56.551 [2024-11-26 08:29:41.901616] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:56.551 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.551 [2024-11-26 08:29:41.970992] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:56.551 [2024-11-26 08:29:42.092632] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:56.551 [2024-11-26 08:29:42.092814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:56.551 [2024-11-26 08:29:42.092835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:56.551 [2024-11-26 08:29:42.092849] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:56.551 [2024-11-26 08:29:42.092912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:56.551 [2024-11-26 08:29:42.092944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:56.551 [2024-11-26 08:29:42.092998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:56.551 [2024-11-26 08:29:42.093002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:56.551 08:29:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:56.551 08:29:42 -- common/autotest_common.sh@862 -- # return 0 00:21:56.551 08:29:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:56.551 08:29:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:56.551 08:29:42 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:56.551 08:29:42 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 [2024-11-26 08:29:42.300584] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 Malloc1 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:56.551 08:29:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.551 08:29:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.551 [2024-11-26 08:29:42.354180] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:56.551 08:29:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.551 08:29:42 -- target/perf_adq.sh@73 -- # perfpid=1018361 00:21:56.551 08:29:42 -- target/perf_adq.sh@74 -- # sleep 2 00:21:56.551 08:29:42 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:56.551 EAL: No free 2048 kB hugepages reported on node 1 00:21:59.088 08:29:44 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:59.088 08:29:44 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:59.088 08:29:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.088 08:29:44 -- target/perf_adq.sh@76 -- # wc -l 00:21:59.088 08:29:44 -- common/autotest_common.sh@10 -- # set +x 00:21:59.088 08:29:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.088 08:29:44 -- target/perf_adq.sh@76 -- # count=4 00:21:59.088 08:29:44 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:59.088 08:29:44 -- target/perf_adq.sh@81 -- # wait 1018361 00:22:07.214 Initializing NVMe Controllers 00:22:07.214 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:07.214 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:07.214 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:07.214 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:07.214 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:07.214 Initialization complete. Launching workers. 00:22:07.214 ======================================================== 00:22:07.214 Latency(us) 00:22:07.214 Device Information : IOPS MiB/s Average min max 00:22:07.214 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11214.40 43.81 5708.90 2559.78 8747.22 00:22:07.214 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11102.60 43.37 5765.98 1475.34 9358.53 00:22:07.214 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11192.00 43.72 5718.04 1160.34 8712.06 00:22:07.214 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11523.90 45.02 5555.62 1520.40 9403.24 00:22:07.214 ======================================================== 00:22:07.214 Total : 45032.90 175.91 5686.02 1160.34 9403.24 00:22:07.214 00:22:07.214 08:29:52 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:07.214 08:29:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:07.214 08:29:52 -- nvmf/common.sh@116 -- # sync 00:22:07.214 08:29:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:07.214 08:29:52 -- nvmf/common.sh@119 -- # set +e 00:22:07.214 08:29:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:07.214 08:29:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:07.214 rmmod nvme_tcp 00:22:07.214 rmmod nvme_fabrics 00:22:07.214 rmmod nvme_keyring 00:22:07.214 08:29:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:07.214 08:29:52 -- nvmf/common.sh@123 -- # set -e 00:22:07.214 08:29:52 -- nvmf/common.sh@124 -- # return 0 00:22:07.214 08:29:52 -- nvmf/common.sh@477 -- # '[' -n 1018332 ']' 00:22:07.214 08:29:52 -- nvmf/common.sh@478 -- # killprocess 1018332 00:22:07.214 08:29:52 -- common/autotest_common.sh@936 -- # '[' -z 1018332 ']' 00:22:07.214 08:29:52 -- common/autotest_common.sh@940 -- # kill -0 1018332 00:22:07.214 08:29:52 -- common/autotest_common.sh@941 -- # uname 00:22:07.214 08:29:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:07.214 08:29:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1018332 00:22:07.214 08:29:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:07.214 08:29:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:07.214 08:29:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1018332' 00:22:07.214 killing process with pid 1018332 00:22:07.214 08:29:52 -- common/autotest_common.sh@955 -- # kill 1018332 00:22:07.214 08:29:52 -- common/autotest_common.sh@960 -- # wait 1018332 00:22:07.214 08:29:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:07.214 08:29:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:07.214 08:29:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:07.214 08:29:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:07.214 08:29:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:07.214 08:29:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.214 08:29:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.214 08:29:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.127 08:29:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:09.127 08:29:54 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:09.127 08:29:54 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:10.063 08:29:55 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:12.605 08:29:58 -- target/perf_adq.sh@54 -- # sleep 5 00:22:17.979 08:30:03 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:17.979 08:30:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.979 08:30:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.979 08:30:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.979 08:30:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.979 08:30:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.979 08:30:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.979 08:30:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.979 08:30:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.979 08:30:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.979 08:30:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.979 08:30:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.979 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 08:30:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.980 08:30:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.980 08:30:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.980 08:30:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.980 08:30:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.980 08:30:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.980 08:30:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.980 08:30:03 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.980 08:30:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.980 08:30:03 -- nvmf/common.sh@295 -- # e810=() 00:22:17.980 08:30:03 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.980 08:30:03 -- nvmf/common.sh@296 -- # x722=() 00:22:17.980 08:30:03 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.980 08:30:03 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.980 08:30:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.980 08:30:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.980 08:30:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.980 08:30:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.980 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.980 08:30:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.980 08:30:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.980 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.980 08:30:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.980 08:30:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.980 08:30:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.980 08:30:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.980 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.980 08:30:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.980 08:30:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.980 08:30:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.980 08:30:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.980 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.980 08:30:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.980 08:30:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.980 08:30:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.980 08:30:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.980 08:30:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.980 08:30:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.980 08:30:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.980 08:30:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.980 08:30:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.980 08:30:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.980 08:30:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.980 08:30:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.980 08:30:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.980 08:30:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.980 08:30:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.980 08:30:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.980 08:30:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.980 08:30:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.980 08:30:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.980 08:30:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.980 08:30:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.980 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.980 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:22:17.980 00:22:17.980 --- 10.0.0.2 ping statistics --- 00:22:17.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.980 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:22:17.980 08:30:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.980 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.980 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:22:17.980 00:22:17.980 --- 10.0.0.1 ping statistics --- 00:22:17.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.980 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:22:17.980 08:30:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.980 08:30:03 -- nvmf/common.sh@410 -- # return 0 00:22:17.980 08:30:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.980 08:30:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.980 08:30:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.980 08:30:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.980 08:30:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.980 08:30:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.980 08:30:03 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:17.980 08:30:03 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:17.980 08:30:03 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:17.980 08:30:03 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:17.980 net.core.busy_poll = 1 00:22:17.980 08:30:03 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:17.980 net.core.busy_read = 1 00:22:17.980 08:30:03 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:17.980 08:30:03 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:17.980 08:30:03 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:17.980 08:30:03 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:17.980 08:30:03 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:17.980 08:30:03 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:17.980 08:30:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.980 08:30:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.980 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 08:30:03 -- nvmf/common.sh@469 -- # nvmfpid=1021291 00:22:17.980 08:30:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:17.980 08:30:03 -- nvmf/common.sh@470 -- # waitforlisten 1021291 00:22:17.980 08:30:03 -- common/autotest_common.sh@829 -- # '[' -z 1021291 ']' 00:22:17.980 08:30:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.980 08:30:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.980 08:30:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.980 08:30:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.980 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 [2024-11-26 08:30:03.445894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.980 [2024-11-26 08:30:03.446000] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.980 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.980 [2024-11-26 08:30:03.512266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.980 [2024-11-26 08:30:03.623831] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.980 [2024-11-26 08:30:03.624008] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.980 [2024-11-26 08:30:03.624027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.980 [2024-11-26 08:30:03.624040] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.980 [2024-11-26 08:30:03.624095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:17.980 [2024-11-26 08:30:03.624144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.980 [2024-11-26 08:30:03.624167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.980 [2024-11-26 08:30:03.624169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:17.980 08:30:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:17.980 08:30:03 -- common/autotest_common.sh@862 -- # return 0 00:22:17.980 08:30:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:17.980 08:30:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:17.980 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 08:30:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:17.980 08:30:03 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:17.980 08:30:03 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:17.980 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.980 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.980 08:30:03 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:17.980 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.980 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.980 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.980 08:30:03 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:17.981 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.981 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:17.981 [2024-11-26 08:30:03.806226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:17.981 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.981 08:30:03 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:17.981 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.981 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:18.238 Malloc1 00:22:18.238 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.238 08:30:03 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:18.238 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.238 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:18.238 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.238 08:30:03 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:18.238 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.238 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:18.238 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.238 08:30:03 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:18.239 08:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.239 08:30:03 -- common/autotest_common.sh@10 -- # set +x 00:22:18.239 [2024-11-26 08:30:03.857513] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.239 08:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.239 08:30:03 -- target/perf_adq.sh@94 -- # perfpid=1021318 00:22:18.239 08:30:03 -- target/perf_adq.sh@95 -- # sleep 2 00:22:18.239 08:30:03 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:18.239 EAL: No free 2048 kB hugepages reported on node 1 00:22:20.143 08:30:05 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:20.143 08:30:05 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:20.143 08:30:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.143 08:30:05 -- target/perf_adq.sh@97 -- # wc -l 00:22:20.143 08:30:05 -- common/autotest_common.sh@10 -- # set +x 00:22:20.143 08:30:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.143 08:30:05 -- target/perf_adq.sh@97 -- # count=2 00:22:20.143 08:30:05 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:20.143 08:30:05 -- target/perf_adq.sh@103 -- # wait 1021318 00:22:28.262 Initializing NVMe Controllers 00:22:28.262 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:28.262 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:28.262 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:28.262 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:28.262 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:28.262 Initialization complete. Launching workers. 00:22:28.262 ======================================================== 00:22:28.262 Latency(us) 00:22:28.262 Device Information : IOPS MiB/s Average min max 00:22:28.262 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4961.40 19.38 12920.26 2276.64 61310.51 00:22:28.262 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4874.20 19.04 13133.25 2127.64 63797.68 00:22:28.262 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4216.30 16.47 15183.72 1802.42 60497.13 00:22:28.262 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 15246.40 59.56 4197.68 922.41 45381.16 00:22:28.262 ======================================================== 00:22:28.262 Total : 29298.30 114.45 8742.32 922.41 63797.68 00:22:28.262 00:22:28.262 08:30:14 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:28.262 08:30:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:28.262 08:30:14 -- nvmf/common.sh@116 -- # sync 00:22:28.262 08:30:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:28.262 08:30:14 -- nvmf/common.sh@119 -- # set +e 00:22:28.262 08:30:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:28.262 08:30:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:28.262 rmmod nvme_tcp 00:22:28.262 rmmod nvme_fabrics 00:22:28.262 rmmod nvme_keyring 00:22:28.262 08:30:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:28.262 08:30:14 -- nvmf/common.sh@123 -- # set -e 00:22:28.262 08:30:14 -- nvmf/common.sh@124 -- # return 0 00:22:28.262 08:30:14 -- nvmf/common.sh@477 -- # '[' -n 1021291 ']' 00:22:28.262 08:30:14 -- nvmf/common.sh@478 -- # killprocess 1021291 00:22:28.262 08:30:14 -- common/autotest_common.sh@936 -- # '[' -z 1021291 ']' 00:22:28.262 08:30:14 -- common/autotest_common.sh@940 -- # kill -0 1021291 00:22:28.262 08:30:14 -- common/autotest_common.sh@941 -- # uname 00:22:28.262 08:30:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:28.262 08:30:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1021291 00:22:28.262 08:30:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:28.262 08:30:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:28.262 08:30:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1021291' 00:22:28.262 killing process with pid 1021291 00:22:28.262 08:30:14 -- common/autotest_common.sh@955 -- # kill 1021291 00:22:28.262 08:30:14 -- common/autotest_common.sh@960 -- # wait 1021291 00:22:28.829 08:30:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:28.829 08:30:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:28.829 08:30:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:28.829 08:30:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:28.829 08:30:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:28.829 08:30:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.829 08:30:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.829 08:30:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.732 08:30:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:30.732 08:30:16 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:30.732 00:22:30.732 real 0m45.039s 00:22:30.732 user 2m37.589s 00:22:30.732 sys 0m10.166s 00:22:30.732 08:30:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:30.732 08:30:16 -- common/autotest_common.sh@10 -- # set +x 00:22:30.732 ************************************ 00:22:30.732 END TEST nvmf_perf_adq 00:22:30.732 ************************************ 00:22:30.732 08:30:16 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:30.732 08:30:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:30.732 08:30:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.732 08:30:16 -- common/autotest_common.sh@10 -- # set +x 00:22:30.732 ************************************ 00:22:30.732 START TEST nvmf_shutdown 00:22:30.732 ************************************ 00:22:30.732 08:30:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:30.732 * Looking for test storage... 00:22:30.732 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:30.732 08:30:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:30.732 08:30:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:30.732 08:30:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:30.991 08:30:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:30.991 08:30:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:30.991 08:30:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:30.991 08:30:16 -- scripts/common.sh@335 -- # IFS=.-: 00:22:30.991 08:30:16 -- scripts/common.sh@335 -- # read -ra ver1 00:22:30.991 08:30:16 -- scripts/common.sh@336 -- # IFS=.-: 00:22:30.991 08:30:16 -- scripts/common.sh@336 -- # read -ra ver2 00:22:30.991 08:30:16 -- scripts/common.sh@337 -- # local 'op=<' 00:22:30.991 08:30:16 -- scripts/common.sh@339 -- # ver1_l=2 00:22:30.991 08:30:16 -- scripts/common.sh@340 -- # ver2_l=1 00:22:30.991 08:30:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:30.991 08:30:16 -- scripts/common.sh@343 -- # case "$op" in 00:22:30.991 08:30:16 -- scripts/common.sh@344 -- # : 1 00:22:30.991 08:30:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:30.991 08:30:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:30.991 08:30:16 -- scripts/common.sh@364 -- # decimal 1 00:22:30.991 08:30:16 -- scripts/common.sh@352 -- # local d=1 00:22:30.991 08:30:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:30.991 08:30:16 -- scripts/common.sh@354 -- # echo 1 00:22:30.991 08:30:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:30.991 08:30:16 -- scripts/common.sh@365 -- # decimal 2 00:22:30.991 08:30:16 -- scripts/common.sh@352 -- # local d=2 00:22:30.991 08:30:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:30.991 08:30:16 -- scripts/common.sh@354 -- # echo 2 00:22:30.991 08:30:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:30.991 08:30:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:30.991 08:30:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:30.991 08:30:16 -- scripts/common.sh@367 -- # return 0 00:22:30.991 08:30:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:30.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.991 --rc genhtml_branch_coverage=1 00:22:30.991 --rc genhtml_function_coverage=1 00:22:30.991 --rc genhtml_legend=1 00:22:30.991 --rc geninfo_all_blocks=1 00:22:30.991 --rc geninfo_unexecuted_blocks=1 00:22:30.991 00:22:30.991 ' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:30.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.991 --rc genhtml_branch_coverage=1 00:22:30.991 --rc genhtml_function_coverage=1 00:22:30.991 --rc genhtml_legend=1 00:22:30.991 --rc geninfo_all_blocks=1 00:22:30.991 --rc geninfo_unexecuted_blocks=1 00:22:30.991 00:22:30.991 ' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:30.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.991 --rc genhtml_branch_coverage=1 00:22:30.991 --rc genhtml_function_coverage=1 00:22:30.991 --rc genhtml_legend=1 00:22:30.991 --rc geninfo_all_blocks=1 00:22:30.991 --rc geninfo_unexecuted_blocks=1 00:22:30.991 00:22:30.991 ' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:30.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.991 --rc genhtml_branch_coverage=1 00:22:30.991 --rc genhtml_function_coverage=1 00:22:30.991 --rc genhtml_legend=1 00:22:30.991 --rc geninfo_all_blocks=1 00:22:30.991 --rc geninfo_unexecuted_blocks=1 00:22:30.991 00:22:30.991 ' 00:22:30.991 08:30:16 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:30.991 08:30:16 -- nvmf/common.sh@7 -- # uname -s 00:22:30.991 08:30:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:30.991 08:30:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:30.991 08:30:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:30.991 08:30:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:30.991 08:30:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:30.991 08:30:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:30.991 08:30:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:30.991 08:30:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:30.991 08:30:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:30.991 08:30:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:30.991 08:30:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.991 08:30:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.991 08:30:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:30.991 08:30:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:30.991 08:30:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:30.991 08:30:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:30.991 08:30:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:30.991 08:30:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:30.991 08:30:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:30.991 08:30:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.991 08:30:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.991 08:30:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.991 08:30:16 -- paths/export.sh@5 -- # export PATH 00:22:30.991 08:30:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.991 08:30:16 -- nvmf/common.sh@46 -- # : 0 00:22:30.991 08:30:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:30.991 08:30:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:30.991 08:30:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:30.991 08:30:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:30.991 08:30:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:30.991 08:30:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:30.991 08:30:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:30.991 08:30:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:30.991 08:30:16 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:30.991 08:30:16 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:30.991 08:30:16 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:30.991 08:30:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:30.991 08:30:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.991 08:30:16 -- common/autotest_common.sh@10 -- # set +x 00:22:30.991 ************************************ 00:22:30.991 START TEST nvmf_shutdown_tc1 00:22:30.991 ************************************ 00:22:30.991 08:30:16 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:30.991 08:30:16 -- target/shutdown.sh@74 -- # starttarget 00:22:30.991 08:30:16 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:30.991 08:30:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:30.992 08:30:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:30.992 08:30:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:30.992 08:30:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:30.992 08:30:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:30.992 08:30:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.992 08:30:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.992 08:30:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.992 08:30:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:30.992 08:30:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:30.992 08:30:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:30.992 08:30:16 -- common/autotest_common.sh@10 -- # set +x 00:22:32.895 08:30:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:32.895 08:30:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:32.895 08:30:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:32.895 08:30:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:32.895 08:30:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:32.895 08:30:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:32.895 08:30:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:32.895 08:30:18 -- nvmf/common.sh@294 -- # net_devs=() 00:22:32.895 08:30:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:32.895 08:30:18 -- nvmf/common.sh@295 -- # e810=() 00:22:32.895 08:30:18 -- nvmf/common.sh@295 -- # local -ga e810 00:22:32.895 08:30:18 -- nvmf/common.sh@296 -- # x722=() 00:22:32.895 08:30:18 -- nvmf/common.sh@296 -- # local -ga x722 00:22:32.895 08:30:18 -- nvmf/common.sh@297 -- # mlx=() 00:22:32.895 08:30:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:32.895 08:30:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:32.895 08:30:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:32.895 08:30:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:32.895 08:30:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.895 08:30:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:32.895 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:32.895 08:30:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.895 08:30:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:32.895 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:32.895 08:30:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.895 08:30:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.895 08:30:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.895 08:30:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:32.895 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:32.895 08:30:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.895 08:30:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.895 08:30:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.895 08:30:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.895 08:30:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:32.895 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:32.895 08:30:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.895 08:30:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:32.895 08:30:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:32.895 08:30:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:32.895 08:30:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:32.895 08:30:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:32.895 08:30:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:32.895 08:30:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:32.895 08:30:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:32.895 08:30:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:32.895 08:30:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:32.895 08:30:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:32.895 08:30:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:32.895 08:30:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:32.895 08:30:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:32.895 08:30:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:32.895 08:30:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:33.153 08:30:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:33.153 08:30:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:33.153 08:30:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:33.153 08:30:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:33.153 08:30:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:33.153 08:30:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:33.153 08:30:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:33.153 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:33.153 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:22:33.153 00:22:33.153 --- 10.0.0.2 ping statistics --- 00:22:33.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.153 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:22:33.153 08:30:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:33.153 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:33.153 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.189 ms 00:22:33.153 00:22:33.153 --- 10.0.0.1 ping statistics --- 00:22:33.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.153 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:22:33.153 08:30:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:33.153 08:30:18 -- nvmf/common.sh@410 -- # return 0 00:22:33.153 08:30:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:33.153 08:30:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:33.153 08:30:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:33.153 08:30:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:33.153 08:30:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:33.153 08:30:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:33.153 08:30:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:33.153 08:30:18 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:33.153 08:30:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:33.153 08:30:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:33.154 08:30:18 -- common/autotest_common.sh@10 -- # set +x 00:22:33.154 08:30:18 -- nvmf/common.sh@469 -- # nvmfpid=1025040 00:22:33.154 08:30:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:33.154 08:30:18 -- nvmf/common.sh@470 -- # waitforlisten 1025040 00:22:33.154 08:30:18 -- common/autotest_common.sh@829 -- # '[' -z 1025040 ']' 00:22:33.154 08:30:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:33.154 08:30:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:33.154 08:30:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:33.154 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:33.154 08:30:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:33.154 08:30:18 -- common/autotest_common.sh@10 -- # set +x 00:22:33.154 [2024-11-26 08:30:18.902491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.154 [2024-11-26 08:30:18.902573] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:33.154 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.154 [2024-11-26 08:30:18.967790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:33.413 [2024-11-26 08:30:19.085233] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:33.413 [2024-11-26 08:30:19.085374] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:33.413 [2024-11-26 08:30:19.085391] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:33.413 [2024-11-26 08:30:19.085403] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:33.413 [2024-11-26 08:30:19.085462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:33.413 [2024-11-26 08:30:19.085496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:33.413 [2024-11-26 08:30:19.085526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:33.413 [2024-11-26 08:30:19.085528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:34.350 08:30:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:34.350 08:30:19 -- common/autotest_common.sh@862 -- # return 0 00:22:34.350 08:30:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:34.350 08:30:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:34.350 08:30:19 -- common/autotest_common.sh@10 -- # set +x 00:22:34.350 08:30:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:34.350 08:30:19 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:34.350 08:30:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.350 08:30:19 -- common/autotest_common.sh@10 -- # set +x 00:22:34.350 [2024-11-26 08:30:19.884193] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:34.350 08:30:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.350 08:30:19 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:34.350 08:30:19 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:34.350 08:30:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:34.350 08:30:19 -- common/autotest_common.sh@10 -- # set +x 00:22:34.350 08:30:19 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:34.350 08:30:19 -- target/shutdown.sh@28 -- # cat 00:22:34.350 08:30:19 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:34.350 08:30:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.350 08:30:19 -- common/autotest_common.sh@10 -- # set +x 00:22:34.350 Malloc1 00:22:34.350 [2024-11-26 08:30:19.973443] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:34.350 Malloc2 00:22:34.350 Malloc3 00:22:34.350 Malloc4 00:22:34.350 Malloc5 00:22:34.350 Malloc6 00:22:34.608 Malloc7 00:22:34.608 Malloc8 00:22:34.608 Malloc9 00:22:34.608 Malloc10 00:22:34.608 08:30:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.608 08:30:20 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:34.608 08:30:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:34.608 08:30:20 -- common/autotest_common.sh@10 -- # set +x 00:22:34.608 08:30:20 -- target/shutdown.sh@78 -- # perfpid=1025358 00:22:34.608 08:30:20 -- target/shutdown.sh@79 -- # waitforlisten 1025358 /var/tmp/bdevperf.sock 00:22:34.608 08:30:20 -- common/autotest_common.sh@829 -- # '[' -z 1025358 ']' 00:22:34.608 08:30:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:34.608 08:30:20 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:34.608 08:30:20 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:34.608 08:30:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:34.608 08:30:20 -- nvmf/common.sh@520 -- # config=() 00:22:34.608 08:30:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:34.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:34.608 08:30:20 -- nvmf/common.sh@520 -- # local subsystem config 00:22:34.608 08:30:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:34.608 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.609 08:30:20 -- common/autotest_common.sh@10 -- # set +x 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.609 { 00:22:34.609 "params": { 00:22:34.609 "name": "Nvme$subsystem", 00:22:34.609 "trtype": "$TEST_TRANSPORT", 00:22:34.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.609 "adrfam": "ipv4", 00:22:34.609 "trsvcid": "$NVMF_PORT", 00:22:34.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.609 "hdgst": ${hdgst:-false}, 00:22:34.609 "ddgst": ${ddgst:-false} 00:22:34.609 }, 00:22:34.609 "method": "bdev_nvme_attach_controller" 00:22:34.609 } 00:22:34.609 EOF 00:22:34.609 )") 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.609 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.609 { 00:22:34.609 "params": { 00:22:34.609 "name": "Nvme$subsystem", 00:22:34.609 "trtype": "$TEST_TRANSPORT", 00:22:34.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.609 "adrfam": "ipv4", 00:22:34.609 "trsvcid": "$NVMF_PORT", 00:22:34.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.609 "hdgst": ${hdgst:-false}, 00:22:34.609 "ddgst": ${ddgst:-false} 00:22:34.609 }, 00:22:34.609 "method": "bdev_nvme_attach_controller" 00:22:34.609 } 00:22:34.609 EOF 00:22:34.609 )") 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.609 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.609 { 00:22:34.609 "params": { 00:22:34.609 "name": "Nvme$subsystem", 00:22:34.609 "trtype": "$TEST_TRANSPORT", 00:22:34.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.609 "adrfam": "ipv4", 00:22:34.609 "trsvcid": "$NVMF_PORT", 00:22:34.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.609 "hdgst": ${hdgst:-false}, 00:22:34.609 "ddgst": ${ddgst:-false} 00:22:34.609 }, 00:22:34.609 "method": "bdev_nvme_attach_controller" 00:22:34.609 } 00:22:34.609 EOF 00:22:34.609 )") 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.609 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.609 { 00:22:34.609 "params": { 00:22:34.609 "name": "Nvme$subsystem", 00:22:34.609 "trtype": "$TEST_TRANSPORT", 00:22:34.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.609 "adrfam": "ipv4", 00:22:34.609 "trsvcid": "$NVMF_PORT", 00:22:34.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.609 "hdgst": ${hdgst:-false}, 00:22:34.609 "ddgst": ${ddgst:-false} 00:22:34.609 }, 00:22:34.609 "method": "bdev_nvme_attach_controller" 00:22:34.609 } 00:22:34.609 EOF 00:22:34.609 )") 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.609 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.609 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.609 { 00:22:34.609 "params": { 00:22:34.609 "name": "Nvme$subsystem", 00:22:34.609 "trtype": "$TEST_TRANSPORT", 00:22:34.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.609 "adrfam": "ipv4", 00:22:34.609 "trsvcid": "$NVMF_PORT", 00:22:34.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.609 "hdgst": ${hdgst:-false}, 00:22:34.609 "ddgst": ${ddgst:-false} 00:22:34.609 }, 00:22:34.609 "method": "bdev_nvme_attach_controller" 00:22:34.609 } 00:22:34.609 EOF 00:22:34.609 )") 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.867 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.867 { 00:22:34.867 "params": { 00:22:34.867 "name": "Nvme$subsystem", 00:22:34.867 "trtype": "$TEST_TRANSPORT", 00:22:34.867 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.867 "adrfam": "ipv4", 00:22:34.867 "trsvcid": "$NVMF_PORT", 00:22:34.867 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.867 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.867 "hdgst": ${hdgst:-false}, 00:22:34.867 "ddgst": ${ddgst:-false} 00:22:34.867 }, 00:22:34.867 "method": "bdev_nvme_attach_controller" 00:22:34.867 } 00:22:34.867 EOF 00:22:34.867 )") 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.867 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.867 { 00:22:34.867 "params": { 00:22:34.867 "name": "Nvme$subsystem", 00:22:34.867 "trtype": "$TEST_TRANSPORT", 00:22:34.867 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.867 "adrfam": "ipv4", 00:22:34.867 "trsvcid": "$NVMF_PORT", 00:22:34.867 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.867 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.867 "hdgst": ${hdgst:-false}, 00:22:34.867 "ddgst": ${ddgst:-false} 00:22:34.867 }, 00:22:34.867 "method": "bdev_nvme_attach_controller" 00:22:34.867 } 00:22:34.867 EOF 00:22:34.867 )") 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.867 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.867 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.868 { 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme$subsystem", 00:22:34.868 "trtype": "$TEST_TRANSPORT", 00:22:34.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "$NVMF_PORT", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.868 "hdgst": ${hdgst:-false}, 00:22:34.868 "ddgst": ${ddgst:-false} 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 } 00:22:34.868 EOF 00:22:34.868 )") 00:22:34.868 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.868 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.868 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.868 { 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme$subsystem", 00:22:34.868 "trtype": "$TEST_TRANSPORT", 00:22:34.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "$NVMF_PORT", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.868 "hdgst": ${hdgst:-false}, 00:22:34.868 "ddgst": ${ddgst:-false} 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 } 00:22:34.868 EOF 00:22:34.868 )") 00:22:34.868 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.868 08:30:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.868 08:30:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.868 { 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme$subsystem", 00:22:34.868 "trtype": "$TEST_TRANSPORT", 00:22:34.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "$NVMF_PORT", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.868 "hdgst": ${hdgst:-false}, 00:22:34.868 "ddgst": ${ddgst:-false} 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 } 00:22:34.868 EOF 00:22:34.868 )") 00:22:34.868 08:30:20 -- nvmf/common.sh@542 -- # cat 00:22:34.868 08:30:20 -- nvmf/common.sh@544 -- # jq . 00:22:34.868 08:30:20 -- nvmf/common.sh@545 -- # IFS=, 00:22:34.868 08:30:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme1", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme2", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme3", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme4", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme5", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme6", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme7", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme8", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme9", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 },{ 00:22:34.868 "params": { 00:22:34.868 "name": "Nvme10", 00:22:34.868 "trtype": "tcp", 00:22:34.868 "traddr": "10.0.0.2", 00:22:34.868 "adrfam": "ipv4", 00:22:34.868 "trsvcid": "4420", 00:22:34.868 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:34.868 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:34.868 "hdgst": false, 00:22:34.868 "ddgst": false 00:22:34.868 }, 00:22:34.868 "method": "bdev_nvme_attach_controller" 00:22:34.868 }' 00:22:34.868 [2024-11-26 08:30:20.487854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:34.868 [2024-11-26 08:30:20.487929] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:34.868 EAL: No free 2048 kB hugepages reported on node 1 00:22:34.868 [2024-11-26 08:30:20.556396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:34.868 [2024-11-26 08:30:20.665563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:36.773 08:30:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:36.773 08:30:22 -- common/autotest_common.sh@862 -- # return 0 00:22:36.773 08:30:22 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:36.773 08:30:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.773 08:30:22 -- common/autotest_common.sh@10 -- # set +x 00:22:36.773 08:30:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.773 08:30:22 -- target/shutdown.sh@83 -- # kill -9 1025358 00:22:36.773 08:30:22 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:36.773 08:30:22 -- target/shutdown.sh@87 -- # sleep 1 00:22:37.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1025358 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:37.711 08:30:23 -- target/shutdown.sh@88 -- # kill -0 1025040 00:22:37.711 08:30:23 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:37.711 08:30:23 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:37.711 08:30:23 -- nvmf/common.sh@520 -- # config=() 00:22:37.711 08:30:23 -- nvmf/common.sh@520 -- # local subsystem config 00:22:37.711 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.711 { 00:22:37.711 "params": { 00:22:37.711 "name": "Nvme$subsystem", 00:22:37.711 "trtype": "$TEST_TRANSPORT", 00:22:37.711 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.711 "adrfam": "ipv4", 00:22:37.711 "trsvcid": "$NVMF_PORT", 00:22:37.711 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.711 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.711 "hdgst": ${hdgst:-false}, 00:22:37.711 "ddgst": ${ddgst:-false} 00:22:37.711 }, 00:22:37.711 "method": "bdev_nvme_attach_controller" 00:22:37.711 } 00:22:37.711 EOF 00:22:37.711 )") 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.711 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.711 { 00:22:37.711 "params": { 00:22:37.711 "name": "Nvme$subsystem", 00:22:37.711 "trtype": "$TEST_TRANSPORT", 00:22:37.711 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.711 "adrfam": "ipv4", 00:22:37.711 "trsvcid": "$NVMF_PORT", 00:22:37.711 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.711 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.711 "hdgst": ${hdgst:-false}, 00:22:37.711 "ddgst": ${ddgst:-false} 00:22:37.711 }, 00:22:37.711 "method": "bdev_nvme_attach_controller" 00:22:37.711 } 00:22:37.711 EOF 00:22:37.711 )") 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.711 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.711 { 00:22:37.711 "params": { 00:22:37.711 "name": "Nvme$subsystem", 00:22:37.711 "trtype": "$TEST_TRANSPORT", 00:22:37.711 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.711 "adrfam": "ipv4", 00:22:37.711 "trsvcid": "$NVMF_PORT", 00:22:37.711 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.711 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.711 "hdgst": ${hdgst:-false}, 00:22:37.711 "ddgst": ${ddgst:-false} 00:22:37.711 }, 00:22:37.711 "method": "bdev_nvme_attach_controller" 00:22:37.711 } 00:22:37.711 EOF 00:22:37.711 )") 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.711 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.711 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.711 { 00:22:37.711 "params": { 00:22:37.711 "name": "Nvme$subsystem", 00:22:37.711 "trtype": "$TEST_TRANSPORT", 00:22:37.711 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.711 "adrfam": "ipv4", 00:22:37.711 "trsvcid": "$NVMF_PORT", 00:22:37.711 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.711 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.711 "hdgst": ${hdgst:-false}, 00:22:37.711 "ddgst": ${ddgst:-false} 00:22:37.711 }, 00:22:37.711 "method": "bdev_nvme_attach_controller" 00:22:37.711 } 00:22:37.711 EOF 00:22:37.711 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:37.712 { 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme$subsystem", 00:22:37.712 "trtype": "$TEST_TRANSPORT", 00:22:37.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "$NVMF_PORT", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.712 "hdgst": ${hdgst:-false}, 00:22:37.712 "ddgst": ${ddgst:-false} 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 } 00:22:37.712 EOF 00:22:37.712 )") 00:22:37.712 08:30:23 -- nvmf/common.sh@542 -- # cat 00:22:37.712 08:30:23 -- nvmf/common.sh@544 -- # jq . 00:22:37.712 08:30:23 -- nvmf/common.sh@545 -- # IFS=, 00:22:37.712 08:30:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme1", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme2", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme3", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme4", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme5", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme6", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme7", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme8", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme9", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.712 "method": "bdev_nvme_attach_controller" 00:22:37.712 },{ 00:22:37.712 "params": { 00:22:37.712 "name": "Nvme10", 00:22:37.712 "trtype": "tcp", 00:22:37.712 "traddr": "10.0.0.2", 00:22:37.712 "adrfam": "ipv4", 00:22:37.712 "trsvcid": "4420", 00:22:37.712 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:37.712 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:37.712 "hdgst": false, 00:22:37.712 "ddgst": false 00:22:37.712 }, 00:22:37.713 "method": "bdev_nvme_attach_controller" 00:22:37.713 }' 00:22:37.713 [2024-11-26 08:30:23.308370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:37.713 [2024-11-26 08:30:23.308454] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025670 ] 00:22:37.713 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.713 [2024-11-26 08:30:23.372053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:37.713 [2024-11-26 08:30:23.483038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.616 Running I/O for 1 seconds... 00:22:40.552 00:22:40.552 Latency(us) 00:22:40.552 [2024-11-26T07:30:26.412Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme1n1 : 1.09 399.01 24.94 0.00 0.00 157605.75 18252.99 140586.86 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme2n1 : 1.06 377.21 23.58 0.00 0.00 165194.64 10922.67 165441.99 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme3n1 : 1.07 405.11 25.32 0.00 0.00 152550.56 22136.60 122722.23 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme4n1 : 1.08 402.19 25.14 0.00 0.00 152807.60 19029.71 119615.34 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme5n1 : 1.08 400.27 25.02 0.00 0.00 152393.96 20680.25 123498.95 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme6n1 : 1.08 371.72 23.23 0.00 0.00 161861.51 5509.88 136703.24 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme7n1 : 1.09 398.28 24.89 0.00 0.00 151447.22 16408.27 119615.34 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme8n1 : 1.09 397.49 24.84 0.00 0.00 150888.61 14369.37 121945.51 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme9n1 : 1.09 396.79 24.80 0.00 0.00 150425.81 11699.39 122722.23 00:22:40.552 [2024-11-26T07:30:26.412Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.552 Verification LBA range: start 0x0 length 0x400 00:22:40.552 Nvme10n1 : 1.10 394.34 24.65 0.00 0.00 151296.35 3470.98 147577.36 00:22:40.552 [2024-11-26T07:30:26.412Z] =================================================================================================================== 00:22:40.552 [2024-11-26T07:30:26.412Z] Total : 3942.42 246.40 0.00 0.00 154503.34 3470.98 165441.99 00:22:40.813 08:30:26 -- target/shutdown.sh@93 -- # stoptarget 00:22:40.813 08:30:26 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:40.813 08:30:26 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:40.813 08:30:26 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:40.813 08:30:26 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:40.813 08:30:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:40.813 08:30:26 -- nvmf/common.sh@116 -- # sync 00:22:40.813 08:30:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:40.813 08:30:26 -- nvmf/common.sh@119 -- # set +e 00:22:40.813 08:30:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:40.813 08:30:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:40.814 rmmod nvme_tcp 00:22:40.814 rmmod nvme_fabrics 00:22:40.814 rmmod nvme_keyring 00:22:40.814 08:30:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:40.814 08:30:26 -- nvmf/common.sh@123 -- # set -e 00:22:40.814 08:30:26 -- nvmf/common.sh@124 -- # return 0 00:22:40.814 08:30:26 -- nvmf/common.sh@477 -- # '[' -n 1025040 ']' 00:22:40.814 08:30:26 -- nvmf/common.sh@478 -- # killprocess 1025040 00:22:40.814 08:30:26 -- common/autotest_common.sh@936 -- # '[' -z 1025040 ']' 00:22:40.814 08:30:26 -- common/autotest_common.sh@940 -- # kill -0 1025040 00:22:40.814 08:30:26 -- common/autotest_common.sh@941 -- # uname 00:22:40.814 08:30:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:40.814 08:30:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1025040 00:22:40.814 08:30:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:40.814 08:30:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:40.814 08:30:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1025040' 00:22:40.814 killing process with pid 1025040 00:22:40.814 08:30:26 -- common/autotest_common.sh@955 -- # kill 1025040 00:22:40.814 08:30:26 -- common/autotest_common.sh@960 -- # wait 1025040 00:22:41.382 08:30:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:41.382 08:30:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:41.382 08:30:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:41.382 08:30:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:41.382 08:30:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:41.382 08:30:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:41.382 08:30:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:41.382 08:30:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.285 08:30:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:43.285 00:22:43.285 real 0m12.491s 00:22:43.285 user 0m36.781s 00:22:43.285 sys 0m3.341s 00:22:43.285 08:30:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:43.285 08:30:29 -- common/autotest_common.sh@10 -- # set +x 00:22:43.285 ************************************ 00:22:43.285 END TEST nvmf_shutdown_tc1 00:22:43.285 ************************************ 00:22:43.559 08:30:29 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:43.559 08:30:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:43.559 08:30:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:43.559 08:30:29 -- common/autotest_common.sh@10 -- # set +x 00:22:43.559 ************************************ 00:22:43.559 START TEST nvmf_shutdown_tc2 00:22:43.559 ************************************ 00:22:43.559 08:30:29 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:43.559 08:30:29 -- target/shutdown.sh@98 -- # starttarget 00:22:43.559 08:30:29 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:43.559 08:30:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:43.559 08:30:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:43.559 08:30:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:43.559 08:30:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:43.559 08:30:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:43.559 08:30:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.559 08:30:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.559 08:30:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.559 08:30:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:43.559 08:30:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:43.559 08:30:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:43.559 08:30:29 -- common/autotest_common.sh@10 -- # set +x 00:22:43.560 08:30:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:43.560 08:30:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:43.560 08:30:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:43.560 08:30:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:43.560 08:30:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:43.560 08:30:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:43.560 08:30:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:43.560 08:30:29 -- nvmf/common.sh@294 -- # net_devs=() 00:22:43.560 08:30:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:43.560 08:30:29 -- nvmf/common.sh@295 -- # e810=() 00:22:43.560 08:30:29 -- nvmf/common.sh@295 -- # local -ga e810 00:22:43.560 08:30:29 -- nvmf/common.sh@296 -- # x722=() 00:22:43.560 08:30:29 -- nvmf/common.sh@296 -- # local -ga x722 00:22:43.560 08:30:29 -- nvmf/common.sh@297 -- # mlx=() 00:22:43.560 08:30:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:43.560 08:30:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:43.560 08:30:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:43.560 08:30:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:43.560 08:30:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:43.560 08:30:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:43.560 08:30:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:43.560 08:30:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:43.560 08:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.560 08:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:43.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:43.561 08:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.561 08:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:43.561 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:43.561 08:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.561 08:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:43.562 08:30:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.562 08:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.562 08:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.562 08:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.562 08:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:43.562 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:43.562 08:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.562 08:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.562 08:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.562 08:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.562 08:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.562 08:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:43.562 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:43.562 08:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.562 08:30:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:43.562 08:30:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:43.562 08:30:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:43.562 08:30:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:43.562 08:30:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:43.562 08:30:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:43.562 08:30:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:43.562 08:30:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:43.562 08:30:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:43.564 08:30:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:43.564 08:30:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:43.564 08:30:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:43.564 08:30:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:43.564 08:30:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:43.564 08:30:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:43.564 08:30:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:43.564 08:30:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:43.564 08:30:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:43.564 08:30:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:43.564 08:30:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:43.564 08:30:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:43.564 08:30:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:43.564 08:30:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:43.564 08:30:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:43.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:43.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:22:43.564 00:22:43.564 --- 10.0.0.2 ping statistics --- 00:22:43.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.564 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:22:43.564 08:30:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:43.564 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:43.564 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:22:43.564 00:22:43.564 --- 10.0.0.1 ping statistics --- 00:22:43.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.564 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:22:43.564 08:30:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:43.564 08:30:29 -- nvmf/common.sh@410 -- # return 0 00:22:43.564 08:30:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:43.564 08:30:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:43.564 08:30:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:43.564 08:30:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:43.564 08:30:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:43.564 08:30:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:43.564 08:30:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:43.564 08:30:29 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:43.564 08:30:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:43.564 08:30:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:43.564 08:30:29 -- common/autotest_common.sh@10 -- # set +x 00:22:43.564 08:30:29 -- nvmf/common.sh@469 -- # nvmfpid=1026576 00:22:43.564 08:30:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:43.564 08:30:29 -- nvmf/common.sh@470 -- # waitforlisten 1026576 00:22:43.564 08:30:29 -- common/autotest_common.sh@829 -- # '[' -z 1026576 ']' 00:22:43.564 08:30:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:43.564 08:30:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:43.564 08:30:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:43.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:43.564 08:30:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:43.564 08:30:29 -- common/autotest_common.sh@10 -- # set +x 00:22:43.824 [2024-11-26 08:30:29.434925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:43.824 [2024-11-26 08:30:29.435006] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:43.824 EAL: No free 2048 kB hugepages reported on node 1 00:22:43.824 [2024-11-26 08:30:29.506637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:43.824 [2024-11-26 08:30:29.623586] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:43.824 [2024-11-26 08:30:29.623758] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:43.824 [2024-11-26 08:30:29.623779] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:43.824 [2024-11-26 08:30:29.623801] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:43.824 [2024-11-26 08:30:29.623898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:43.824 [2024-11-26 08:30:29.623995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:43.824 [2024-11-26 08:30:29.624025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:43.824 [2024-11-26 08:30:29.624028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:44.761 08:30:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:44.761 08:30:30 -- common/autotest_common.sh@862 -- # return 0 00:22:44.761 08:30:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:44.761 08:30:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.761 08:30:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.761 08:30:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:44.761 08:30:30 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:44.761 08:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.761 08:30:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.761 [2024-11-26 08:30:30.467355] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:44.761 08:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.761 08:30:30 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:44.761 08:30:30 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:44.761 08:30:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.761 08:30:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.761 08:30:30 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.761 08:30:30 -- target/shutdown.sh@28 -- # cat 00:22:44.761 08:30:30 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:44.761 08:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.761 08:30:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.761 Malloc1 00:22:44.761 [2024-11-26 08:30:30.552401] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:44.761 Malloc2 00:22:45.020 Malloc3 00:22:45.020 Malloc4 00:22:45.020 Malloc5 00:22:45.020 Malloc6 00:22:45.020 Malloc7 00:22:45.020 Malloc8 00:22:45.278 Malloc9 00:22:45.278 Malloc10 00:22:45.278 08:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.278 08:30:30 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:45.278 08:30:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.278 08:30:30 -- common/autotest_common.sh@10 -- # set +x 00:22:45.278 08:30:31 -- target/shutdown.sh@102 -- # perfpid=1026769 00:22:45.278 08:30:31 -- target/shutdown.sh@103 -- # waitforlisten 1026769 /var/tmp/bdevperf.sock 00:22:45.278 08:30:31 -- common/autotest_common.sh@829 -- # '[' -z 1026769 ']' 00:22:45.278 08:30:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:45.278 08:30:31 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:45.278 08:30:31 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:45.278 08:30:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:45.278 08:30:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:45.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:45.278 08:30:31 -- nvmf/common.sh@520 -- # config=() 00:22:45.278 08:30:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:45.278 08:30:31 -- nvmf/common.sh@520 -- # local subsystem config 00:22:45.278 08:30:31 -- common/autotest_common.sh@10 -- # set +x 00:22:45.278 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.278 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.278 { 00:22:45.278 "params": { 00:22:45.278 "name": "Nvme$subsystem", 00:22:45.278 "trtype": "$TEST_TRANSPORT", 00:22:45.278 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.278 "adrfam": "ipv4", 00:22:45.278 "trsvcid": "$NVMF_PORT", 00:22:45.278 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.278 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.278 "hdgst": ${hdgst:-false}, 00:22:45.278 "ddgst": ${ddgst:-false} 00:22:45.278 }, 00:22:45.278 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:45.279 { 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme$subsystem", 00:22:45.279 "trtype": "$TEST_TRANSPORT", 00:22:45.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "$NVMF_PORT", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.279 "hdgst": ${hdgst:-false}, 00:22:45.279 "ddgst": ${ddgst:-false} 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 } 00:22:45.279 EOF 00:22:45.279 )") 00:22:45.279 08:30:31 -- nvmf/common.sh@542 -- # cat 00:22:45.279 08:30:31 -- nvmf/common.sh@544 -- # jq . 00:22:45.279 08:30:31 -- nvmf/common.sh@545 -- # IFS=, 00:22:45.279 08:30:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme1", 00:22:45.279 "trtype": "tcp", 00:22:45.279 "traddr": "10.0.0.2", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "4420", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:45.279 "hdgst": false, 00:22:45.279 "ddgst": false 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 },{ 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme2", 00:22:45.279 "trtype": "tcp", 00:22:45.279 "traddr": "10.0.0.2", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "4420", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:45.279 "hdgst": false, 00:22:45.279 "ddgst": false 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 },{ 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme3", 00:22:45.279 "trtype": "tcp", 00:22:45.279 "traddr": "10.0.0.2", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "4420", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:45.279 "hdgst": false, 00:22:45.279 "ddgst": false 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 },{ 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme4", 00:22:45.279 "trtype": "tcp", 00:22:45.279 "traddr": "10.0.0.2", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "4420", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:45.279 "hdgst": false, 00:22:45.279 "ddgst": false 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 },{ 00:22:45.279 "params": { 00:22:45.279 "name": "Nvme5", 00:22:45.279 "trtype": "tcp", 00:22:45.279 "traddr": "10.0.0.2", 00:22:45.279 "adrfam": "ipv4", 00:22:45.279 "trsvcid": "4420", 00:22:45.279 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:45.279 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:45.279 "hdgst": false, 00:22:45.279 "ddgst": false 00:22:45.279 }, 00:22:45.279 "method": "bdev_nvme_attach_controller" 00:22:45.279 },{ 00:22:45.279 "params": { 00:22:45.280 "name": "Nvme6", 00:22:45.280 "trtype": "tcp", 00:22:45.280 "traddr": "10.0.0.2", 00:22:45.280 "adrfam": "ipv4", 00:22:45.280 "trsvcid": "4420", 00:22:45.280 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:45.280 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:45.280 "hdgst": false, 00:22:45.280 "ddgst": false 00:22:45.280 }, 00:22:45.280 "method": "bdev_nvme_attach_controller" 00:22:45.280 },{ 00:22:45.280 "params": { 00:22:45.280 "name": "Nvme7", 00:22:45.280 "trtype": "tcp", 00:22:45.280 "traddr": "10.0.0.2", 00:22:45.280 "adrfam": "ipv4", 00:22:45.280 "trsvcid": "4420", 00:22:45.280 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:45.280 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:45.280 "hdgst": false, 00:22:45.280 "ddgst": false 00:22:45.280 }, 00:22:45.280 "method": "bdev_nvme_attach_controller" 00:22:45.280 },{ 00:22:45.280 "params": { 00:22:45.280 "name": "Nvme8", 00:22:45.280 "trtype": "tcp", 00:22:45.280 "traddr": "10.0.0.2", 00:22:45.280 "adrfam": "ipv4", 00:22:45.280 "trsvcid": "4420", 00:22:45.280 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:45.280 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:45.280 "hdgst": false, 00:22:45.280 "ddgst": false 00:22:45.280 }, 00:22:45.280 "method": "bdev_nvme_attach_controller" 00:22:45.280 },{ 00:22:45.280 "params": { 00:22:45.280 "name": "Nvme9", 00:22:45.280 "trtype": "tcp", 00:22:45.280 "traddr": "10.0.0.2", 00:22:45.280 "adrfam": "ipv4", 00:22:45.280 "trsvcid": "4420", 00:22:45.280 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:45.280 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:45.280 "hdgst": false, 00:22:45.280 "ddgst": false 00:22:45.280 }, 00:22:45.280 "method": "bdev_nvme_attach_controller" 00:22:45.280 },{ 00:22:45.280 "params": { 00:22:45.280 "name": "Nvme10", 00:22:45.280 "trtype": "tcp", 00:22:45.280 "traddr": "10.0.0.2", 00:22:45.280 "adrfam": "ipv4", 00:22:45.280 "trsvcid": "4420", 00:22:45.280 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:45.280 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:45.280 "hdgst": false, 00:22:45.280 "ddgst": false 00:22:45.280 }, 00:22:45.280 "method": "bdev_nvme_attach_controller" 00:22:45.280 }' 00:22:45.280 [2024-11-26 08:30:31.048530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:45.280 [2024-11-26 08:30:31.048603] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026769 ] 00:22:45.280 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.280 [2024-11-26 08:30:31.112349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:45.540 [2024-11-26 08:30:31.220068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:47.444 Running I/O for 10 seconds... 00:22:47.717 08:30:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:47.717 08:30:33 -- common/autotest_common.sh@862 -- # return 0 00:22:47.717 08:30:33 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:47.717 08:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.717 08:30:33 -- common/autotest_common.sh@10 -- # set +x 00:22:47.717 08:30:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.717 08:30:33 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:47.717 08:30:33 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:47.717 08:30:33 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:47.717 08:30:33 -- target/shutdown.sh@57 -- # local ret=1 00:22:47.717 08:30:33 -- target/shutdown.sh@58 -- # local i 00:22:47.717 08:30:33 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:47.717 08:30:33 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:47.717 08:30:33 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:47.717 08:30:33 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:47.717 08:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.717 08:30:33 -- common/autotest_common.sh@10 -- # set +x 00:22:48.027 08:30:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.027 08:30:33 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:48.027 08:30:33 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:48.027 08:30:33 -- target/shutdown.sh@64 -- # ret=0 00:22:48.027 08:30:33 -- target/shutdown.sh@65 -- # break 00:22:48.027 08:30:33 -- target/shutdown.sh@69 -- # return 0 00:22:48.027 08:30:33 -- target/shutdown.sh@109 -- # killprocess 1026769 00:22:48.027 08:30:33 -- common/autotest_common.sh@936 -- # '[' -z 1026769 ']' 00:22:48.027 08:30:33 -- common/autotest_common.sh@940 -- # kill -0 1026769 00:22:48.027 08:30:33 -- common/autotest_common.sh@941 -- # uname 00:22:48.027 08:30:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:48.027 08:30:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1026769 00:22:48.027 08:30:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:48.027 08:30:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:48.027 08:30:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1026769' 00:22:48.027 killing process with pid 1026769 00:22:48.027 08:30:33 -- common/autotest_common.sh@955 -- # kill 1026769 00:22:48.027 08:30:33 -- common/autotest_common.sh@960 -- # wait 1026769 00:22:48.027 Received shutdown signal, test time was about 0.740947 seconds 00:22:48.027 00:22:48.027 Latency(us) 00:22:48.027 [2024-11-26T07:30:33.887Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:48.027 [2024-11-26T07:30:33.887Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.027 Verification LBA range: start 0x0 length 0x400 00:22:48.027 Nvme1n1 : 0.74 428.10 26.76 0.00 0.00 147111.79 10922.67 121945.51 00:22:48.027 [2024-11-26T07:30:33.887Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.027 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme2n1 : 0.71 381.08 23.82 0.00 0.00 161245.15 24175.50 135149.80 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme3n1 : 0.74 426.93 26.68 0.00 0.00 144433.18 10534.31 120392.06 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme4n1 : 0.74 425.62 26.60 0.00 0.00 143276.57 11747.93 118061.89 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme5n1 : 0.71 384.61 24.04 0.00 0.00 154524.86 23495.87 118838.61 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme6n1 : 0.72 376.86 23.55 0.00 0.00 155604.81 26602.76 125052.40 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme7n1 : 0.71 383.57 23.97 0.00 0.00 151661.76 22233.69 121945.51 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme8n1 : 0.72 379.89 23.74 0.00 0.00 151264.48 23592.96 122722.23 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme9n1 : 0.72 377.85 23.62 0.00 0.00 150481.33 22622.06 125052.40 00:22:48.028 [2024-11-26T07:30:33.888Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:48.028 Verification LBA range: start 0x0 length 0x400 00:22:48.028 Nvme10n1 : 0.73 372.24 23.27 0.00 0.00 151980.16 18738.44 127382.57 00:22:48.028 [2024-11-26T07:30:33.888Z] =================================================================================================================== 00:22:48.028 [2024-11-26T07:30:33.888Z] Total : 3936.77 246.05 0.00 0.00 150876.87 10534.31 135149.80 00:22:48.290 08:30:33 -- target/shutdown.sh@112 -- # sleep 1 00:22:49.224 08:30:34 -- target/shutdown.sh@113 -- # kill -0 1026576 00:22:49.224 08:30:34 -- target/shutdown.sh@115 -- # stoptarget 00:22:49.224 08:30:34 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:49.224 08:30:34 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:49.224 08:30:35 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:49.224 08:30:35 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:49.224 08:30:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:49.224 08:30:35 -- nvmf/common.sh@116 -- # sync 00:22:49.224 08:30:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:49.224 08:30:35 -- nvmf/common.sh@119 -- # set +e 00:22:49.224 08:30:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:49.224 08:30:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:49.224 rmmod nvme_tcp 00:22:49.224 rmmod nvme_fabrics 00:22:49.224 rmmod nvme_keyring 00:22:49.224 08:30:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:49.224 08:30:35 -- nvmf/common.sh@123 -- # set -e 00:22:49.224 08:30:35 -- nvmf/common.sh@124 -- # return 0 00:22:49.224 08:30:35 -- nvmf/common.sh@477 -- # '[' -n 1026576 ']' 00:22:49.224 08:30:35 -- nvmf/common.sh@478 -- # killprocess 1026576 00:22:49.224 08:30:35 -- common/autotest_common.sh@936 -- # '[' -z 1026576 ']' 00:22:49.224 08:30:35 -- common/autotest_common.sh@940 -- # kill -0 1026576 00:22:49.224 08:30:35 -- common/autotest_common.sh@941 -- # uname 00:22:49.224 08:30:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:49.224 08:30:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1026576 00:22:49.483 08:30:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:49.483 08:30:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:49.483 08:30:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1026576' 00:22:49.483 killing process with pid 1026576 00:22:49.483 08:30:35 -- common/autotest_common.sh@955 -- # kill 1026576 00:22:49.483 08:30:35 -- common/autotest_common.sh@960 -- # wait 1026576 00:22:50.053 08:30:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:50.053 08:30:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:50.053 08:30:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:50.053 08:30:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:50.053 08:30:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:50.053 08:30:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.053 08:30:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.053 08:30:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.956 08:30:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:51.956 00:22:51.956 real 0m8.539s 00:22:51.956 user 0m26.940s 00:22:51.956 sys 0m1.505s 00:22:51.956 08:30:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:51.956 08:30:37 -- common/autotest_common.sh@10 -- # set +x 00:22:51.956 ************************************ 00:22:51.956 END TEST nvmf_shutdown_tc2 00:22:51.956 ************************************ 00:22:51.956 08:30:37 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:51.956 08:30:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:51.956 08:30:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:51.956 08:30:37 -- common/autotest_common.sh@10 -- # set +x 00:22:51.956 ************************************ 00:22:51.956 START TEST nvmf_shutdown_tc3 00:22:51.956 ************************************ 00:22:51.956 08:30:37 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:51.956 08:30:37 -- target/shutdown.sh@120 -- # starttarget 00:22:51.956 08:30:37 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:51.956 08:30:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:51.956 08:30:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:51.956 08:30:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:51.956 08:30:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:51.956 08:30:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:51.956 08:30:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.956 08:30:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.956 08:30:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.956 08:30:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:51.956 08:30:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:51.956 08:30:37 -- common/autotest_common.sh@10 -- # set +x 00:22:51.956 08:30:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.956 08:30:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:51.956 08:30:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:51.956 08:30:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:51.956 08:30:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:51.956 08:30:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:51.956 08:30:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:51.956 08:30:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:51.956 08:30:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:51.956 08:30:37 -- nvmf/common.sh@295 -- # e810=() 00:22:51.956 08:30:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:51.956 08:30:37 -- nvmf/common.sh@296 -- # x722=() 00:22:51.956 08:30:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:51.956 08:30:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:51.956 08:30:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:51.956 08:30:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.956 08:30:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:51.956 08:30:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:51.956 08:30:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.956 08:30:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:51.956 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:51.956 08:30:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.956 08:30:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:51.956 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:51.956 08:30:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.956 08:30:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.956 08:30:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.956 08:30:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:51.956 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:51.956 08:30:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.956 08:30:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.956 08:30:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.956 08:30:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.956 08:30:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:51.956 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:51.956 08:30:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.956 08:30:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:51.956 08:30:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:51.956 08:30:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:51.956 08:30:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:51.956 08:30:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:51.956 08:30:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:51.956 08:30:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:51.956 08:30:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:51.956 08:30:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:51.956 08:30:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:51.956 08:30:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:51.956 08:30:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:51.956 08:30:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:51.956 08:30:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:51.956 08:30:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:51.956 08:30:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:52.214 08:30:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:52.214 08:30:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:52.214 08:30:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:52.214 08:30:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:52.214 08:30:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:52.214 08:30:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:52.214 08:30:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:52.214 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:52.214 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:22:52.214 00:22:52.214 --- 10.0.0.2 ping statistics --- 00:22:52.214 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.214 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:22:52.214 08:30:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:52.214 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:52.214 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:22:52.214 00:22:52.214 --- 10.0.0.1 ping statistics --- 00:22:52.214 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.214 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:22:52.214 08:30:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:52.214 08:30:37 -- nvmf/common.sh@410 -- # return 0 00:22:52.214 08:30:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:52.214 08:30:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:52.214 08:30:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:52.214 08:30:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:52.215 08:30:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:52.215 08:30:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:52.215 08:30:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:52.215 08:30:37 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:52.215 08:30:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:52.215 08:30:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:52.215 08:30:37 -- common/autotest_common.sh@10 -- # set +x 00:22:52.215 08:30:37 -- nvmf/common.sh@469 -- # nvmfpid=1027702 00:22:52.215 08:30:37 -- nvmf/common.sh@470 -- # waitforlisten 1027702 00:22:52.215 08:30:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:52.215 08:30:37 -- common/autotest_common.sh@829 -- # '[' -z 1027702 ']' 00:22:52.215 08:30:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:52.215 08:30:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:52.215 08:30:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:52.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:52.215 08:30:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:52.215 08:30:37 -- common/autotest_common.sh@10 -- # set +x 00:22:52.215 [2024-11-26 08:30:37.949352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.215 [2024-11-26 08:30:37.949435] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:52.215 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.215 [2024-11-26 08:30:38.011648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:52.475 [2024-11-26 08:30:38.117413] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:52.475 [2024-11-26 08:30:38.117575] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:52.475 [2024-11-26 08:30:38.117592] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:52.475 [2024-11-26 08:30:38.117605] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:52.475 [2024-11-26 08:30:38.117746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:52.475 [2024-11-26 08:30:38.117825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:52.475 [2024-11-26 08:30:38.117854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:52.475 [2024-11-26 08:30:38.117857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:53.410 08:30:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:53.410 08:30:38 -- common/autotest_common.sh@862 -- # return 0 00:22:53.410 08:30:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:53.410 08:30:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:53.410 08:30:38 -- common/autotest_common.sh@10 -- # set +x 00:22:53.410 08:30:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:53.410 08:30:38 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:53.410 08:30:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.410 08:30:38 -- common/autotest_common.sh@10 -- # set +x 00:22:53.410 [2024-11-26 08:30:38.998443] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:53.410 08:30:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.410 08:30:39 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:53.410 08:30:39 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:53.410 08:30:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:53.410 08:30:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.410 08:30:39 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:53.410 08:30:39 -- target/shutdown.sh@28 -- # cat 00:22:53.410 08:30:39 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:53.410 08:30:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.410 08:30:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.410 Malloc1 00:22:53.410 [2024-11-26 08:30:39.088003] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:53.410 Malloc2 00:22:53.410 Malloc3 00:22:53.410 Malloc4 00:22:53.410 Malloc5 00:22:53.668 Malloc6 00:22:53.668 Malloc7 00:22:53.668 Malloc8 00:22:53.668 Malloc9 00:22:53.668 Malloc10 00:22:53.926 08:30:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.926 08:30:39 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:53.926 08:30:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:53.926 08:30:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.926 08:30:39 -- target/shutdown.sh@124 -- # perfpid=1027959 00:22:53.926 08:30:39 -- target/shutdown.sh@125 -- # waitforlisten 1027959 /var/tmp/bdevperf.sock 00:22:53.926 08:30:39 -- common/autotest_common.sh@829 -- # '[' -z 1027959 ']' 00:22:53.926 08:30:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:53.926 08:30:39 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:53.926 08:30:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:53.926 08:30:39 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:53.926 08:30:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:53.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:53.926 08:30:39 -- nvmf/common.sh@520 -- # config=() 00:22:53.926 08:30:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:53.926 08:30:39 -- nvmf/common.sh@520 -- # local subsystem config 00:22:53.926 08:30:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.926 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.926 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.926 { 00:22:53.926 "params": { 00:22:53.926 "name": "Nvme$subsystem", 00:22:53.926 "trtype": "$TEST_TRANSPORT", 00:22:53.926 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.926 "adrfam": "ipv4", 00:22:53.926 "trsvcid": "$NVMF_PORT", 00:22:53.926 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.927 "hdgst": ${hdgst:-false}, 00:22:53.927 "ddgst": ${ddgst:-false} 00:22:53.927 }, 00:22:53.927 "method": "bdev_nvme_attach_controller" 00:22:53.927 } 00:22:53.927 EOF 00:22:53.927 )") 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.927 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.927 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.927 { 00:22:53.927 "params": { 00:22:53.927 "name": "Nvme$subsystem", 00:22:53.927 "trtype": "$TEST_TRANSPORT", 00:22:53.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.927 "adrfam": "ipv4", 00:22:53.927 "trsvcid": "$NVMF_PORT", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.928 "hdgst": ${hdgst:-false}, 00:22:53.928 "ddgst": ${ddgst:-false} 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 } 00:22:53.928 EOF 00:22:53.928 )") 00:22:53.928 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.928 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.928 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.928 { 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme$subsystem", 00:22:53.928 "trtype": "$TEST_TRANSPORT", 00:22:53.928 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "$NVMF_PORT", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.928 "hdgst": ${hdgst:-false}, 00:22:53.928 "ddgst": ${ddgst:-false} 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 } 00:22:53.928 EOF 00:22:53.928 )") 00:22:53.928 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.928 08:30:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:53.928 08:30:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:53.928 { 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme$subsystem", 00:22:53.928 "trtype": "$TEST_TRANSPORT", 00:22:53.928 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "$NVMF_PORT", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:53.928 "hdgst": ${hdgst:-false}, 00:22:53.928 "ddgst": ${ddgst:-false} 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 } 00:22:53.928 EOF 00:22:53.928 )") 00:22:53.928 08:30:39 -- nvmf/common.sh@542 -- # cat 00:22:53.928 08:30:39 -- nvmf/common.sh@544 -- # jq . 00:22:53.928 [2024-11-26 08:30:39.585404] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:53.928 [2024-11-26 08:30:39.585478] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1027959 ] 00:22:53.928 08:30:39 -- nvmf/common.sh@545 -- # IFS=, 00:22:53.928 08:30:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme1", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme2", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme3", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme4", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme5", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme6", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:53.928 "hdgst": false, 00:22:53.928 "ddgst": false 00:22:53.928 }, 00:22:53.928 "method": "bdev_nvme_attach_controller" 00:22:53.928 },{ 00:22:53.928 "params": { 00:22:53.928 "name": "Nvme7", 00:22:53.928 "trtype": "tcp", 00:22:53.928 "traddr": "10.0.0.2", 00:22:53.928 "adrfam": "ipv4", 00:22:53.928 "trsvcid": "4420", 00:22:53.928 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:53.928 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:53.929 "hdgst": false, 00:22:53.929 "ddgst": false 00:22:53.929 }, 00:22:53.929 "method": "bdev_nvme_attach_controller" 00:22:53.929 },{ 00:22:53.929 "params": { 00:22:53.929 "name": "Nvme8", 00:22:53.929 "trtype": "tcp", 00:22:53.929 "traddr": "10.0.0.2", 00:22:53.929 "adrfam": "ipv4", 00:22:53.929 "trsvcid": "4420", 00:22:53.929 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:53.929 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:53.929 "hdgst": false, 00:22:53.929 "ddgst": false 00:22:53.929 }, 00:22:53.929 "method": "bdev_nvme_attach_controller" 00:22:53.929 },{ 00:22:53.929 "params": { 00:22:53.929 "name": "Nvme9", 00:22:53.929 "trtype": "tcp", 00:22:53.929 "traddr": "10.0.0.2", 00:22:53.929 "adrfam": "ipv4", 00:22:53.929 "trsvcid": "4420", 00:22:53.929 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:53.929 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:53.929 "hdgst": false, 00:22:53.929 "ddgst": false 00:22:53.929 }, 00:22:53.929 "method": "bdev_nvme_attach_controller" 00:22:53.929 },{ 00:22:53.929 "params": { 00:22:53.929 "name": "Nvme10", 00:22:53.929 "trtype": "tcp", 00:22:53.929 "traddr": "10.0.0.2", 00:22:53.929 "adrfam": "ipv4", 00:22:53.929 "trsvcid": "4420", 00:22:53.929 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:53.929 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:53.929 "hdgst": false, 00:22:53.929 "ddgst": false 00:22:53.929 }, 00:22:53.929 "method": "bdev_nvme_attach_controller" 00:22:53.929 }' 00:22:53.929 EAL: No free 2048 kB hugepages reported on node 1 00:22:53.929 [2024-11-26 08:30:39.648545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:53.929 [2024-11-26 08:30:39.757394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:55.306 Running I/O for 10 seconds... 00:22:55.564 08:30:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:55.564 08:30:41 -- common/autotest_common.sh@862 -- # return 0 00:22:55.564 08:30:41 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:55.564 08:30:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.564 08:30:41 -- common/autotest_common.sh@10 -- # set +x 00:22:55.564 08:30:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.564 08:30:41 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:55.564 08:30:41 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:55.564 08:30:41 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:55.564 08:30:41 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:55.564 08:30:41 -- target/shutdown.sh@57 -- # local ret=1 00:22:55.564 08:30:41 -- target/shutdown.sh@58 -- # local i 00:22:55.564 08:30:41 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:55.564 08:30:41 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:55.564 08:30:41 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:55.564 08:30:41 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:55.564 08:30:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.564 08:30:41 -- common/autotest_common.sh@10 -- # set +x 00:22:55.564 08:30:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.824 08:30:41 -- target/shutdown.sh@60 -- # read_io_count=87 00:22:55.824 08:30:41 -- target/shutdown.sh@63 -- # '[' 87 -ge 100 ']' 00:22:55.824 08:30:41 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:56.105 08:30:41 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:56.105 08:30:41 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:56.105 08:30:41 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:56.105 08:30:41 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:56.105 08:30:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.105 08:30:41 -- common/autotest_common.sh@10 -- # set +x 00:22:56.105 08:30:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.105 08:30:41 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:56.105 08:30:41 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:56.105 08:30:41 -- target/shutdown.sh@64 -- # ret=0 00:22:56.105 08:30:41 -- target/shutdown.sh@65 -- # break 00:22:56.105 08:30:41 -- target/shutdown.sh@69 -- # return 0 00:22:56.105 08:30:41 -- target/shutdown.sh@134 -- # killprocess 1027702 00:22:56.105 08:30:41 -- common/autotest_common.sh@936 -- # '[' -z 1027702 ']' 00:22:56.105 08:30:41 -- common/autotest_common.sh@940 -- # kill -0 1027702 00:22:56.105 08:30:41 -- common/autotest_common.sh@941 -- # uname 00:22:56.105 08:30:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:56.105 08:30:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1027702 00:22:56.105 08:30:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:56.105 08:30:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:56.105 08:30:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1027702' 00:22:56.105 killing process with pid 1027702 00:22:56.105 08:30:41 -- common/autotest_common.sh@955 -- # kill 1027702 00:22:56.105 08:30:41 -- common/autotest_common.sh@960 -- # wait 1027702 00:22:56.105 [2024-11-26 08:30:41.762786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.762991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.763554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe32e0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.764890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.764925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.764940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.105 [2024-11-26 08:30:41.764959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.764980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.764992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.765726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5cd0 is same with the state(5) to be set 00:22:56.106 [2024-11-26 08:30:41.766763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.106 [2024-11-26 08:30:41.766804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.106 [2024-11-26 08:30:41.766822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.107 [2024-11-26 08:30:41.766836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.766849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.107 [2024-11-26 08:30:41.766863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.766876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.107 [2024-11-26 08:30:41.766888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.766901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbc0f70 is same with the state(5) to be set 00:22:56.107 [2024-11-26 08:30:41.767907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.767934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.767962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.767980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.767997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.107 [2024-11-26 08:30:41.768968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.107 [2024-11-26 08:30:41.768985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.108 [2024-11-26 08:30:41.769869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.108 [2024-11-26 08:30:41.769971] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe05260 was disconnected and freed. reset controller. 00:22:56.108 [2024-11-26 08:30:41.771918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.771948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.771963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.771975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.108 [2024-11-26 08:30:41.772124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.772514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3790 is same with the state(5) to be set 00:22:56.109 [2024-11-26 08:30:41.773597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:56.109 [2024-11-26 08:30:41.773640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc0f70 (9): Bad file descriptor 00:22:56.109 [2024-11-26 08:30:41.773716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.773982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.773998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.109 [2024-11-26 08:30:41.774345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.109 [2024-11-26 08:30:41.774376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.774669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:1the state(5) to be set 00:22:56.110 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.774767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.110 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.774812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:12the state(5) to be set 00:22:56.110 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.774853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.774903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38656 len:1the state(5) to be set 00:22:56.110 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.774935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38784 len:1the state(5) to be set 00:22:56.110 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.774966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.774987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.774988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.775018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.775026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.775032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.110 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.775053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.775052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.775066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.775075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.775081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:12the state(5) to be set 00:22:56.110 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.775096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 [2024-11-26 08:30:41.775098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.775111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.775124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.775120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.110 the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.775141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.110 [2024-11-26 08:30:41.775144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.110 [2024-11-26 08:30:41.775154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.775169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31872 len:12the state(5) to be set 00:22:56.111 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.775267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32640 len:12[2024-11-26 08:30:41.775398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.775544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.111 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33920 len:12[2024-11-26 08:30:41.775585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with [2024-11-26 08:30:41.775671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.111 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.111 [2024-11-26 08:30:41.775700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.111 [2024-11-26 08:30:41.775732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775805] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xbb1550 was disconnected and freed. reset controller. 00:22:56.111 [2024-11-26 08:30:41.775816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.775981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe3c40 is same with the state(5) to be set 00:22:56.111 [2024-11-26 08:30:41.776402] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.111 [2024-11-26 08:30:41.777956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:56.112 [2024-11-26 08:30:41.778369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd87600 (9): Bad file descriptor 00:22:56.112 [2024-11-26 08:30:41.778431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe40d0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778776] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc19590 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.778884] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.778982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.778995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe31b0 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.779063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.779083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.779110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.779135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.112 [2024-11-26 08:30:41.779161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbec690 is same with the state(5) to be set 00:22:56.112 [2024-11-26 08:30:41.779323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.112 [2024-11-26 08:30:41.779353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.112 [2024-11-26 08:30:41.779373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with [2024-11-26 08:30:41.779549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128the state(5) to be set 00:22:56.113 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with [2024-11-26 08:30:41.779565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.113 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31488 len:12[2024-11-26 08:30:41.779675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32256 len:12[2024-11-26 08:30:41.779751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.779766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4580 is same with the state(5) to be set 00:22:56.113 [2024-11-26 08:30:41.779813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.779985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.779998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.113 [2024-11-26 08:30:41.780313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.113 [2024-11-26 08:30:41.780326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.780967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.780992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.114 [2024-11-26 08:30:41.781287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.114 [2024-11-26 08:30:41.781378] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd4e6f0 was disconnected and freed. reset controller. 00:22:56.114 [2024-11-26 08:30:41.781399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.114 [2024-11-26 08:30:41.781435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.114 [2024-11-26 08:30:41.781460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.114 [2024-11-26 08:30:41.781490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.114 [2024-11-26 08:30:41.781513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.114 [2024-11-26 08:30:41.781535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.781980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.782949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe4ee0 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 [2024-11-26 08:30:41.784217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128[2024-11-26 08:30:41.784257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.115 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 [2024-11-26 08:30:41.784299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 [2024-11-26 08:30:41.784325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128the state(5) to be set 00:22:56.115 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 [2024-11-26 08:30:41.784363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.115 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.115 [2024-11-26 08:30:41.784387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.115 [2024-11-26 08:30:41.784401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.115 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.115 [2024-11-26 08:30:41.784416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31872 len:12[2024-11-26 08:30:41.784478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.784493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:12[2024-11-26 08:30:41.784598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.784627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34304 len:12the state(5) to be set 00:22:56.116 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 [2024-11-26 08:30:41.784866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:56.116 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 [2024-11-26 08:30:41.784883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:12[2024-11-26 08:30:41.784885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 08:30:41.784898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.116 the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.784913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe11e00 is same wthe state(5) to be set 00:22:56.116 ith the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.784997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with [2024-11-26 08:30:41.785007] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe11e00 was disconnected and frethe state(5) to be set 00:22:56.116 ed. reset controller. 00:22:56.116 [2024-11-26 08:30:41.785033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5370 is same with the state(5) to be set 00:22:56.116 [2024-11-26 08:30:41.785231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:56.116 [2024-11-26 08:30:41.785268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbec690 (9): Bad file descriptor 00:22:56.117 [2024-11-26 08:30:41.785863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.785990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.786705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:56.117 [2024-11-26 08:30:41.786770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd620a0 (9): Bad file descriptor 00:22:56.117 [2024-11-26 08:30:41.786974] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.117 [2024-11-26 08:30:41.787830] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.117 [2024-11-26 08:30:41.788666] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.117 [2024-11-26 08:30:41.788883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc19590 (9): Bad file descriptor 00:22:56.117 [2024-11-26 08:30:41.788941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.788963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.788978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.788992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789005] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd71a60 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.789101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd77150 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.789261] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789322] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789347] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.117 [2024-11-26 08:30:41.789359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.117 [2024-11-26 08:30:41.789371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd76c70 is same with the state(5) to be set 00:22:56.117 [2024-11-26 08:30:41.789397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbe31b0 (9): Bad file descriptor 00:22:56.118 [2024-11-26 08:30:41.789472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.789986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.789999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.790014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.790041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.790056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.790068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.790082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.790094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.790108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.790120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.790139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.810516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.810705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe5820 is same with the state(5) to be set 00:22:56.118 [2024-11-26 08:30:41.814572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.118 [2024-11-26 08:30:41.814904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.118 [2024-11-26 08:30:41.814917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.814932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.814946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.814961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.814974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.814999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.119 [2024-11-26 08:30:41.815892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.815906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe133e0 is same with the state(5) to be set 00:22:56.119 [2024-11-26 08:30:41.816007] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe133e0 was disconnected and freed. reset controller. 00:22:56.119 [2024-11-26 08:30:41.816104] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.119 [2024-11-26 08:30:41.816294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:56.119 [2024-11-26 08:30:41.816318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.119 [2024-11-26 08:30:41.816332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd87600 is same with the state(5) to be set 00:22:56.119 [2024-11-26 08:30:41.816373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:56.119 [2024-11-26 08:30:41.816392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.816405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbc0f70 is same with the state(5) to be set 00:22:56.120 [2024-11-26 08:30:41.816444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd87600 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc0f70 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbec690 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd620a0 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.120 [2024-11-26 08:30:41.816575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.816590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.120 [2024-11-26 08:30:41.816603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.816616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.120 [2024-11-26 08:30:41.816628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.816642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:56.120 [2024-11-26 08:30:41.816654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.816666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0e490 is same with the state(5) to be set 00:22:56.120 [2024-11-26 08:30:41.816720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd71a60 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd77150 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.816775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd76c70 (9): Bad file descriptor 00:22:56.120 [2024-11-26 08:30:41.818067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:56.120 [2024-11-26 08:30:41.818159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.818976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.818989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.819004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.819017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.819041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.819055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.120 [2024-11-26 08:30:41.819070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.120 [2024-11-26 08:30:41.819083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.819982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.819997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.820010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.820025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.820042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.820057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.820071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.820085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d1a0 is same with the state(5) to be set 00:22:56.121 [2024-11-26 08:30:41.821434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.121 [2024-11-26 08:30:41.821618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.121 [2024-11-26 08:30:41.821634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.821979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.821992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.122 [2024-11-26 08:30:41.822810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.122 [2024-11-26 08:30:41.822824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.822852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.822880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.822923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.822951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.822982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.822997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.823334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.823349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.833746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.833813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe17580 is same with the state(5) to be set 00:22:56.123 [2024-11-26 08:30:41.836351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:56.123 [2024-11-26 08:30:41.836392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:56.123 [2024-11-26 08:30:41.836632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.836773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.836799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd71a60 with addr=10.0.0.2, port=4420 00:22:56.123 [2024-11-26 08:30:41.836817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd71a60 is same with the state(5) to be set 00:22:56.123 [2024-11-26 08:30:41.836835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:56.123 [2024-11-26 08:30:41.836848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:56.123 [2024-11-26 08:30:41.836865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:56.123 [2024-11-26 08:30:41.836893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:56.123 [2024-11-26 08:30:41.836908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:56.123 [2024-11-26 08:30:41.836921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:56.123 [2024-11-26 08:30:41.836938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:56.123 [2024-11-26 08:30:41.836951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:56.123 [2024-11-26 08:30:41.836964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:56.123 [2024-11-26 08:30:41.836992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:56.123 [2024-11-26 08:30:41.837005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:56.123 [2024-11-26 08:30:41.837018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:56.123 [2024-11-26 08:30:41.837078] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.123 [2024-11-26 08:30:41.837103] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.123 [2024-11-26 08:30:41.837124] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.123 [2024-11-26 08:30:41.837157] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.123 [2024-11-26 08:30:41.837186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc0e490 (9): Bad file descriptor 00:22:56.123 [2024-11-26 08:30:41.837237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd71a60 (9): Bad file descriptor 00:22:56.123 [2024-11-26 08:30:41.837712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.123 [2024-11-26 08:30:41.837749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.123 [2024-11-26 08:30:41.837762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.123 [2024-11-26 08:30:41.837773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.123 [2024-11-26 08:30:41.837896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.838022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.838049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbe31b0 with addr=10.0.0.2, port=4420 00:22:56.123 [2024-11-26 08:30:41.838065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe31b0 is same with the state(5) to be set 00:22:56.123 [2024-11-26 08:30:41.838173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.838282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.123 [2024-11-26 08:30:41.838306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc19590 with addr=10.0.0.2, port=4420 00:22:56.123 [2024-11-26 08:30:41.838320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc19590 is same with the state(5) to be set 00:22:56.123 [2024-11-26 08:30:41.838656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.123 [2024-11-26 08:30:41.838679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.123 [2024-11-26 08:30:41.838719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.838972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.838988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.839304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.839318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe10950 is same with the state(5) to be set 00:22:56.124 [2024-11-26 08:30:41.840389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.124 [2024-11-26 08:30:41.840971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.124 [2024-11-26 08:30:41.840987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.841964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.841980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.125 [2024-11-26 08:30:41.842160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.125 [2024-11-26 08:30:41.842174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.842203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.842236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.842265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.842294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.842323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.842337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe149c0 is same with the state(5) to be set 00:22:56.126 [2024-11-26 08:30:41.843589] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:56.126 [2024-11-26 08:30:41.843917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:56.126 [2024-11-26 08:30:41.843948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:56.126 [2024-11-26 08:30:41.844010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbe31b0 (9): Bad file descriptor 00:22:56.126 [2024-11-26 08:30:41.844033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc19590 (9): Bad file descriptor 00:22:56.126 [2024-11-26 08:30:41.844053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:56.126 [2024-11-26 08:30:41.844067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:56.126 [2024-11-26 08:30:41.844085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:56.126 [2024-11-26 08:30:41.844229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.126 [2024-11-26 08:30:41.844364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.126 [2024-11-26 08:30:41.844484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.126 [2024-11-26 08:30:41.844510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd77150 with addr=10.0.0.2, port=4420 00:22:56.126 [2024-11-26 08:30:41.844527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd77150 is same with the state(5) to be set 00:22:56.126 [2024-11-26 08:30:41.844624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.126 [2024-11-26 08:30:41.844745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.126 [2024-11-26 08:30:41.844770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd76c70 with addr=10.0.0.2, port=4420 00:22:56.126 [2024-11-26 08:30:41.844786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd76c70 is same with the state(5) to be set 00:22:56.126 [2024-11-26 08:30:41.844801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:56.126 [2024-11-26 08:30:41.844813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:56.126 [2024-11-26 08:30:41.844826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:56.126 [2024-11-26 08:30:41.844844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:56.126 [2024-11-26 08:30:41.844865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:56.126 [2024-11-26 08:30:41.844879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:56.126 [2024-11-26 08:30:41.845458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.126 [2024-11-26 08:30:41.845480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.126 [2024-11-26 08:30:41.845497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd77150 (9): Bad file descriptor 00:22:56.126 [2024-11-26 08:30:41.845517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd76c70 (9): Bad file descriptor 00:22:56.126 [2024-11-26 08:30:41.845565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:56.126 [2024-11-26 08:30:41.845583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:56.126 [2024-11-26 08:30:41.845597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:56.126 [2024-11-26 08:30:41.845614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:56.126 [2024-11-26 08:30:41.845628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:56.126 [2024-11-26 08:30:41.845640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:56.126 [2024-11-26 08:30:41.845683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.126 [2024-11-26 08:30:41.845710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.126 [2024-11-26 08:30:41.846480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.846974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.846987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.847003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.847017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.847032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.847045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.847060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.126 [2024-11-26 08:30:41.847073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.126 [2024-11-26 08:30:41.847088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.847983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.847999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.848012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.848028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.848049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.848064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.848078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.848093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.127 [2024-11-26 08:30:41.848106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.127 [2024-11-26 08:30:41.848122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:56.128 [2024-11-26 08:30:41.848426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:56.128 [2024-11-26 08:30:41.848440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe15fa0 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.850137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:56.128 [2024-11-26 08:30:41.850168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:56.128 [2024-11-26 08:30:41.850189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:56.128 [2024-11-26 08:30:41.850206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:56.128 [2024-11-26 08:30:41.850222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:56.128 task offset: 34816 on job bdev=Nvme1n1 fails 00:22:56.128 00:22:56.128 Latency(us) 00:22:56.128 [2024-11-26T07:30:41.988Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme1n1 ended in about 0.67 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme1n1 : 0.67 373.86 23.37 95.33 0.00 135390.21 33593.27 117285.17 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme2n1 ended in about 0.68 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme2n1 : 0.68 370.63 23.16 94.50 0.00 135051.93 21554.06 114955.00 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme3n1 ended in about 0.72 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme3n1 : 0.72 348.38 21.77 88.83 0.00 142369.62 73400.32 114955.00 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme4n1 ended in about 0.68 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme4n1 : 0.68 367.29 22.96 93.65 0.00 133347.77 16990.81 115731.72 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme5n1 ended in about 0.74 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme5n1 : 0.74 339.42 21.21 28.40 0.00 155469.53 66021.45 116508.44 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme6n1 ended in about 0.69 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme6n1 : 0.69 365.98 22.87 30.62 0.00 151046.78 3616.62 121168.78 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme7n1 ended in about 0.72 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme7n1 : 0.72 290.01 18.13 89.23 0.00 157273.55 95536.92 138256.69 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme8n1 ended in about 0.74 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme8n1 : 0.74 280.08 17.50 86.18 0.00 161512.69 99420.54 152237.70 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme9n1 ended in about 0.75 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme9n1 : 0.75 277.79 17.36 85.47 0.00 161274.24 99032.18 147577.36 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:56.128 [2024-11-26T07:30:41.988Z] Job: Nvme10n1 ended in about 0.73 seconds with error 00:22:56.128 Verification LBA range: start 0x0 length 0x400 00:22:56.128 Nvme10n1 : 0.73 283.29 17.71 87.17 0.00 156211.27 97867.09 121945.51 00:22:56.128 [2024-11-26T07:30:41.988Z] =================================================================================================================== 00:22:56.128 [2024-11-26T07:30:41.988Z] Total : 3296.73 206.05 779.38 0.00 148159.96 3616.62 152237.70 00:22:56.128 [2024-11-26 08:30:41.876036] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:56.128 [2024-11-26 08:30:41.876113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:56.128 [2024-11-26 08:30:41.876580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.876712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.876750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd87600 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.876771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd87600 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.876871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.876975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbc0f70 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.877016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbc0f70 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.877127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbec690 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.877265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbec690 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.877369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd620a0 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.877493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd620a0 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.877577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd71a60 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.877724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd71a60 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.877820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.128 [2024-11-26 08:30:41.877934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc0e490 with addr=10.0.0.2, port=4420 00:22:56.128 [2024-11-26 08:30:41.877949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc0e490 is same with the state(5) to be set 00:22:56.128 [2024-11-26 08:30:41.878007] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.128 [2024-11-26 08:30:41.878030] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:56.128 [2024-11-26 08:30:41.878342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:56.129 [2024-11-26 08:30:41.878370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:56.129 [2024-11-26 08:30:41.878441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd87600 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbc0f70 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbec690 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd620a0 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd71a60 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc0e490 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.878599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:56.129 [2024-11-26 08:30:41.878623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:56.129 [2024-11-26 08:30:41.878750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.878842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.878866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc19590 with addr=10.0.0.2, port=4420 00:22:56.129 [2024-11-26 08:30:41.878882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc19590 is same with the state(5) to be set 00:22:56.129 [2024-11-26 08:30:41.878975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbe31b0 with addr=10.0.0.2, port=4420 00:22:56.129 [2024-11-26 08:30:41.879124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe31b0 is same with the state(5) to be set 00:22:56.129 [2024-11-26 08:30:41.879140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.879368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.879380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:56.129 [2024-11-26 08:30:41.879438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.879600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd76c70 with addr=10.0.0.2, port=4420 00:22:56.129 [2024-11-26 08:30:41.879739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd76c70 is same with the state(5) to be set 00:22:56.129 [2024-11-26 08:30:41.879828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:56.129 [2024-11-26 08:30:41.879960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd77150 with addr=10.0.0.2, port=4420 00:22:56.129 [2024-11-26 08:30:41.879976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd77150 is same with the state(5) to be set 00:22:56.129 [2024-11-26 08:30:41.879994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc19590 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.880013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbe31b0 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.880055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd76c70 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.880079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd77150 (9): Bad file descriptor 00:22:56.129 [2024-11-26 08:30:41.880094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.880107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.880119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:56.129 [2024-11-26 08:30:41.880135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.880149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.880161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:56.129 [2024-11-26 08:30:41.880200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.880220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.880234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.880248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.880261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:56.129 [2024-11-26 08:30:41.880277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:56.129 [2024-11-26 08:30:41.880291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:56.129 [2024-11-26 08:30:41.880304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:56.129 [2024-11-26 08:30:41.880340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.129 [2024-11-26 08:30:41.880357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:56.699 08:30:42 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:56.699 08:30:42 -- target/shutdown.sh@138 -- # sleep 1 00:22:57.635 08:30:43 -- target/shutdown.sh@141 -- # kill -9 1027959 00:22:57.635 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1027959) - No such process 00:22:57.635 08:30:43 -- target/shutdown.sh@141 -- # true 00:22:57.635 08:30:43 -- target/shutdown.sh@143 -- # stoptarget 00:22:57.635 08:30:43 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:57.635 08:30:43 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:57.635 08:30:43 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:57.635 08:30:43 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:57.635 08:30:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:57.635 08:30:43 -- nvmf/common.sh@116 -- # sync 00:22:57.635 08:30:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:57.635 08:30:43 -- nvmf/common.sh@119 -- # set +e 00:22:57.635 08:30:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:57.635 08:30:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:57.635 rmmod nvme_tcp 00:22:57.635 rmmod nvme_fabrics 00:22:57.635 rmmod nvme_keyring 00:22:57.635 08:30:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:57.635 08:30:43 -- nvmf/common.sh@123 -- # set -e 00:22:57.635 08:30:43 -- nvmf/common.sh@124 -- # return 0 00:22:57.635 08:30:43 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:57.635 08:30:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:57.635 08:30:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:57.635 08:30:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:57.635 08:30:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:57.635 08:30:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:57.635 08:30:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:57.635 08:30:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:57.635 08:30:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.174 08:30:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.174 00:23:00.174 real 0m7.778s 00:23:00.174 user 0m19.441s 00:23:00.174 sys 0m1.440s 00:23:00.174 08:30:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.174 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:00.174 ************************************ 00:23:00.174 END TEST nvmf_shutdown_tc3 00:23:00.174 ************************************ 00:23:00.174 08:30:45 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:23:00.174 00:23:00.174 real 0m29.069s 00:23:00.174 user 1m23.321s 00:23:00.174 sys 0m6.411s 00:23:00.174 08:30:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.174 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:00.174 ************************************ 00:23:00.174 END TEST nvmf_shutdown 00:23:00.174 ************************************ 00:23:00.174 08:30:45 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:23:00.174 08:30:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:00.174 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:00.174 08:30:45 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:23:00.174 08:30:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:00.174 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:00.174 08:30:45 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:23:00.174 08:30:45 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:00.174 08:30:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.174 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:00.174 ************************************ 00:23:00.174 START TEST nvmf_multicontroller 00:23:00.174 ************************************ 00:23:00.174 08:30:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:00.174 * Looking for test storage... 00:23:00.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.174 08:30:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.174 08:30:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.174 08:30:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.174 08:30:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.174 08:30:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.174 08:30:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.174 08:30:45 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.174 08:30:45 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.174 08:30:45 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.174 08:30:45 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.174 08:30:45 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.174 08:30:45 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.174 08:30:45 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.174 08:30:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.174 08:30:45 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.174 08:30:45 -- scripts/common.sh@344 -- # : 1 00:23:00.174 08:30:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.174 08:30:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.174 08:30:45 -- scripts/common.sh@364 -- # decimal 1 00:23:00.174 08:30:45 -- scripts/common.sh@352 -- # local d=1 00:23:00.174 08:30:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.174 08:30:45 -- scripts/common.sh@354 -- # echo 1 00:23:00.174 08:30:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.174 08:30:45 -- scripts/common.sh@365 -- # decimal 2 00:23:00.174 08:30:45 -- scripts/common.sh@352 -- # local d=2 00:23:00.174 08:30:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.174 08:30:45 -- scripts/common.sh@354 -- # echo 2 00:23:00.174 08:30:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.174 08:30:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.174 08:30:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.174 08:30:45 -- scripts/common.sh@367 -- # return 0 00:23:00.174 08:30:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.174 --rc genhtml_branch_coverage=1 00:23:00.174 --rc genhtml_function_coverage=1 00:23:00.174 --rc genhtml_legend=1 00:23:00.174 --rc geninfo_all_blocks=1 00:23:00.174 --rc geninfo_unexecuted_blocks=1 00:23:00.174 00:23:00.174 ' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.174 --rc genhtml_branch_coverage=1 00:23:00.174 --rc genhtml_function_coverage=1 00:23:00.174 --rc genhtml_legend=1 00:23:00.174 --rc geninfo_all_blocks=1 00:23:00.174 --rc geninfo_unexecuted_blocks=1 00:23:00.174 00:23:00.174 ' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.174 --rc genhtml_branch_coverage=1 00:23:00.174 --rc genhtml_function_coverage=1 00:23:00.174 --rc genhtml_legend=1 00:23:00.174 --rc geninfo_all_blocks=1 00:23:00.174 --rc geninfo_unexecuted_blocks=1 00:23:00.174 00:23:00.174 ' 00:23:00.174 08:30:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.174 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.174 --rc genhtml_branch_coverage=1 00:23:00.174 --rc genhtml_function_coverage=1 00:23:00.174 --rc genhtml_legend=1 00:23:00.174 --rc geninfo_all_blocks=1 00:23:00.174 --rc geninfo_unexecuted_blocks=1 00:23:00.174 00:23:00.174 ' 00:23:00.174 08:30:45 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.174 08:30:45 -- nvmf/common.sh@7 -- # uname -s 00:23:00.174 08:30:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.174 08:30:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.174 08:30:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.174 08:30:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.174 08:30:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.175 08:30:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.175 08:30:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.175 08:30:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.175 08:30:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.175 08:30:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.175 08:30:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.175 08:30:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.175 08:30:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.175 08:30:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.175 08:30:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.175 08:30:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.175 08:30:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.175 08:30:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.175 08:30:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.175 08:30:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.175 08:30:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.175 08:30:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.175 08:30:45 -- paths/export.sh@5 -- # export PATH 00:23:00.175 08:30:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.175 08:30:45 -- nvmf/common.sh@46 -- # : 0 00:23:00.175 08:30:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.175 08:30:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.175 08:30:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.175 08:30:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.175 08:30:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.175 08:30:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.175 08:30:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.175 08:30:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.175 08:30:45 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:00.175 08:30:45 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:00.175 08:30:45 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:00.175 08:30:45 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:00.175 08:30:45 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:00.175 08:30:45 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:00.175 08:30:45 -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:00.175 08:30:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.175 08:30:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.175 08:30:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.175 08:30:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.175 08:30:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.175 08:30:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.175 08:30:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.175 08:30:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.175 08:30:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.175 08:30:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.175 08:30:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.175 08:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:02.082 08:30:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:02.082 08:30:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:02.082 08:30:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:02.082 08:30:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:02.082 08:30:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:02.082 08:30:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:02.082 08:30:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:02.082 08:30:47 -- nvmf/common.sh@294 -- # net_devs=() 00:23:02.082 08:30:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:02.082 08:30:47 -- nvmf/common.sh@295 -- # e810=() 00:23:02.082 08:30:47 -- nvmf/common.sh@295 -- # local -ga e810 00:23:02.082 08:30:47 -- nvmf/common.sh@296 -- # x722=() 00:23:02.082 08:30:47 -- nvmf/common.sh@296 -- # local -ga x722 00:23:02.082 08:30:47 -- nvmf/common.sh@297 -- # mlx=() 00:23:02.082 08:30:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:02.082 08:30:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:02.082 08:30:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:02.082 08:30:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:02.082 08:30:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:02.082 08:30:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:02.082 08:30:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:02.082 08:30:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:02.082 08:30:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.082 08:30:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:02.082 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:02.082 08:30:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.083 08:30:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:02.083 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:02.083 08:30:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:02.083 08:30:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.083 08:30:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.083 08:30:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.083 08:30:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.083 08:30:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:02.083 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:02.083 08:30:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.083 08:30:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.083 08:30:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.083 08:30:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.083 08:30:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.083 08:30:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:02.083 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:02.083 08:30:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.083 08:30:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:02.083 08:30:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:02.083 08:30:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:02.083 08:30:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:02.083 08:30:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:02.083 08:30:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:02.083 08:30:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:02.083 08:30:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:02.083 08:30:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:02.083 08:30:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:02.083 08:30:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:02.083 08:30:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:02.083 08:30:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:02.083 08:30:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:02.083 08:30:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:02.083 08:30:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:02.083 08:30:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:02.083 08:30:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:02.083 08:30:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:02.083 08:30:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:02.083 08:30:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:02.083 08:30:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:02.083 08:30:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:02.083 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:02.083 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:23:02.083 00:23:02.083 --- 10.0.0.2 ping statistics --- 00:23:02.083 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.083 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:23:02.083 08:30:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:02.083 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:02.083 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:23:02.083 00:23:02.083 --- 10.0.0.1 ping statistics --- 00:23:02.083 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.083 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:23:02.083 08:30:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:02.083 08:30:47 -- nvmf/common.sh@410 -- # return 0 00:23:02.083 08:30:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:02.083 08:30:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:02.083 08:30:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:02.083 08:30:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:02.083 08:30:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:02.083 08:30:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:02.083 08:30:47 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:02.083 08:30:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:02.083 08:30:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:02.083 08:30:47 -- common/autotest_common.sh@10 -- # set +x 00:23:02.083 08:30:47 -- nvmf/common.sh@469 -- # nvmfpid=1030441 00:23:02.083 08:30:47 -- nvmf/common.sh@470 -- # waitforlisten 1030441 00:23:02.083 08:30:47 -- common/autotest_common.sh@829 -- # '[' -z 1030441 ']' 00:23:02.083 08:30:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:02.083 08:30:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:02.083 08:30:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.083 08:30:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:02.083 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:02.083 08:30:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.083 08:30:47 -- common/autotest_common.sh@10 -- # set +x 00:23:02.083 [2024-11-26 08:30:47.836399] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:02.083 [2024-11-26 08:30:47.836471] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:02.083 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.083 [2024-11-26 08:30:47.899973] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:02.341 [2024-11-26 08:30:48.007308] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:02.341 [2024-11-26 08:30:48.007468] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:02.341 [2024-11-26 08:30:48.007500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:02.341 [2024-11-26 08:30:48.007512] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:02.341 [2024-11-26 08:30:48.007602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:02.341 [2024-11-26 08:30:48.007665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:02.341 [2024-11-26 08:30:48.007669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:03.274 08:30:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.274 08:30:48 -- common/autotest_common.sh@862 -- # return 0 00:23:03.274 08:30:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:03.275 08:30:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:03.275 08:30:48 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 [2024-11-26 08:30:48.849261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 Malloc0 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 [2024-11-26 08:30:48.908863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 [2024-11-26 08:30:48.916714] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 Malloc1 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:03.275 08:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:03.275 08:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.275 08:30:48 -- host/multicontroller.sh@44 -- # bdevperf_pid=1030599 00:23:03.275 08:30:48 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:03.275 08:30:48 -- host/multicontroller.sh@47 -- # waitforlisten 1030599 /var/tmp/bdevperf.sock 00:23:03.275 08:30:48 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:03.275 08:30:48 -- common/autotest_common.sh@829 -- # '[' -z 1030599 ']' 00:23:03.275 08:30:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:03.275 08:30:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:03.275 08:30:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:03.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:03.275 08:30:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:03.275 08:30:48 -- common/autotest_common.sh@10 -- # set +x 00:23:04.210 08:30:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:04.210 08:30:49 -- common/autotest_common.sh@862 -- # return 0 00:23:04.210 08:30:49 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:04.210 08:30:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.210 08:30:49 -- common/autotest_common.sh@10 -- # set +x 00:23:04.467 NVMe0n1 00:23:04.467 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.467 08:30:50 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:04.467 08:30:50 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:04.467 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.467 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.467 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.467 1 00:23:04.468 08:30:50 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:04.468 08:30:50 -- common/autotest_common.sh@650 -- # local es=0 00:23:04.468 08:30:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:04.468 08:30:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 request: 00:23:04.468 { 00:23:04.468 "name": "NVMe0", 00:23:04.468 "trtype": "tcp", 00:23:04.468 "traddr": "10.0.0.2", 00:23:04.468 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:04.468 "hostaddr": "10.0.0.2", 00:23:04.468 "hostsvcid": "60000", 00:23:04.468 "adrfam": "ipv4", 00:23:04.468 "trsvcid": "4420", 00:23:04.468 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:04.468 "method": "bdev_nvme_attach_controller", 00:23:04.468 "req_id": 1 00:23:04.468 } 00:23:04.468 Got JSON-RPC error response 00:23:04.468 response: 00:23:04.468 { 00:23:04.468 "code": -114, 00:23:04.468 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:04.468 } 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # es=1 00:23:04.468 08:30:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:04.468 08:30:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:04.468 08:30:50 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:04.468 08:30:50 -- common/autotest_common.sh@650 -- # local es=0 00:23:04.468 08:30:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:04.468 08:30:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 request: 00:23:04.468 { 00:23:04.468 "name": "NVMe0", 00:23:04.468 "trtype": "tcp", 00:23:04.468 "traddr": "10.0.0.2", 00:23:04.468 "hostaddr": "10.0.0.2", 00:23:04.468 "hostsvcid": "60000", 00:23:04.468 "adrfam": "ipv4", 00:23:04.468 "trsvcid": "4420", 00:23:04.468 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:04.468 "method": "bdev_nvme_attach_controller", 00:23:04.468 "req_id": 1 00:23:04.468 } 00:23:04.468 Got JSON-RPC error response 00:23:04.468 response: 00:23:04.468 { 00:23:04.468 "code": -114, 00:23:04.468 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:04.468 } 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # es=1 00:23:04.468 08:30:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:04.468 08:30:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:04.468 08:30:50 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@650 -- # local es=0 00:23:04.468 08:30:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 request: 00:23:04.468 { 00:23:04.468 "name": "NVMe0", 00:23:04.468 "trtype": "tcp", 00:23:04.468 "traddr": "10.0.0.2", 00:23:04.468 "hostaddr": "10.0.0.2", 00:23:04.468 "hostsvcid": "60000", 00:23:04.468 "adrfam": "ipv4", 00:23:04.468 "trsvcid": "4420", 00:23:04.468 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:04.468 "multipath": "disable", 00:23:04.468 "method": "bdev_nvme_attach_controller", 00:23:04.468 "req_id": 1 00:23:04.468 } 00:23:04.468 Got JSON-RPC error response 00:23:04.468 response: 00:23:04.468 { 00:23:04.468 "code": -114, 00:23:04.468 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:04.468 } 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # es=1 00:23:04.468 08:30:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:04.468 08:30:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:04.468 08:30:50 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:04.468 08:30:50 -- common/autotest_common.sh@650 -- # local es=0 00:23:04.468 08:30:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:04.468 08:30:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:04.468 08:30:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 request: 00:23:04.468 { 00:23:04.468 "name": "NVMe0", 00:23:04.468 "trtype": "tcp", 00:23:04.468 "traddr": "10.0.0.2", 00:23:04.468 "hostaddr": "10.0.0.2", 00:23:04.468 "hostsvcid": "60000", 00:23:04.468 "adrfam": "ipv4", 00:23:04.468 "trsvcid": "4420", 00:23:04.468 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:04.468 "multipath": "failover", 00:23:04.468 "method": "bdev_nvme_attach_controller", 00:23:04.468 "req_id": 1 00:23:04.468 } 00:23:04.468 Got JSON-RPC error response 00:23:04.468 response: 00:23:04.468 { 00:23:04.468 "code": -114, 00:23:04.468 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:04.468 } 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@653 -- # es=1 00:23:04.468 08:30:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:04.468 08:30:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:04.468 08:30:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:04.468 08:30:50 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.468 08:30:50 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.468 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.468 08:30:50 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:04.468 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.468 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.726 00:23:04.726 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.726 08:30:50 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:04.726 08:30:50 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:04.726 08:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.726 08:30:50 -- common/autotest_common.sh@10 -- # set +x 00:23:04.726 08:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.726 08:30:50 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:04.726 08:30:50 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:06.102 0 00:23:06.102 08:30:51 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:06.102 08:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.102 08:30:51 -- common/autotest_common.sh@10 -- # set +x 00:23:06.102 08:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.102 08:30:51 -- host/multicontroller.sh@100 -- # killprocess 1030599 00:23:06.102 08:30:51 -- common/autotest_common.sh@936 -- # '[' -z 1030599 ']' 00:23:06.102 08:30:51 -- common/autotest_common.sh@940 -- # kill -0 1030599 00:23:06.102 08:30:51 -- common/autotest_common.sh@941 -- # uname 00:23:06.102 08:30:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:06.102 08:30:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1030599 00:23:06.102 08:30:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:06.102 08:30:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:06.102 08:30:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1030599' 00:23:06.102 killing process with pid 1030599 00:23:06.102 08:30:51 -- common/autotest_common.sh@955 -- # kill 1030599 00:23:06.102 08:30:51 -- common/autotest_common.sh@960 -- # wait 1030599 00:23:06.102 08:30:51 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:06.102 08:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.102 08:30:51 -- common/autotest_common.sh@10 -- # set +x 00:23:06.102 08:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.102 08:30:51 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:06.102 08:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.102 08:30:51 -- common/autotest_common.sh@10 -- # set +x 00:23:06.362 08:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.362 08:30:51 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:06.362 08:30:51 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:06.362 08:30:51 -- common/autotest_common.sh@1607 -- # read -r file 00:23:06.362 08:30:51 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:06.362 08:30:51 -- common/autotest_common.sh@1606 -- # sort -u 00:23:06.362 08:30:51 -- common/autotest_common.sh@1608 -- # cat 00:23:06.362 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:06.362 [2024-11-26 08:30:49.015322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:06.362 [2024-11-26 08:30:49.015399] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1030599 ] 00:23:06.362 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.362 [2024-11-26 08:30:49.073591] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:06.362 [2024-11-26 08:30:49.180438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:06.362 [2024-11-26 08:30:50.500631] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name bd9e3e7c-a292-4161-8bdf-5e8cdc0f932f already exists 00:23:06.362 [2024-11-26 08:30:50.500696] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:bd9e3e7c-a292-4161-8bdf-5e8cdc0f932f alias for bdev NVMe1n1 00:23:06.362 [2024-11-26 08:30:50.500716] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:06.362 Running I/O for 1 seconds... 00:23:06.362 00:23:06.362 Latency(us) 00:23:06.362 [2024-11-26T07:30:52.222Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:06.362 [2024-11-26T07:30:52.222Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:06.362 NVMe0n1 : 1.00 19556.25 76.39 0.00 0.00 6535.77 4126.34 12233.39 00:23:06.362 [2024-11-26T07:30:52.222Z] =================================================================================================================== 00:23:06.362 [2024-11-26T07:30:52.222Z] Total : 19556.25 76.39 0.00 0.00 6535.77 4126.34 12233.39 00:23:06.362 Received shutdown signal, test time was about 1.000000 seconds 00:23:06.362 00:23:06.362 Latency(us) 00:23:06.362 [2024-11-26T07:30:52.222Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:06.362 [2024-11-26T07:30:52.222Z] =================================================================================================================== 00:23:06.362 [2024-11-26T07:30:52.222Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:06.362 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:06.362 08:30:51 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:06.362 08:30:51 -- common/autotest_common.sh@1607 -- # read -r file 00:23:06.362 08:30:51 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:06.362 08:30:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:06.362 08:30:51 -- nvmf/common.sh@116 -- # sync 00:23:06.362 08:30:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:06.362 08:30:51 -- nvmf/common.sh@119 -- # set +e 00:23:06.362 08:30:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:06.362 08:30:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:06.363 rmmod nvme_tcp 00:23:06.363 rmmod nvme_fabrics 00:23:06.363 rmmod nvme_keyring 00:23:06.363 08:30:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:06.363 08:30:52 -- nvmf/common.sh@123 -- # set -e 00:23:06.363 08:30:52 -- nvmf/common.sh@124 -- # return 0 00:23:06.363 08:30:52 -- nvmf/common.sh@477 -- # '[' -n 1030441 ']' 00:23:06.363 08:30:52 -- nvmf/common.sh@478 -- # killprocess 1030441 00:23:06.363 08:30:52 -- common/autotest_common.sh@936 -- # '[' -z 1030441 ']' 00:23:06.363 08:30:52 -- common/autotest_common.sh@940 -- # kill -0 1030441 00:23:06.363 08:30:52 -- common/autotest_common.sh@941 -- # uname 00:23:06.363 08:30:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:06.363 08:30:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1030441 00:23:06.363 08:30:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:06.363 08:30:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:06.363 08:30:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1030441' 00:23:06.363 killing process with pid 1030441 00:23:06.363 08:30:52 -- common/autotest_common.sh@955 -- # kill 1030441 00:23:06.363 08:30:52 -- common/autotest_common.sh@960 -- # wait 1030441 00:23:06.623 08:30:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:06.623 08:30:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:06.623 08:30:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:06.623 08:30:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:06.623 08:30:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:06.623 08:30:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.623 08:30:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.623 08:30:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.161 08:30:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:09.161 00:23:09.161 real 0m8.859s 00:23:09.161 user 0m17.228s 00:23:09.161 sys 0m2.228s 00:23:09.161 08:30:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:09.161 08:30:54 -- common/autotest_common.sh@10 -- # set +x 00:23:09.161 ************************************ 00:23:09.161 END TEST nvmf_multicontroller 00:23:09.161 ************************************ 00:23:09.161 08:30:54 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:09.161 08:30:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:09.161 08:30:54 -- common/autotest_common.sh@10 -- # set +x 00:23:09.161 ************************************ 00:23:09.161 START TEST nvmf_aer 00:23:09.161 ************************************ 00:23:09.161 08:30:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:09.161 * Looking for test storage... 00:23:09.161 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:09.161 08:30:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:09.161 08:30:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:09.161 08:30:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:09.161 08:30:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:09.161 08:30:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:09.161 08:30:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:09.161 08:30:54 -- scripts/common.sh@335 -- # IFS=.-: 00:23:09.161 08:30:54 -- scripts/common.sh@335 -- # read -ra ver1 00:23:09.161 08:30:54 -- scripts/common.sh@336 -- # IFS=.-: 00:23:09.161 08:30:54 -- scripts/common.sh@336 -- # read -ra ver2 00:23:09.161 08:30:54 -- scripts/common.sh@337 -- # local 'op=<' 00:23:09.161 08:30:54 -- scripts/common.sh@339 -- # ver1_l=2 00:23:09.161 08:30:54 -- scripts/common.sh@340 -- # ver2_l=1 00:23:09.161 08:30:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:09.161 08:30:54 -- scripts/common.sh@343 -- # case "$op" in 00:23:09.161 08:30:54 -- scripts/common.sh@344 -- # : 1 00:23:09.161 08:30:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:09.161 08:30:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:09.161 08:30:54 -- scripts/common.sh@364 -- # decimal 1 00:23:09.161 08:30:54 -- scripts/common.sh@352 -- # local d=1 00:23:09.161 08:30:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:09.161 08:30:54 -- scripts/common.sh@354 -- # echo 1 00:23:09.161 08:30:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:09.161 08:30:54 -- scripts/common.sh@365 -- # decimal 2 00:23:09.161 08:30:54 -- scripts/common.sh@352 -- # local d=2 00:23:09.161 08:30:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:09.161 08:30:54 -- scripts/common.sh@354 -- # echo 2 00:23:09.161 08:30:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:09.161 08:30:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:09.161 08:30:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:09.161 08:30:54 -- scripts/common.sh@367 -- # return 0 00:23:09.161 08:30:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:09.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.161 --rc genhtml_branch_coverage=1 00:23:09.161 --rc genhtml_function_coverage=1 00:23:09.161 --rc genhtml_legend=1 00:23:09.161 --rc geninfo_all_blocks=1 00:23:09.161 --rc geninfo_unexecuted_blocks=1 00:23:09.161 00:23:09.161 ' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:09.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.161 --rc genhtml_branch_coverage=1 00:23:09.161 --rc genhtml_function_coverage=1 00:23:09.161 --rc genhtml_legend=1 00:23:09.161 --rc geninfo_all_blocks=1 00:23:09.161 --rc geninfo_unexecuted_blocks=1 00:23:09.161 00:23:09.161 ' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:09.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.161 --rc genhtml_branch_coverage=1 00:23:09.161 --rc genhtml_function_coverage=1 00:23:09.161 --rc genhtml_legend=1 00:23:09.161 --rc geninfo_all_blocks=1 00:23:09.161 --rc geninfo_unexecuted_blocks=1 00:23:09.161 00:23:09.161 ' 00:23:09.161 08:30:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:09.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.161 --rc genhtml_branch_coverage=1 00:23:09.161 --rc genhtml_function_coverage=1 00:23:09.161 --rc genhtml_legend=1 00:23:09.161 --rc geninfo_all_blocks=1 00:23:09.161 --rc geninfo_unexecuted_blocks=1 00:23:09.161 00:23:09.161 ' 00:23:09.161 08:30:54 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:09.161 08:30:54 -- nvmf/common.sh@7 -- # uname -s 00:23:09.161 08:30:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:09.161 08:30:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:09.161 08:30:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:09.161 08:30:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:09.161 08:30:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:09.161 08:30:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:09.161 08:30:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:09.161 08:30:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:09.161 08:30:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:09.161 08:30:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:09.161 08:30:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:09.161 08:30:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:09.162 08:30:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:09.162 08:30:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:09.162 08:30:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:09.162 08:30:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:09.162 08:30:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:09.162 08:30:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:09.162 08:30:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:09.162 08:30:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.162 08:30:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.162 08:30:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.162 08:30:54 -- paths/export.sh@5 -- # export PATH 00:23:09.162 08:30:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.162 08:30:54 -- nvmf/common.sh@46 -- # : 0 00:23:09.162 08:30:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:09.162 08:30:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:09.162 08:30:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:09.162 08:30:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:09.162 08:30:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:09.162 08:30:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:09.162 08:30:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:09.162 08:30:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:09.162 08:30:54 -- host/aer.sh@11 -- # nvmftestinit 00:23:09.162 08:30:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:09.162 08:30:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:09.162 08:30:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:09.162 08:30:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:09.162 08:30:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:09.162 08:30:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:09.162 08:30:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:09.162 08:30:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.162 08:30:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:09.162 08:30:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:09.162 08:30:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:09.162 08:30:54 -- common/autotest_common.sh@10 -- # set +x 00:23:11.069 08:30:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:11.069 08:30:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:11.069 08:30:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:11.069 08:30:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:11.069 08:30:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:11.069 08:30:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:11.069 08:30:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:11.069 08:30:56 -- nvmf/common.sh@294 -- # net_devs=() 00:23:11.069 08:30:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:11.069 08:30:56 -- nvmf/common.sh@295 -- # e810=() 00:23:11.069 08:30:56 -- nvmf/common.sh@295 -- # local -ga e810 00:23:11.069 08:30:56 -- nvmf/common.sh@296 -- # x722=() 00:23:11.069 08:30:56 -- nvmf/common.sh@296 -- # local -ga x722 00:23:11.069 08:30:56 -- nvmf/common.sh@297 -- # mlx=() 00:23:11.069 08:30:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:11.069 08:30:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:11.069 08:30:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:11.069 08:30:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:11.069 08:30:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:11.069 08:30:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:11.069 08:30:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:11.069 08:30:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.070 08:30:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:11.070 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:11.070 08:30:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.070 08:30:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:11.070 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:11.070 08:30:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.070 08:30:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.070 08:30:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.070 08:30:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:11.070 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:11.070 08:30:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.070 08:30:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.070 08:30:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.070 08:30:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.070 08:30:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:11.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:11.070 08:30:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.070 08:30:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:11.070 08:30:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:11.070 08:30:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:11.070 08:30:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:11.070 08:30:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:11.070 08:30:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:11.070 08:30:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:11.070 08:30:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:11.070 08:30:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:11.070 08:30:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:11.070 08:30:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:11.070 08:30:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:11.070 08:30:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:11.070 08:30:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:11.070 08:30:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:11.070 08:30:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:11.070 08:30:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:11.070 08:30:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:11.070 08:30:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:11.070 08:30:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:11.070 08:30:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:11.070 08:30:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:11.070 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:11.070 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:23:11.070 00:23:11.070 --- 10.0.0.2 ping statistics --- 00:23:11.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.070 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:23:11.070 08:30:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:11.070 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:11.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:23:11.070 00:23:11.070 --- 10.0.0.1 ping statistics --- 00:23:11.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.070 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:23:11.070 08:30:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:11.070 08:30:56 -- nvmf/common.sh@410 -- # return 0 00:23:11.070 08:30:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:11.070 08:30:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:11.070 08:30:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:11.070 08:30:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:11.070 08:30:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:11.070 08:30:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:11.070 08:30:56 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:11.070 08:30:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:11.070 08:30:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:11.070 08:30:56 -- common/autotest_common.sh@10 -- # set +x 00:23:11.070 08:30:56 -- nvmf/common.sh@469 -- # nvmfpid=1032970 00:23:11.070 08:30:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:11.070 08:30:56 -- nvmf/common.sh@470 -- # waitforlisten 1032970 00:23:11.070 08:30:56 -- common/autotest_common.sh@829 -- # '[' -z 1032970 ']' 00:23:11.070 08:30:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:11.070 08:30:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:11.070 08:30:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:11.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:11.070 08:30:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:11.070 08:30:56 -- common/autotest_common.sh@10 -- # set +x 00:23:11.070 [2024-11-26 08:30:56.847482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.070 [2024-11-26 08:30:56.847567] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:11.070 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.070 [2024-11-26 08:30:56.909649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:11.331 [2024-11-26 08:30:57.016988] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:11.331 [2024-11-26 08:30:57.017141] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:11.331 [2024-11-26 08:30:57.017174] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:11.331 [2024-11-26 08:30:57.017188] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:11.331 [2024-11-26 08:30:57.017241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:11.331 [2024-11-26 08:30:57.017292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:11.331 [2024-11-26 08:30:57.017342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:11.331 [2024-11-26 08:30:57.017345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:12.267 08:30:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:12.267 08:30:57 -- common/autotest_common.sh@862 -- # return 0 00:23:12.267 08:30:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:12.267 08:30:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 08:30:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:12.267 08:30:57 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 [2024-11-26 08:30:57.871383] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 Malloc0 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 [2024-11-26 08:30:57.925254] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:12.267 08:30:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.267 08:30:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.267 [2024-11-26 08:30:57.932946] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:12.267 [ 00:23:12.267 { 00:23:12.267 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:12.267 "subtype": "Discovery", 00:23:12.267 "listen_addresses": [], 00:23:12.267 "allow_any_host": true, 00:23:12.267 "hosts": [] 00:23:12.267 }, 00:23:12.267 { 00:23:12.267 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:12.267 "subtype": "NVMe", 00:23:12.267 "listen_addresses": [ 00:23:12.267 { 00:23:12.267 "transport": "TCP", 00:23:12.267 "trtype": "TCP", 00:23:12.267 "adrfam": "IPv4", 00:23:12.267 "traddr": "10.0.0.2", 00:23:12.267 "trsvcid": "4420" 00:23:12.267 } 00:23:12.267 ], 00:23:12.267 "allow_any_host": true, 00:23:12.267 "hosts": [], 00:23:12.267 "serial_number": "SPDK00000000000001", 00:23:12.267 "model_number": "SPDK bdev Controller", 00:23:12.267 "max_namespaces": 2, 00:23:12.267 "min_cntlid": 1, 00:23:12.267 "max_cntlid": 65519, 00:23:12.267 "namespaces": [ 00:23:12.267 { 00:23:12.267 "nsid": 1, 00:23:12.267 "bdev_name": "Malloc0", 00:23:12.267 "name": "Malloc0", 00:23:12.267 "nguid": "EFA27790049747E58631651177855EAD", 00:23:12.267 "uuid": "efa27790-0497-47e5-8631-651177855ead" 00:23:12.267 } 00:23:12.267 ] 00:23:12.267 } 00:23:12.267 ] 00:23:12.267 08:30:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.267 08:30:57 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:12.267 08:30:57 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:12.267 08:30:57 -- host/aer.sh@33 -- # aerpid=1033127 00:23:12.267 08:30:57 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:12.267 08:30:57 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:12.267 08:30:57 -- common/autotest_common.sh@1254 -- # local i=0 00:23:12.267 08:30:57 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.267 08:30:57 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:12.267 08:30:57 -- common/autotest_common.sh@1257 -- # i=1 00:23:12.267 08:30:57 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:12.267 EAL: No free 2048 kB hugepages reported on node 1 00:23:12.267 08:30:58 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.267 08:30:58 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:12.267 08:30:58 -- common/autotest_common.sh@1257 -- # i=2 00:23:12.267 08:30:58 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:12.526 08:30:58 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.526 08:30:58 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:23:12.526 08:30:58 -- common/autotest_common.sh@1257 -- # i=3 00:23:12.526 08:30:58 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:12.526 08:30:58 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.526 08:30:58 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.526 08:30:58 -- common/autotest_common.sh@1265 -- # return 0 00:23:12.526 08:30:58 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:12.526 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.526 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.526 Malloc1 00:23:12.526 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.526 08:30:58 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:12.526 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.526 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.526 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.526 08:30:58 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:12.526 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.526 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.526 Asynchronous Event Request test 00:23:12.526 Attaching to 10.0.0.2 00:23:12.526 Attached to 10.0.0.2 00:23:12.526 Registering asynchronous event callbacks... 00:23:12.526 Starting namespace attribute notice tests for all controllers... 00:23:12.526 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:12.526 aer_cb - Changed Namespace 00:23:12.526 Cleaning up... 00:23:12.526 [ 00:23:12.526 { 00:23:12.526 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:12.526 "subtype": "Discovery", 00:23:12.526 "listen_addresses": [], 00:23:12.526 "allow_any_host": true, 00:23:12.526 "hosts": [] 00:23:12.526 }, 00:23:12.526 { 00:23:12.526 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:12.526 "subtype": "NVMe", 00:23:12.526 "listen_addresses": [ 00:23:12.526 { 00:23:12.526 "transport": "TCP", 00:23:12.526 "trtype": "TCP", 00:23:12.526 "adrfam": "IPv4", 00:23:12.526 "traddr": "10.0.0.2", 00:23:12.526 "trsvcid": "4420" 00:23:12.526 } 00:23:12.526 ], 00:23:12.526 "allow_any_host": true, 00:23:12.526 "hosts": [], 00:23:12.526 "serial_number": "SPDK00000000000001", 00:23:12.526 "model_number": "SPDK bdev Controller", 00:23:12.526 "max_namespaces": 2, 00:23:12.526 "min_cntlid": 1, 00:23:12.526 "max_cntlid": 65519, 00:23:12.526 "namespaces": [ 00:23:12.526 { 00:23:12.526 "nsid": 1, 00:23:12.526 "bdev_name": "Malloc0", 00:23:12.526 "name": "Malloc0", 00:23:12.526 "nguid": "EFA27790049747E58631651177855EAD", 00:23:12.526 "uuid": "efa27790-0497-47e5-8631-651177855ead" 00:23:12.526 }, 00:23:12.526 { 00:23:12.526 "nsid": 2, 00:23:12.526 "bdev_name": "Malloc1", 00:23:12.526 "name": "Malloc1", 00:23:12.526 "nguid": "18CB61D2EAA14A47869C5D8A7F9063C2", 00:23:12.526 "uuid": "18cb61d2-eaa1-4a47-869c-5d8a7f9063c2" 00:23:12.526 } 00:23:12.526 ] 00:23:12.526 } 00:23:12.526 ] 00:23:12.526 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.526 08:30:58 -- host/aer.sh@43 -- # wait 1033127 00:23:12.526 08:30:58 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:12.526 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.526 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.526 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.526 08:30:58 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:12.526 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.526 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.785 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.785 08:30:58 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.785 08:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.785 08:30:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.785 08:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.785 08:30:58 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:12.785 08:30:58 -- host/aer.sh@51 -- # nvmftestfini 00:23:12.785 08:30:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:12.785 08:30:58 -- nvmf/common.sh@116 -- # sync 00:23:12.785 08:30:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:12.785 08:30:58 -- nvmf/common.sh@119 -- # set +e 00:23:12.785 08:30:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:12.785 08:30:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:12.785 rmmod nvme_tcp 00:23:12.785 rmmod nvme_fabrics 00:23:12.785 rmmod nvme_keyring 00:23:12.785 08:30:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:12.785 08:30:58 -- nvmf/common.sh@123 -- # set -e 00:23:12.785 08:30:58 -- nvmf/common.sh@124 -- # return 0 00:23:12.785 08:30:58 -- nvmf/common.sh@477 -- # '[' -n 1032970 ']' 00:23:12.785 08:30:58 -- nvmf/common.sh@478 -- # killprocess 1032970 00:23:12.785 08:30:58 -- common/autotest_common.sh@936 -- # '[' -z 1032970 ']' 00:23:12.785 08:30:58 -- common/autotest_common.sh@940 -- # kill -0 1032970 00:23:12.785 08:30:58 -- common/autotest_common.sh@941 -- # uname 00:23:12.785 08:30:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:12.785 08:30:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1032970 00:23:12.785 08:30:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:12.785 08:30:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:12.785 08:30:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1032970' 00:23:12.785 killing process with pid 1032970 00:23:12.785 08:30:58 -- common/autotest_common.sh@955 -- # kill 1032970 00:23:12.785 [2024-11-26 08:30:58.474410] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:12.785 08:30:58 -- common/autotest_common.sh@960 -- # wait 1032970 00:23:13.043 08:30:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:13.043 08:30:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:13.043 08:30:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:13.043 08:30:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:13.043 08:30:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:13.043 08:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.043 08:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.043 08:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.948 08:31:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:14.948 00:23:14.948 real 0m6.293s 00:23:14.948 user 0m7.705s 00:23:14.948 sys 0m1.954s 00:23:14.948 08:31:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:14.948 08:31:00 -- common/autotest_common.sh@10 -- # set +x 00:23:14.948 ************************************ 00:23:14.948 END TEST nvmf_aer 00:23:14.948 ************************************ 00:23:14.948 08:31:00 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:14.948 08:31:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:14.948 08:31:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:14.948 08:31:00 -- common/autotest_common.sh@10 -- # set +x 00:23:14.948 ************************************ 00:23:14.948 START TEST nvmf_async_init 00:23:14.948 ************************************ 00:23:14.948 08:31:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:15.207 * Looking for test storage... 00:23:15.207 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:15.207 08:31:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:15.207 08:31:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:15.207 08:31:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:15.207 08:31:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:15.207 08:31:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:15.207 08:31:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:15.207 08:31:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:15.207 08:31:00 -- scripts/common.sh@335 -- # IFS=.-: 00:23:15.207 08:31:00 -- scripts/common.sh@335 -- # read -ra ver1 00:23:15.207 08:31:00 -- scripts/common.sh@336 -- # IFS=.-: 00:23:15.207 08:31:00 -- scripts/common.sh@336 -- # read -ra ver2 00:23:15.207 08:31:00 -- scripts/common.sh@337 -- # local 'op=<' 00:23:15.207 08:31:00 -- scripts/common.sh@339 -- # ver1_l=2 00:23:15.207 08:31:00 -- scripts/common.sh@340 -- # ver2_l=1 00:23:15.207 08:31:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:15.207 08:31:00 -- scripts/common.sh@343 -- # case "$op" in 00:23:15.207 08:31:00 -- scripts/common.sh@344 -- # : 1 00:23:15.207 08:31:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:15.207 08:31:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:15.207 08:31:00 -- scripts/common.sh@364 -- # decimal 1 00:23:15.207 08:31:00 -- scripts/common.sh@352 -- # local d=1 00:23:15.207 08:31:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:15.207 08:31:00 -- scripts/common.sh@354 -- # echo 1 00:23:15.207 08:31:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:15.207 08:31:00 -- scripts/common.sh@365 -- # decimal 2 00:23:15.207 08:31:00 -- scripts/common.sh@352 -- # local d=2 00:23:15.207 08:31:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:15.207 08:31:00 -- scripts/common.sh@354 -- # echo 2 00:23:15.207 08:31:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:15.207 08:31:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:15.207 08:31:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:15.207 08:31:00 -- scripts/common.sh@367 -- # return 0 00:23:15.207 08:31:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:15.207 08:31:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:15.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.207 --rc genhtml_branch_coverage=1 00:23:15.207 --rc genhtml_function_coverage=1 00:23:15.207 --rc genhtml_legend=1 00:23:15.207 --rc geninfo_all_blocks=1 00:23:15.207 --rc geninfo_unexecuted_blocks=1 00:23:15.207 00:23:15.207 ' 00:23:15.207 08:31:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:15.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.207 --rc genhtml_branch_coverage=1 00:23:15.207 --rc genhtml_function_coverage=1 00:23:15.207 --rc genhtml_legend=1 00:23:15.207 --rc geninfo_all_blocks=1 00:23:15.208 --rc geninfo_unexecuted_blocks=1 00:23:15.208 00:23:15.208 ' 00:23:15.208 08:31:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:15.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.208 --rc genhtml_branch_coverage=1 00:23:15.208 --rc genhtml_function_coverage=1 00:23:15.208 --rc genhtml_legend=1 00:23:15.208 --rc geninfo_all_blocks=1 00:23:15.208 --rc geninfo_unexecuted_blocks=1 00:23:15.208 00:23:15.208 ' 00:23:15.208 08:31:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:15.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.208 --rc genhtml_branch_coverage=1 00:23:15.208 --rc genhtml_function_coverage=1 00:23:15.208 --rc genhtml_legend=1 00:23:15.208 --rc geninfo_all_blocks=1 00:23:15.208 --rc geninfo_unexecuted_blocks=1 00:23:15.208 00:23:15.208 ' 00:23:15.208 08:31:00 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:15.208 08:31:00 -- nvmf/common.sh@7 -- # uname -s 00:23:15.208 08:31:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:15.208 08:31:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:15.208 08:31:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:15.208 08:31:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:15.208 08:31:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:15.208 08:31:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:15.208 08:31:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:15.208 08:31:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:15.208 08:31:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:15.208 08:31:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:15.208 08:31:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.208 08:31:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.208 08:31:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:15.208 08:31:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:15.208 08:31:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:15.208 08:31:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:15.208 08:31:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:15.208 08:31:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:15.208 08:31:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:15.208 08:31:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.208 08:31:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.208 08:31:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.208 08:31:00 -- paths/export.sh@5 -- # export PATH 00:23:15.208 08:31:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.208 08:31:00 -- nvmf/common.sh@46 -- # : 0 00:23:15.208 08:31:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:15.208 08:31:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:15.208 08:31:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:15.208 08:31:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:15.208 08:31:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:15.208 08:31:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:15.208 08:31:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:15.208 08:31:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:15.208 08:31:00 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:15.208 08:31:00 -- host/async_init.sh@14 -- # null_block_size=512 00:23:15.208 08:31:00 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:15.208 08:31:00 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:15.208 08:31:00 -- host/async_init.sh@20 -- # uuidgen 00:23:15.208 08:31:00 -- host/async_init.sh@20 -- # tr -d - 00:23:15.208 08:31:00 -- host/async_init.sh@20 -- # nguid=ab213ddeae5342ce8e6d37cddf8f9b54 00:23:15.208 08:31:00 -- host/async_init.sh@22 -- # nvmftestinit 00:23:15.208 08:31:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:15.208 08:31:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:15.208 08:31:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:15.208 08:31:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:15.208 08:31:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:15.208 08:31:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.208 08:31:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.208 08:31:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.208 08:31:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:15.208 08:31:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:15.208 08:31:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:15.208 08:31:00 -- common/autotest_common.sh@10 -- # set +x 00:23:17.747 08:31:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:17.747 08:31:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:17.747 08:31:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:17.747 08:31:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:17.747 08:31:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:17.747 08:31:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:17.747 08:31:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:17.747 08:31:03 -- nvmf/common.sh@294 -- # net_devs=() 00:23:17.747 08:31:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:17.747 08:31:03 -- nvmf/common.sh@295 -- # e810=() 00:23:17.747 08:31:03 -- nvmf/common.sh@295 -- # local -ga e810 00:23:17.747 08:31:03 -- nvmf/common.sh@296 -- # x722=() 00:23:17.747 08:31:03 -- nvmf/common.sh@296 -- # local -ga x722 00:23:17.747 08:31:03 -- nvmf/common.sh@297 -- # mlx=() 00:23:17.747 08:31:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:17.747 08:31:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:17.747 08:31:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:17.747 08:31:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:17.748 08:31:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:17.748 08:31:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:17.748 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:17.748 08:31:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:17.748 08:31:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:17.748 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:17.748 08:31:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:17.748 08:31:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.748 08:31:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.748 08:31:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:17.748 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:17.748 08:31:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.748 08:31:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:17.748 08:31:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.748 08:31:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.748 08:31:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:17.748 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:17.748 08:31:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.748 08:31:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:17.748 08:31:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:17.748 08:31:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:17.748 08:31:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:17.748 08:31:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:17.748 08:31:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:17.748 08:31:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:17.748 08:31:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:17.748 08:31:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:17.748 08:31:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:17.748 08:31:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:17.748 08:31:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:17.748 08:31:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:17.748 08:31:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:17.748 08:31:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:17.748 08:31:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:17.748 08:31:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:17.748 08:31:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:17.748 08:31:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:17.748 08:31:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:17.748 08:31:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:17.748 08:31:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:17.748 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:17.748 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:23:17.748 00:23:17.748 --- 10.0.0.2 ping statistics --- 00:23:17.748 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.748 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:23:17.748 08:31:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:17.748 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:17.748 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:23:17.748 00:23:17.748 --- 10.0.0.1 ping statistics --- 00:23:17.748 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.748 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:23:17.748 08:31:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:17.748 08:31:03 -- nvmf/common.sh@410 -- # return 0 00:23:17.748 08:31:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:17.748 08:31:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:17.748 08:31:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:17.748 08:31:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:17.748 08:31:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:17.748 08:31:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:17.748 08:31:03 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:17.748 08:31:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:17.748 08:31:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:17.748 08:31:03 -- common/autotest_common.sh@10 -- # set +x 00:23:17.748 08:31:03 -- nvmf/common.sh@469 -- # nvmfpid=1035089 00:23:17.748 08:31:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:17.748 08:31:03 -- nvmf/common.sh@470 -- # waitforlisten 1035089 00:23:17.748 08:31:03 -- common/autotest_common.sh@829 -- # '[' -z 1035089 ']' 00:23:17.748 08:31:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:17.748 08:31:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:17.748 08:31:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:17.748 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:17.748 08:31:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:17.748 08:31:03 -- common/autotest_common.sh@10 -- # set +x 00:23:17.748 [2024-11-26 08:31:03.290373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:17.748 [2024-11-26 08:31:03.290464] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:17.748 EAL: No free 2048 kB hugepages reported on node 1 00:23:17.748 [2024-11-26 08:31:03.354931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:17.748 [2024-11-26 08:31:03.460288] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:17.748 [2024-11-26 08:31:03.460458] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:17.748 [2024-11-26 08:31:03.460474] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:17.748 [2024-11-26 08:31:03.460486] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:17.748 [2024-11-26 08:31:03.460513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:18.740 08:31:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:18.741 08:31:04 -- common/autotest_common.sh@862 -- # return 0 00:23:18.741 08:31:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:18.741 08:31:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 08:31:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:18.741 08:31:04 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 [2024-11-26 08:31:04.282365] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 null0 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ab213ddeae5342ce8e6d37cddf8f9b54 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 [2024-11-26 08:31:04.322642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 nvme0n1 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 [ 00:23:18.741 { 00:23:18.741 "name": "nvme0n1", 00:23:18.741 "aliases": [ 00:23:18.741 "ab213dde-ae53-42ce-8e6d-37cddf8f9b54" 00:23:18.741 ], 00:23:18.741 "product_name": "NVMe disk", 00:23:18.741 "block_size": 512, 00:23:18.741 "num_blocks": 2097152, 00:23:18.741 "uuid": "ab213dde-ae53-42ce-8e6d-37cddf8f9b54", 00:23:18.741 "assigned_rate_limits": { 00:23:18.741 "rw_ios_per_sec": 0, 00:23:18.741 "rw_mbytes_per_sec": 0, 00:23:18.741 "r_mbytes_per_sec": 0, 00:23:18.741 "w_mbytes_per_sec": 0 00:23:18.741 }, 00:23:18.741 "claimed": false, 00:23:18.741 "zoned": false, 00:23:18.741 "supported_io_types": { 00:23:18.741 "read": true, 00:23:18.741 "write": true, 00:23:18.741 "unmap": false, 00:23:18.741 "write_zeroes": true, 00:23:18.741 "flush": true, 00:23:18.741 "reset": true, 00:23:18.741 "compare": true, 00:23:18.741 "compare_and_write": true, 00:23:18.741 "abort": true, 00:23:18.741 "nvme_admin": true, 00:23:18.741 "nvme_io": true 00:23:18.741 }, 00:23:18.741 "driver_specific": { 00:23:18.741 "nvme": [ 00:23:18.741 { 00:23:18.741 "trid": { 00:23:18.741 "trtype": "TCP", 00:23:18.741 "adrfam": "IPv4", 00:23:18.741 "traddr": "10.0.0.2", 00:23:18.741 "trsvcid": "4420", 00:23:18.741 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.741 }, 00:23:18.741 "ctrlr_data": { 00:23:18.741 "cntlid": 1, 00:23:18.741 "vendor_id": "0x8086", 00:23:18.741 "model_number": "SPDK bdev Controller", 00:23:18.741 "serial_number": "00000000000000000000", 00:23:18.741 "firmware_revision": "24.01.1", 00:23:18.741 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.741 "oacs": { 00:23:18.741 "security": 0, 00:23:18.741 "format": 0, 00:23:18.741 "firmware": 0, 00:23:18.741 "ns_manage": 0 00:23:18.741 }, 00:23:18.741 "multi_ctrlr": true, 00:23:18.741 "ana_reporting": false 00:23:18.741 }, 00:23:18.741 "vs": { 00:23:18.741 "nvme_version": "1.3" 00:23:18.741 }, 00:23:18.741 "ns_data": { 00:23:18.741 "id": 1, 00:23:18.741 "can_share": true 00:23:18.741 } 00:23:18.741 } 00:23:18.741 ], 00:23:18.741 "mp_policy": "active_passive" 00:23:18.741 } 00:23:18.741 } 00:23:18.741 ] 00:23:18.741 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.741 08:31:04 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:18.741 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.741 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.741 [2024-11-26 08:31:04.571332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:18.741 [2024-11-26 08:31:04.571428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1317ba0 (9): Bad file descriptor 00:23:19.002 [2024-11-26 08:31:04.703862] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 [ 00:23:19.002 { 00:23:19.002 "name": "nvme0n1", 00:23:19.002 "aliases": [ 00:23:19.002 "ab213dde-ae53-42ce-8e6d-37cddf8f9b54" 00:23:19.002 ], 00:23:19.002 "product_name": "NVMe disk", 00:23:19.002 "block_size": 512, 00:23:19.002 "num_blocks": 2097152, 00:23:19.002 "uuid": "ab213dde-ae53-42ce-8e6d-37cddf8f9b54", 00:23:19.002 "assigned_rate_limits": { 00:23:19.002 "rw_ios_per_sec": 0, 00:23:19.002 "rw_mbytes_per_sec": 0, 00:23:19.002 "r_mbytes_per_sec": 0, 00:23:19.002 "w_mbytes_per_sec": 0 00:23:19.002 }, 00:23:19.002 "claimed": false, 00:23:19.002 "zoned": false, 00:23:19.002 "supported_io_types": { 00:23:19.002 "read": true, 00:23:19.002 "write": true, 00:23:19.002 "unmap": false, 00:23:19.002 "write_zeroes": true, 00:23:19.002 "flush": true, 00:23:19.002 "reset": true, 00:23:19.002 "compare": true, 00:23:19.002 "compare_and_write": true, 00:23:19.002 "abort": true, 00:23:19.002 "nvme_admin": true, 00:23:19.002 "nvme_io": true 00:23:19.002 }, 00:23:19.002 "driver_specific": { 00:23:19.002 "nvme": [ 00:23:19.002 { 00:23:19.002 "trid": { 00:23:19.002 "trtype": "TCP", 00:23:19.002 "adrfam": "IPv4", 00:23:19.002 "traddr": "10.0.0.2", 00:23:19.002 "trsvcid": "4420", 00:23:19.002 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:19.002 }, 00:23:19.002 "ctrlr_data": { 00:23:19.002 "cntlid": 2, 00:23:19.002 "vendor_id": "0x8086", 00:23:19.002 "model_number": "SPDK bdev Controller", 00:23:19.002 "serial_number": "00000000000000000000", 00:23:19.002 "firmware_revision": "24.01.1", 00:23:19.002 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:19.002 "oacs": { 00:23:19.002 "security": 0, 00:23:19.002 "format": 0, 00:23:19.002 "firmware": 0, 00:23:19.002 "ns_manage": 0 00:23:19.002 }, 00:23:19.002 "multi_ctrlr": true, 00:23:19.002 "ana_reporting": false 00:23:19.002 }, 00:23:19.002 "vs": { 00:23:19.002 "nvme_version": "1.3" 00:23:19.002 }, 00:23:19.002 "ns_data": { 00:23:19.002 "id": 1, 00:23:19.002 "can_share": true 00:23:19.002 } 00:23:19.002 } 00:23:19.002 ], 00:23:19.002 "mp_policy": "active_passive" 00:23:19.002 } 00:23:19.002 } 00:23:19.002 ] 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@53 -- # mktemp 00:23:19.002 08:31:04 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.YtM33Sp488 00:23:19.002 08:31:04 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:19.002 08:31:04 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.YtM33Sp488 00:23:19.002 08:31:04 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 [2024-11-26 08:31:04.751960] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:19.002 [2024-11-26 08:31:04.752094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.YtM33Sp488 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.YtM33Sp488 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 [2024-11-26 08:31:04.768009] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:19.002 nvme0n1 00:23:19.002 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.002 08:31:04 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:19.002 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.002 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.002 [ 00:23:19.002 { 00:23:19.002 "name": "nvme0n1", 00:23:19.002 "aliases": [ 00:23:19.002 "ab213dde-ae53-42ce-8e6d-37cddf8f9b54" 00:23:19.002 ], 00:23:19.002 "product_name": "NVMe disk", 00:23:19.002 "block_size": 512, 00:23:19.002 "num_blocks": 2097152, 00:23:19.002 "uuid": "ab213dde-ae53-42ce-8e6d-37cddf8f9b54", 00:23:19.002 "assigned_rate_limits": { 00:23:19.002 "rw_ios_per_sec": 0, 00:23:19.002 "rw_mbytes_per_sec": 0, 00:23:19.002 "r_mbytes_per_sec": 0, 00:23:19.002 "w_mbytes_per_sec": 0 00:23:19.002 }, 00:23:19.002 "claimed": false, 00:23:19.002 "zoned": false, 00:23:19.002 "supported_io_types": { 00:23:19.002 "read": true, 00:23:19.002 "write": true, 00:23:19.002 "unmap": false, 00:23:19.002 "write_zeroes": true, 00:23:19.002 "flush": true, 00:23:19.002 "reset": true, 00:23:19.002 "compare": true, 00:23:19.002 "compare_and_write": true, 00:23:19.002 "abort": true, 00:23:19.002 "nvme_admin": true, 00:23:19.002 "nvme_io": true 00:23:19.002 }, 00:23:19.002 "driver_specific": { 00:23:19.002 "nvme": [ 00:23:19.002 { 00:23:19.002 "trid": { 00:23:19.002 "trtype": "TCP", 00:23:19.002 "adrfam": "IPv4", 00:23:19.002 "traddr": "10.0.0.2", 00:23:19.002 "trsvcid": "4421", 00:23:19.002 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:19.002 }, 00:23:19.002 "ctrlr_data": { 00:23:19.002 "cntlid": 3, 00:23:19.002 "vendor_id": "0x8086", 00:23:19.002 "model_number": "SPDK bdev Controller", 00:23:19.002 "serial_number": "00000000000000000000", 00:23:19.002 "firmware_revision": "24.01.1", 00:23:19.002 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:19.002 "oacs": { 00:23:19.002 "security": 0, 00:23:19.002 "format": 0, 00:23:19.002 "firmware": 0, 00:23:19.002 "ns_manage": 0 00:23:19.002 }, 00:23:19.002 "multi_ctrlr": true, 00:23:19.002 "ana_reporting": false 00:23:19.002 }, 00:23:19.002 "vs": { 00:23:19.002 "nvme_version": "1.3" 00:23:19.002 }, 00:23:19.002 "ns_data": { 00:23:19.002 "id": 1, 00:23:19.002 "can_share": true 00:23:19.002 } 00:23:19.002 } 00:23:19.003 ], 00:23:19.003 "mp_policy": "active_passive" 00:23:19.003 } 00:23:19.003 } 00:23:19.003 ] 00:23:19.003 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.003 08:31:04 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:19.003 08:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.003 08:31:04 -- common/autotest_common.sh@10 -- # set +x 00:23:19.263 08:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.263 08:31:04 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.YtM33Sp488 00:23:19.263 08:31:04 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:19.263 08:31:04 -- host/async_init.sh@78 -- # nvmftestfini 00:23:19.263 08:31:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:19.263 08:31:04 -- nvmf/common.sh@116 -- # sync 00:23:19.263 08:31:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:19.263 08:31:04 -- nvmf/common.sh@119 -- # set +e 00:23:19.263 08:31:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:19.263 08:31:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:19.263 rmmod nvme_tcp 00:23:19.263 rmmod nvme_fabrics 00:23:19.263 rmmod nvme_keyring 00:23:19.263 08:31:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:19.263 08:31:04 -- nvmf/common.sh@123 -- # set -e 00:23:19.263 08:31:04 -- nvmf/common.sh@124 -- # return 0 00:23:19.263 08:31:04 -- nvmf/common.sh@477 -- # '[' -n 1035089 ']' 00:23:19.263 08:31:04 -- nvmf/common.sh@478 -- # killprocess 1035089 00:23:19.263 08:31:04 -- common/autotest_common.sh@936 -- # '[' -z 1035089 ']' 00:23:19.263 08:31:04 -- common/autotest_common.sh@940 -- # kill -0 1035089 00:23:19.263 08:31:04 -- common/autotest_common.sh@941 -- # uname 00:23:19.263 08:31:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:19.263 08:31:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1035089 00:23:19.263 08:31:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:19.263 08:31:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:19.263 08:31:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1035089' 00:23:19.263 killing process with pid 1035089 00:23:19.263 08:31:04 -- common/autotest_common.sh@955 -- # kill 1035089 00:23:19.263 08:31:04 -- common/autotest_common.sh@960 -- # wait 1035089 00:23:19.523 08:31:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:19.523 08:31:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:19.523 08:31:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:19.523 08:31:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:19.523 08:31:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:19.523 08:31:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:19.524 08:31:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:19.524 08:31:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.431 08:31:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:21.431 00:23:21.431 real 0m6.477s 00:23:21.431 user 0m3.149s 00:23:21.431 sys 0m1.918s 00:23:21.431 08:31:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:21.431 08:31:07 -- common/autotest_common.sh@10 -- # set +x 00:23:21.431 ************************************ 00:23:21.431 END TEST nvmf_async_init 00:23:21.431 ************************************ 00:23:21.690 08:31:07 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.690 08:31:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:21.690 08:31:07 -- common/autotest_common.sh@10 -- # set +x 00:23:21.690 ************************************ 00:23:21.690 START TEST dma 00:23:21.690 ************************************ 00:23:21.690 08:31:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.690 * Looking for test storage... 00:23:21.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.690 08:31:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:21.690 08:31:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:21.690 08:31:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:21.690 08:31:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:21.690 08:31:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:21.690 08:31:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:21.690 08:31:07 -- scripts/common.sh@335 -- # IFS=.-: 00:23:21.690 08:31:07 -- scripts/common.sh@335 -- # read -ra ver1 00:23:21.690 08:31:07 -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.690 08:31:07 -- scripts/common.sh@336 -- # read -ra ver2 00:23:21.690 08:31:07 -- scripts/common.sh@337 -- # local 'op=<' 00:23:21.690 08:31:07 -- scripts/common.sh@339 -- # ver1_l=2 00:23:21.690 08:31:07 -- scripts/common.sh@340 -- # ver2_l=1 00:23:21.690 08:31:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:21.690 08:31:07 -- scripts/common.sh@343 -- # case "$op" in 00:23:21.690 08:31:07 -- scripts/common.sh@344 -- # : 1 00:23:21.690 08:31:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:21.690 08:31:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.690 08:31:07 -- scripts/common.sh@364 -- # decimal 1 00:23:21.690 08:31:07 -- scripts/common.sh@352 -- # local d=1 00:23:21.690 08:31:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.690 08:31:07 -- scripts/common.sh@354 -- # echo 1 00:23:21.690 08:31:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:21.690 08:31:07 -- scripts/common.sh@365 -- # decimal 2 00:23:21.690 08:31:07 -- scripts/common.sh@352 -- # local d=2 00:23:21.690 08:31:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.690 08:31:07 -- scripts/common.sh@354 -- # echo 2 00:23:21.690 08:31:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:21.690 08:31:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:21.690 08:31:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:21.690 08:31:07 -- scripts/common.sh@367 -- # return 0 00:23:21.690 08:31:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:21.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.690 --rc genhtml_branch_coverage=1 00:23:21.690 --rc genhtml_function_coverage=1 00:23:21.690 --rc genhtml_legend=1 00:23:21.690 --rc geninfo_all_blocks=1 00:23:21.690 --rc geninfo_unexecuted_blocks=1 00:23:21.690 00:23:21.690 ' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:21.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.690 --rc genhtml_branch_coverage=1 00:23:21.690 --rc genhtml_function_coverage=1 00:23:21.690 --rc genhtml_legend=1 00:23:21.690 --rc geninfo_all_blocks=1 00:23:21.690 --rc geninfo_unexecuted_blocks=1 00:23:21.690 00:23:21.690 ' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:21.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.690 --rc genhtml_branch_coverage=1 00:23:21.690 --rc genhtml_function_coverage=1 00:23:21.690 --rc genhtml_legend=1 00:23:21.690 --rc geninfo_all_blocks=1 00:23:21.690 --rc geninfo_unexecuted_blocks=1 00:23:21.690 00:23:21.690 ' 00:23:21.690 08:31:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:21.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.691 --rc genhtml_branch_coverage=1 00:23:21.691 --rc genhtml_function_coverage=1 00:23:21.691 --rc genhtml_legend=1 00:23:21.691 --rc geninfo_all_blocks=1 00:23:21.691 --rc geninfo_unexecuted_blocks=1 00:23:21.691 00:23:21.691 ' 00:23:21.691 08:31:07 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.691 08:31:07 -- nvmf/common.sh@7 -- # uname -s 00:23:21.691 08:31:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.691 08:31:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.691 08:31:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.691 08:31:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.691 08:31:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.691 08:31:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.691 08:31:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.691 08:31:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.691 08:31:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.691 08:31:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.691 08:31:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.691 08:31:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.691 08:31:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.691 08:31:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.691 08:31:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.691 08:31:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.691 08:31:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.691 08:31:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.691 08:31:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.691 08:31:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.691 08:31:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.691 08:31:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.691 08:31:07 -- paths/export.sh@5 -- # export PATH 00:23:21.691 08:31:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.691 08:31:07 -- nvmf/common.sh@46 -- # : 0 00:23:21.691 08:31:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:21.691 08:31:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:21.691 08:31:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:21.691 08:31:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.691 08:31:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.691 08:31:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:21.691 08:31:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:21.691 08:31:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:21.691 08:31:07 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:21.691 08:31:07 -- host/dma.sh@13 -- # exit 0 00:23:21.691 00:23:21.691 real 0m0.143s 00:23:21.691 user 0m0.095s 00:23:21.691 sys 0m0.056s 00:23:21.691 08:31:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:21.691 08:31:07 -- common/autotest_common.sh@10 -- # set +x 00:23:21.691 ************************************ 00:23:21.691 END TEST dma 00:23:21.691 ************************************ 00:23:21.691 08:31:07 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.691 08:31:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:21.691 08:31:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:21.691 08:31:07 -- common/autotest_common.sh@10 -- # set +x 00:23:21.691 ************************************ 00:23:21.691 START TEST nvmf_identify 00:23:21.691 ************************************ 00:23:21.691 08:31:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.691 * Looking for test storage... 00:23:21.691 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.691 08:31:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:21.691 08:31:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:21.691 08:31:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:21.951 08:31:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:21.951 08:31:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:21.951 08:31:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:21.951 08:31:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:21.951 08:31:07 -- scripts/common.sh@335 -- # IFS=.-: 00:23:21.951 08:31:07 -- scripts/common.sh@335 -- # read -ra ver1 00:23:21.951 08:31:07 -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.951 08:31:07 -- scripts/common.sh@336 -- # read -ra ver2 00:23:21.951 08:31:07 -- scripts/common.sh@337 -- # local 'op=<' 00:23:21.951 08:31:07 -- scripts/common.sh@339 -- # ver1_l=2 00:23:21.951 08:31:07 -- scripts/common.sh@340 -- # ver2_l=1 00:23:21.951 08:31:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:21.951 08:31:07 -- scripts/common.sh@343 -- # case "$op" in 00:23:21.951 08:31:07 -- scripts/common.sh@344 -- # : 1 00:23:21.951 08:31:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:21.951 08:31:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.951 08:31:07 -- scripts/common.sh@364 -- # decimal 1 00:23:21.951 08:31:07 -- scripts/common.sh@352 -- # local d=1 00:23:21.951 08:31:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.951 08:31:07 -- scripts/common.sh@354 -- # echo 1 00:23:21.951 08:31:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:21.951 08:31:07 -- scripts/common.sh@365 -- # decimal 2 00:23:21.951 08:31:07 -- scripts/common.sh@352 -- # local d=2 00:23:21.951 08:31:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.951 08:31:07 -- scripts/common.sh@354 -- # echo 2 00:23:21.951 08:31:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:21.951 08:31:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:21.951 08:31:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:21.951 08:31:07 -- scripts/common.sh@367 -- # return 0 00:23:21.951 08:31:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.951 08:31:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:21.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.951 --rc genhtml_branch_coverage=1 00:23:21.951 --rc genhtml_function_coverage=1 00:23:21.951 --rc genhtml_legend=1 00:23:21.951 --rc geninfo_all_blocks=1 00:23:21.951 --rc geninfo_unexecuted_blocks=1 00:23:21.951 00:23:21.951 ' 00:23:21.951 08:31:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:21.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.951 --rc genhtml_branch_coverage=1 00:23:21.951 --rc genhtml_function_coverage=1 00:23:21.951 --rc genhtml_legend=1 00:23:21.951 --rc geninfo_all_blocks=1 00:23:21.951 --rc geninfo_unexecuted_blocks=1 00:23:21.951 00:23:21.951 ' 00:23:21.951 08:31:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:21.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.951 --rc genhtml_branch_coverage=1 00:23:21.951 --rc genhtml_function_coverage=1 00:23:21.951 --rc genhtml_legend=1 00:23:21.951 --rc geninfo_all_blocks=1 00:23:21.951 --rc geninfo_unexecuted_blocks=1 00:23:21.951 00:23:21.951 ' 00:23:21.951 08:31:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:21.951 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.951 --rc genhtml_branch_coverage=1 00:23:21.951 --rc genhtml_function_coverage=1 00:23:21.951 --rc genhtml_legend=1 00:23:21.951 --rc geninfo_all_blocks=1 00:23:21.951 --rc geninfo_unexecuted_blocks=1 00:23:21.951 00:23:21.951 ' 00:23:21.951 08:31:07 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.951 08:31:07 -- nvmf/common.sh@7 -- # uname -s 00:23:21.951 08:31:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.951 08:31:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.951 08:31:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.951 08:31:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.951 08:31:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.951 08:31:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.951 08:31:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.951 08:31:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.951 08:31:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.951 08:31:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.951 08:31:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.951 08:31:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.951 08:31:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.951 08:31:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.951 08:31:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.951 08:31:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.951 08:31:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.951 08:31:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.951 08:31:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.951 08:31:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.951 08:31:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.951 08:31:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.952 08:31:07 -- paths/export.sh@5 -- # export PATH 00:23:21.952 08:31:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.952 08:31:07 -- nvmf/common.sh@46 -- # : 0 00:23:21.952 08:31:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:21.952 08:31:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:21.952 08:31:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:21.952 08:31:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.952 08:31:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.952 08:31:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:21.952 08:31:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:21.952 08:31:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:21.952 08:31:07 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:21.952 08:31:07 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:21.952 08:31:07 -- host/identify.sh@14 -- # nvmftestinit 00:23:21.952 08:31:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:21.952 08:31:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:21.952 08:31:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:21.952 08:31:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:21.952 08:31:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:21.952 08:31:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.952 08:31:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.952 08:31:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.952 08:31:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:21.952 08:31:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:21.952 08:31:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:21.952 08:31:07 -- common/autotest_common.sh@10 -- # set +x 00:23:23.855 08:31:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:23.855 08:31:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:23.855 08:31:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:23.855 08:31:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:23.855 08:31:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:23.855 08:31:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:23.855 08:31:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:23.855 08:31:09 -- nvmf/common.sh@294 -- # net_devs=() 00:23:23.855 08:31:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:23.855 08:31:09 -- nvmf/common.sh@295 -- # e810=() 00:23:23.855 08:31:09 -- nvmf/common.sh@295 -- # local -ga e810 00:23:23.855 08:31:09 -- nvmf/common.sh@296 -- # x722=() 00:23:23.855 08:31:09 -- nvmf/common.sh@296 -- # local -ga x722 00:23:23.855 08:31:09 -- nvmf/common.sh@297 -- # mlx=() 00:23:23.855 08:31:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:23.855 08:31:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:23.855 08:31:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:23.855 08:31:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:23.855 08:31:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:23.855 08:31:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.855 08:31:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:23.855 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:23.855 08:31:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.855 08:31:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:23.855 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:23.855 08:31:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:23.855 08:31:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.855 08:31:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.855 08:31:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.855 08:31:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.855 08:31:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:23.855 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:23.855 08:31:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.855 08:31:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.855 08:31:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.855 08:31:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.855 08:31:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.855 08:31:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:23.855 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:23.855 08:31:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.855 08:31:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:23.855 08:31:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:23.855 08:31:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:23.855 08:31:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:23.856 08:31:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:23.856 08:31:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:23.856 08:31:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:23.856 08:31:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:23.856 08:31:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:23.856 08:31:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:23.856 08:31:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:23.856 08:31:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:23.856 08:31:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:23.856 08:31:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:23.856 08:31:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:23.856 08:31:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:23.856 08:31:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:23.856 08:31:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:23.856 08:31:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:23.856 08:31:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:23.856 08:31:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:23.856 08:31:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:23.856 08:31:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:23.856 08:31:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:23.856 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:23.856 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:23:23.856 00:23:23.856 --- 10.0.0.2 ping statistics --- 00:23:23.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.856 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:23:23.856 08:31:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:23.856 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:23.856 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:23:23.856 00:23:23.856 --- 10.0.0.1 ping statistics --- 00:23:23.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.856 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:23:23.856 08:31:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:23.856 08:31:09 -- nvmf/common.sh@410 -- # return 0 00:23:23.856 08:31:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:23.856 08:31:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:23.856 08:31:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:23.856 08:31:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:23.856 08:31:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:23.856 08:31:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:23.856 08:31:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:23.856 08:31:09 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:23.856 08:31:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:23.856 08:31:09 -- common/autotest_common.sh@10 -- # set +x 00:23:23.856 08:31:09 -- host/identify.sh@19 -- # nvmfpid=1037375 00:23:23.856 08:31:09 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:23.856 08:31:09 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:23.856 08:31:09 -- host/identify.sh@23 -- # waitforlisten 1037375 00:23:23.856 08:31:09 -- common/autotest_common.sh@829 -- # '[' -z 1037375 ']' 00:23:23.856 08:31:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:23.856 08:31:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:23.856 08:31:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:23.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:23.856 08:31:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:23.856 08:31:09 -- common/autotest_common.sh@10 -- # set +x 00:23:24.116 [2024-11-26 08:31:09.740621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:24.116 [2024-11-26 08:31:09.740705] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:24.116 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.116 [2024-11-26 08:31:09.810545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:24.116 [2024-11-26 08:31:09.926156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:24.116 [2024-11-26 08:31:09.926319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:24.116 [2024-11-26 08:31:09.926338] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:24.116 [2024-11-26 08:31:09.926352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:24.116 [2024-11-26 08:31:09.926435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:24.116 [2024-11-26 08:31:09.926504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:24.116 [2024-11-26 08:31:09.926598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:24.116 [2024-11-26 08:31:09.926601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:25.054 08:31:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:25.054 08:31:10 -- common/autotest_common.sh@862 -- # return 0 00:23:25.054 08:31:10 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 [2024-11-26 08:31:10.761297] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:25.054 08:31:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 08:31:10 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 Malloc0 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 [2024-11-26 08:31:10.832612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:25.054 08:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.054 08:31:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.054 [2024-11-26 08:31:10.848359] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:25.054 [ 00:23:25.054 { 00:23:25.054 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:25.054 "subtype": "Discovery", 00:23:25.054 "listen_addresses": [ 00:23:25.054 { 00:23:25.054 "transport": "TCP", 00:23:25.054 "trtype": "TCP", 00:23:25.054 "adrfam": "IPv4", 00:23:25.054 "traddr": "10.0.0.2", 00:23:25.054 "trsvcid": "4420" 00:23:25.054 } 00:23:25.054 ], 00:23:25.054 "allow_any_host": true, 00:23:25.054 "hosts": [] 00:23:25.054 }, 00:23:25.054 { 00:23:25.054 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:25.054 "subtype": "NVMe", 00:23:25.054 "listen_addresses": [ 00:23:25.054 { 00:23:25.054 "transport": "TCP", 00:23:25.054 "trtype": "TCP", 00:23:25.054 "adrfam": "IPv4", 00:23:25.054 "traddr": "10.0.0.2", 00:23:25.054 "trsvcid": "4420" 00:23:25.054 } 00:23:25.054 ], 00:23:25.054 "allow_any_host": true, 00:23:25.054 "hosts": [], 00:23:25.054 "serial_number": "SPDK00000000000001", 00:23:25.054 "model_number": "SPDK bdev Controller", 00:23:25.054 "max_namespaces": 32, 00:23:25.054 "min_cntlid": 1, 00:23:25.054 "max_cntlid": 65519, 00:23:25.054 "namespaces": [ 00:23:25.054 { 00:23:25.054 "nsid": 1, 00:23:25.054 "bdev_name": "Malloc0", 00:23:25.054 "name": "Malloc0", 00:23:25.054 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:25.054 "eui64": "ABCDEF0123456789", 00:23:25.054 "uuid": "c11d0a5f-c379-4969-944a-67f1f4ae9ca4" 00:23:25.054 } 00:23:25.054 ] 00:23:25.054 } 00:23:25.054 ] 00:23:25.054 08:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.054 08:31:10 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:25.054 [2024-11-26 08:31:10.869313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:25.054 [2024-11-26 08:31:10.869350] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1037540 ] 00:23:25.054 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.054 [2024-11-26 08:31:10.901871] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:25.054 [2024-11-26 08:31:10.901928] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:25.054 [2024-11-26 08:31:10.901938] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:25.054 [2024-11-26 08:31:10.901954] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:25.054 [2024-11-26 08:31:10.901967] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:25.054 [2024-11-26 08:31:10.902321] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:25.054 [2024-11-26 08:31:10.902384] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2439e10 0 00:23:25.316 [2024-11-26 08:31:10.912703] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:25.317 [2024-11-26 08:31:10.912724] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:25.317 [2024-11-26 08:31:10.912748] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:25.317 [2024-11-26 08:31:10.912754] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:25.317 [2024-11-26 08:31:10.912822] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.912836] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.912843] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.912862] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:25.317 [2024-11-26 08:31:10.912890] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.920713] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.920732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.920739] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.920747] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.920771] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:25.317 [2024-11-26 08:31:10.920783] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:25.317 [2024-11-26 08:31:10.920792] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:25.317 [2024-11-26 08:31:10.920812] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.920821] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.920827] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.920838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.920862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.921019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.921034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.921041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921048] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.921058] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:25.317 [2024-11-26 08:31:10.921071] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:25.317 [2024-11-26 08:31:10.921083] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921090] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921096] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.921107] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.921128] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.921231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.921246] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.921252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921259] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.921268] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:25.317 [2024-11-26 08:31:10.921283] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.921295] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921302] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921308] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.921319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.921339] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.921430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.921445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.921452] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.921473] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.921491] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921500] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921506] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.921516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.921537] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.921629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.921640] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.921647] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921653] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.921662] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:25.317 [2024-11-26 08:31:10.921670] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.921683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.921803] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:25.317 [2024-11-26 08:31:10.921812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.921827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921834] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.921841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.921851] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.921873] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.921996] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.922011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.922018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.922034] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:25.317 [2024-11-26 08:31:10.922050] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922059] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922065] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.922076] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.922096] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.922181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.317 [2024-11-26 08:31:10.922192] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.317 [2024-11-26 08:31:10.922203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922210] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.317 [2024-11-26 08:31:10.922218] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:25.317 [2024-11-26 08:31:10.922227] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:25.317 [2024-11-26 08:31:10.922239] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:25.317 [2024-11-26 08:31:10.922253] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:25.317 [2024-11-26 08:31:10.922269] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.317 [2024-11-26 08:31:10.922294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.317 [2024-11-26 08:31:10.922315] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.317 [2024-11-26 08:31:10.922439] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.317 [2024-11-26 08:31:10.922451] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.317 [2024-11-26 08:31:10.922457] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922464] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2439e10): datao=0, datal=4096, cccid=0 00:23:25.317 [2024-11-26 08:31:10.922472] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24b9b30) on tqpair(0x2439e10): expected_datao=0, payload_size=4096 00:23:25.317 [2024-11-26 08:31:10.922490] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.317 [2024-11-26 08:31:10.922500] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.962814] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:10.962834] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:10.962841] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.962848] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:10.962863] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:25.318 [2024-11-26 08:31:10.962872] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:25.318 [2024-11-26 08:31:10.962880] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:25.318 [2024-11-26 08:31:10.962888] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:25.318 [2024-11-26 08:31:10.962896] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:25.318 [2024-11-26 08:31:10.962904] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:25.318 [2024-11-26 08:31:10.962924] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:25.318 [2024-11-26 08:31:10.962938] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.962946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.962952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.962967] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:25.318 [2024-11-26 08:31:10.962997] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.318 [2024-11-26 08:31:10.963130] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:10.963142] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:10.963148] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963155] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9b30) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:10.963169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.318 [2024-11-26 08:31:10.963202] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963209] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963215] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963223] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.318 [2024-11-26 08:31:10.963233] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963239] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963254] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.318 [2024-11-26 08:31:10.963263] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963270] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963275] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.318 [2024-11-26 08:31:10.963293] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:25.318 [2024-11-26 08:31:10.963312] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:25.318 [2024-11-26 08:31:10.963324] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963331] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963337] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963347] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.318 [2024-11-26 08:31:10.963370] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9b30, cid 0, qid 0 00:23:25.318 [2024-11-26 08:31:10.963381] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9c90, cid 1, qid 0 00:23:25.318 [2024-11-26 08:31:10.963389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9df0, cid 2, qid 0 00:23:25.318 [2024-11-26 08:31:10.963396] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.318 [2024-11-26 08:31:10.963404] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba0b0, cid 4, qid 0 00:23:25.318 [2024-11-26 08:31:10.963565] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:10.963578] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:10.963584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba0b0) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:10.963601] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:25.318 [2024-11-26 08:31:10.963609] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:25.318 [2024-11-26 08:31:10.963627] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963636] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963642] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.963652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.318 [2024-11-26 08:31:10.963673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba0b0, cid 4, qid 0 00:23:25.318 [2024-11-26 08:31:10.963833] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.318 [2024-11-26 08:31:10.963848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.318 [2024-11-26 08:31:10.963855] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963861] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2439e10): datao=0, datal=4096, cccid=4 00:23:25.318 [2024-11-26 08:31:10.963869] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24ba0b0) on tqpair(0x2439e10): expected_datao=0, payload_size=4096 00:23:25.318 [2024-11-26 08:31:10.963880] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963887] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963899] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:10.963909] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:10.963915] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963921] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba0b0) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:10.963941] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:25.318 [2024-11-26 08:31:10.963979] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963989] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.963996] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.964006] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.318 [2024-11-26 08:31:10.964018] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964025] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964031] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:10.964040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.318 [2024-11-26 08:31:10.964066] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba0b0, cid 4, qid 0 00:23:25.318 [2024-11-26 08:31:10.964078] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba210, cid 5, qid 0 00:23:25.318 [2024-11-26 08:31:10.964248] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.318 [2024-11-26 08:31:10.964261] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.318 [2024-11-26 08:31:10.964271] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964278] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2439e10): datao=0, datal=1024, cccid=4 00:23:25.318 [2024-11-26 08:31:10.964286] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24ba0b0) on tqpair(0x2439e10): expected_datao=0, payload_size=1024 00:23:25.318 [2024-11-26 08:31:10.964296] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964304] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:10.964321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:10.964327] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:10.964334] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba210) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:11.008702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.318 [2024-11-26 08:31:11.008735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.318 [2024-11-26 08:31:11.008743] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:11.008750] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba0b0) on tqpair=0x2439e10 00:23:25.318 [2024-11-26 08:31:11.008769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:11.008778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.318 [2024-11-26 08:31:11.008784] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2439e10) 00:23:25.318 [2024-11-26 08:31:11.008795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.318 [2024-11-26 08:31:11.008840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba0b0, cid 4, qid 0 00:23:25.318 [2024-11-26 08:31:11.008995] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.319 [2024-11-26 08:31:11.009008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.319 [2024-11-26 08:31:11.009014] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009021] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2439e10): datao=0, datal=3072, cccid=4 00:23:25.319 [2024-11-26 08:31:11.009028] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24ba0b0) on tqpair(0x2439e10): expected_datao=0, payload_size=3072 00:23:25.319 [2024-11-26 08:31:11.009039] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009047] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.319 [2024-11-26 08:31:11.009067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.319 [2024-11-26 08:31:11.009074] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba0b0) on tqpair=0x2439e10 00:23:25.319 [2024-11-26 08:31:11.009097] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009105] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009111] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2439e10) 00:23:25.319 [2024-11-26 08:31:11.009122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.319 [2024-11-26 08:31:11.009149] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24ba0b0, cid 4, qid 0 00:23:25.319 [2024-11-26 08:31:11.009271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.319 [2024-11-26 08:31:11.009287] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.319 [2024-11-26 08:31:11.009294] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009304] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2439e10): datao=0, datal=8, cccid=4 00:23:25.319 [2024-11-26 08:31:11.009313] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24ba0b0) on tqpair(0x2439e10): expected_datao=0, payload_size=8 00:23:25.319 [2024-11-26 08:31:11.009323] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.009330] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.049807] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.319 [2024-11-26 08:31:11.049827] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.319 [2024-11-26 08:31:11.049834] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.319 [2024-11-26 08:31:11.049841] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24ba0b0) on tqpair=0x2439e10 00:23:25.319 ===================================================== 00:23:25.319 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:25.319 ===================================================== 00:23:25.319 Controller Capabilities/Features 00:23:25.319 ================================ 00:23:25.319 Vendor ID: 0000 00:23:25.319 Subsystem Vendor ID: 0000 00:23:25.319 Serial Number: .................... 00:23:25.319 Model Number: ........................................ 00:23:25.319 Firmware Version: 24.01.1 00:23:25.319 Recommended Arb Burst: 0 00:23:25.319 IEEE OUI Identifier: 00 00 00 00:23:25.319 Multi-path I/O 00:23:25.319 May have multiple subsystem ports: No 00:23:25.319 May have multiple controllers: No 00:23:25.319 Associated with SR-IOV VF: No 00:23:25.319 Max Data Transfer Size: 131072 00:23:25.319 Max Number of Namespaces: 0 00:23:25.319 Max Number of I/O Queues: 1024 00:23:25.319 NVMe Specification Version (VS): 1.3 00:23:25.319 NVMe Specification Version (Identify): 1.3 00:23:25.319 Maximum Queue Entries: 128 00:23:25.319 Contiguous Queues Required: Yes 00:23:25.319 Arbitration Mechanisms Supported 00:23:25.319 Weighted Round Robin: Not Supported 00:23:25.319 Vendor Specific: Not Supported 00:23:25.319 Reset Timeout: 15000 ms 00:23:25.319 Doorbell Stride: 4 bytes 00:23:25.319 NVM Subsystem Reset: Not Supported 00:23:25.319 Command Sets Supported 00:23:25.319 NVM Command Set: Supported 00:23:25.319 Boot Partition: Not Supported 00:23:25.319 Memory Page Size Minimum: 4096 bytes 00:23:25.319 Memory Page Size Maximum: 4096 bytes 00:23:25.319 Persistent Memory Region: Not Supported 00:23:25.319 Optional Asynchronous Events Supported 00:23:25.319 Namespace Attribute Notices: Not Supported 00:23:25.319 Firmware Activation Notices: Not Supported 00:23:25.319 ANA Change Notices: Not Supported 00:23:25.319 PLE Aggregate Log Change Notices: Not Supported 00:23:25.319 LBA Status Info Alert Notices: Not Supported 00:23:25.319 EGE Aggregate Log Change Notices: Not Supported 00:23:25.319 Normal NVM Subsystem Shutdown event: Not Supported 00:23:25.319 Zone Descriptor Change Notices: Not Supported 00:23:25.319 Discovery Log Change Notices: Supported 00:23:25.319 Controller Attributes 00:23:25.319 128-bit Host Identifier: Not Supported 00:23:25.319 Non-Operational Permissive Mode: Not Supported 00:23:25.319 NVM Sets: Not Supported 00:23:25.319 Read Recovery Levels: Not Supported 00:23:25.319 Endurance Groups: Not Supported 00:23:25.319 Predictable Latency Mode: Not Supported 00:23:25.319 Traffic Based Keep ALive: Not Supported 00:23:25.319 Namespace Granularity: Not Supported 00:23:25.319 SQ Associations: Not Supported 00:23:25.319 UUID List: Not Supported 00:23:25.319 Multi-Domain Subsystem: Not Supported 00:23:25.319 Fixed Capacity Management: Not Supported 00:23:25.319 Variable Capacity Management: Not Supported 00:23:25.319 Delete Endurance Group: Not Supported 00:23:25.319 Delete NVM Set: Not Supported 00:23:25.319 Extended LBA Formats Supported: Not Supported 00:23:25.319 Flexible Data Placement Supported: Not Supported 00:23:25.319 00:23:25.319 Controller Memory Buffer Support 00:23:25.319 ================================ 00:23:25.319 Supported: No 00:23:25.319 00:23:25.319 Persistent Memory Region Support 00:23:25.319 ================================ 00:23:25.319 Supported: No 00:23:25.319 00:23:25.319 Admin Command Set Attributes 00:23:25.319 ============================ 00:23:25.319 Security Send/Receive: Not Supported 00:23:25.319 Format NVM: Not Supported 00:23:25.319 Firmware Activate/Download: Not Supported 00:23:25.319 Namespace Management: Not Supported 00:23:25.319 Device Self-Test: Not Supported 00:23:25.319 Directives: Not Supported 00:23:25.319 NVMe-MI: Not Supported 00:23:25.319 Virtualization Management: Not Supported 00:23:25.319 Doorbell Buffer Config: Not Supported 00:23:25.319 Get LBA Status Capability: Not Supported 00:23:25.319 Command & Feature Lockdown Capability: Not Supported 00:23:25.319 Abort Command Limit: 1 00:23:25.319 Async Event Request Limit: 4 00:23:25.319 Number of Firmware Slots: N/A 00:23:25.319 Firmware Slot 1 Read-Only: N/A 00:23:25.319 Firmware Activation Without Reset: N/A 00:23:25.319 Multiple Update Detection Support: N/A 00:23:25.319 Firmware Update Granularity: No Information Provided 00:23:25.319 Per-Namespace SMART Log: No 00:23:25.319 Asymmetric Namespace Access Log Page: Not Supported 00:23:25.319 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:25.319 Command Effects Log Page: Not Supported 00:23:25.319 Get Log Page Extended Data: Supported 00:23:25.319 Telemetry Log Pages: Not Supported 00:23:25.319 Persistent Event Log Pages: Not Supported 00:23:25.319 Supported Log Pages Log Page: May Support 00:23:25.319 Commands Supported & Effects Log Page: Not Supported 00:23:25.319 Feature Identifiers & Effects Log Page:May Support 00:23:25.319 NVMe-MI Commands & Effects Log Page: May Support 00:23:25.319 Data Area 4 for Telemetry Log: Not Supported 00:23:25.319 Error Log Page Entries Supported: 128 00:23:25.319 Keep Alive: Not Supported 00:23:25.319 00:23:25.319 NVM Command Set Attributes 00:23:25.319 ========================== 00:23:25.319 Submission Queue Entry Size 00:23:25.319 Max: 1 00:23:25.319 Min: 1 00:23:25.319 Completion Queue Entry Size 00:23:25.319 Max: 1 00:23:25.319 Min: 1 00:23:25.319 Number of Namespaces: 0 00:23:25.319 Compare Command: Not Supported 00:23:25.319 Write Uncorrectable Command: Not Supported 00:23:25.319 Dataset Management Command: Not Supported 00:23:25.319 Write Zeroes Command: Not Supported 00:23:25.319 Set Features Save Field: Not Supported 00:23:25.319 Reservations: Not Supported 00:23:25.319 Timestamp: Not Supported 00:23:25.319 Copy: Not Supported 00:23:25.319 Volatile Write Cache: Not Present 00:23:25.319 Atomic Write Unit (Normal): 1 00:23:25.319 Atomic Write Unit (PFail): 1 00:23:25.319 Atomic Compare & Write Unit: 1 00:23:25.319 Fused Compare & Write: Supported 00:23:25.319 Scatter-Gather List 00:23:25.319 SGL Command Set: Supported 00:23:25.319 SGL Keyed: Supported 00:23:25.319 SGL Bit Bucket Descriptor: Not Supported 00:23:25.319 SGL Metadata Pointer: Not Supported 00:23:25.319 Oversized SGL: Not Supported 00:23:25.319 SGL Metadata Address: Not Supported 00:23:25.319 SGL Offset: Supported 00:23:25.319 Transport SGL Data Block: Not Supported 00:23:25.319 Replay Protected Memory Block: Not Supported 00:23:25.319 00:23:25.319 Firmware Slot Information 00:23:25.319 ========================= 00:23:25.319 Active slot: 0 00:23:25.319 00:23:25.319 00:23:25.319 Error Log 00:23:25.319 ========= 00:23:25.319 00:23:25.319 Active Namespaces 00:23:25.319 ================= 00:23:25.319 Discovery Log Page 00:23:25.319 ================== 00:23:25.319 Generation Counter: 2 00:23:25.320 Number of Records: 2 00:23:25.320 Record Format: 0 00:23:25.320 00:23:25.320 Discovery Log Entry 0 00:23:25.320 ---------------------- 00:23:25.320 Transport Type: 3 (TCP) 00:23:25.320 Address Family: 1 (IPv4) 00:23:25.320 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:25.320 Entry Flags: 00:23:25.320 Duplicate Returned Information: 1 00:23:25.320 Explicit Persistent Connection Support for Discovery: 1 00:23:25.320 Transport Requirements: 00:23:25.320 Secure Channel: Not Required 00:23:25.320 Port ID: 0 (0x0000) 00:23:25.320 Controller ID: 65535 (0xffff) 00:23:25.320 Admin Max SQ Size: 128 00:23:25.320 Transport Service Identifier: 4420 00:23:25.320 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:25.320 Transport Address: 10.0.0.2 00:23:25.320 Discovery Log Entry 1 00:23:25.320 ---------------------- 00:23:25.320 Transport Type: 3 (TCP) 00:23:25.320 Address Family: 1 (IPv4) 00:23:25.320 Subsystem Type: 2 (NVM Subsystem) 00:23:25.320 Entry Flags: 00:23:25.320 Duplicate Returned Information: 0 00:23:25.320 Explicit Persistent Connection Support for Discovery: 0 00:23:25.320 Transport Requirements: 00:23:25.320 Secure Channel: Not Required 00:23:25.320 Port ID: 0 (0x0000) 00:23:25.320 Controller ID: 65535 (0xffff) 00:23:25.320 Admin Max SQ Size: 128 00:23:25.320 Transport Service Identifier: 4420 00:23:25.320 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:25.320 Transport Address: 10.0.0.2 [2024-11-26 08:31:11.049956] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:25.320 [2024-11-26 08:31:11.049983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.320 [2024-11-26 08:31:11.049995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.320 [2024-11-26 08:31:11.050004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.320 [2024-11-26 08:31:11.050014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.320 [2024-11-26 08:31:11.050027] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.050052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.050077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.050200] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.050212] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.050219] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050225] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.050238] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050246] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050252] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.050262] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.050288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.050425] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.050440] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.050447] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050453] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.050474] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:25.320 [2024-11-26 08:31:11.050482] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:25.320 [2024-11-26 08:31:11.050498] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050511] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050518] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.050528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.050549] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.050694] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.050708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.050714] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050721] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.050739] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.050765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.050786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.050891] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.050903] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.050910] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050916] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.050933] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050942] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.050948] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.050958] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.050979] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.051083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.051097] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.051104] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051111] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.051128] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051137] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051143] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.051154] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.051174] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.051265] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.051277] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.051283] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051290] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.051307] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051315] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051326] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.051337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.051358] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.051446] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.051458] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.051464] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051471] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.051488] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051497] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051503] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.051513] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.320 [2024-11-26 08:31:11.051533] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.320 [2024-11-26 08:31:11.051618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.320 [2024-11-26 08:31:11.051630] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.320 [2024-11-26 08:31:11.051636] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051643] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.320 [2024-11-26 08:31:11.051660] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051669] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.320 [2024-11-26 08:31:11.051675] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.320 [2024-11-26 08:31:11.051692] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.051716] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.051827] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.051841] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.051848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.051855] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.051872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.051881] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.051887] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.051898] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.051918] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.052004] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.052017] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.052023] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052030] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.052047] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052056] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052062] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.052076] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.052098] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.052188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.052203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.052210] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052216] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.052234] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052243] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052249] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.052259] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.052279] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.052373] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.052388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.052395] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052401] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.052419] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052434] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.052444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.052464] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.052556] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.052570] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.052577] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.052600] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052610] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.052616] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.052626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.052646] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.056717] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.056734] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.056741] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.056748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.056766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.056775] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.056781] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2439e10) 00:23:25.321 [2024-11-26 08:31:11.056792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.321 [2024-11-26 08:31:11.056818] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24b9f50, cid 3, qid 0 00:23:25.321 [2024-11-26 08:31:11.056940] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.056952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.056959] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.056966] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24b9f50) on tqpair=0x2439e10 00:23:25.321 [2024-11-26 08:31:11.056980] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:25.321 00:23:25.321 08:31:11 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:25.321 [2024-11-26 08:31:11.086979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:25.321 [2024-11-26 08:31:11.087019] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1037542 ] 00:23:25.321 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.321 [2024-11-26 08:31:11.118675] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:25.321 [2024-11-26 08:31:11.118732] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:25.321 [2024-11-26 08:31:11.118743] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:25.321 [2024-11-26 08:31:11.118757] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:25.321 [2024-11-26 08:31:11.118768] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:25.321 [2024-11-26 08:31:11.122724] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:25.321 [2024-11-26 08:31:11.122765] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xb23e10 0 00:23:25.321 [2024-11-26 08:31:11.130702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:25.321 [2024-11-26 08:31:11.130721] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:25.321 [2024-11-26 08:31:11.130729] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:25.321 [2024-11-26 08:31:11.130735] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:25.321 [2024-11-26 08:31:11.130788] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.130801] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.321 [2024-11-26 08:31:11.130808] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.321 [2024-11-26 08:31:11.130822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:25.321 [2024-11-26 08:31:11.130848] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.321 [2024-11-26 08:31:11.138712] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.321 [2024-11-26 08:31:11.138731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.321 [2024-11-26 08:31:11.138738] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.138745] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.138764] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:25.322 [2024-11-26 08:31:11.138780] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:25.322 [2024-11-26 08:31:11.138790] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:25.322 [2024-11-26 08:31:11.138806] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.138815] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.138821] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.138832] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.138856] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.138956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.138971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.138978] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.138985] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.138993] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:25.322 [2024-11-26 08:31:11.139007] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:25.322 [2024-11-26 08:31:11.139019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139026] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139033] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.139043] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.139064] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.139161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.139173] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.139180] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139187] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.139195] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:25.322 [2024-11-26 08:31:11.139209] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139221] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139228] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139234] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.139245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.139265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.139359] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.139374] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.139381] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139388] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.139396] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139420] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139430] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139437] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.139447] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.139469] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.139559] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.139571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.139577] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139584] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.139591] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:25.322 [2024-11-26 08:31:11.139599] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139722] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:25.322 [2024-11-26 08:31:11.139731] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139757] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.139768] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.139789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.139889] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.139903] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.139910] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139917] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.139925] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:25.322 [2024-11-26 08:31:11.139942] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139950] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.139957] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.139967] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.139998] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.140085] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.322 [2024-11-26 08:31:11.140097] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.322 [2024-11-26 08:31:11.140103] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.140110] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.322 [2024-11-26 08:31:11.140118] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:25.322 [2024-11-26 08:31:11.140130] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:25.322 [2024-11-26 08:31:11.140144] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:25.322 [2024-11-26 08:31:11.140162] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:25.322 [2024-11-26 08:31:11.140175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.140183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.140190] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.322 [2024-11-26 08:31:11.140200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.322 [2024-11-26 08:31:11.140222] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.322 [2024-11-26 08:31:11.140360] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.322 [2024-11-26 08:31:11.140375] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.322 [2024-11-26 08:31:11.140382] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.140388] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=4096, cccid=0 00:23:25.322 [2024-11-26 08:31:11.140396] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba3b30) on tqpair(0xb23e10): expected_datao=0, payload_size=4096 00:23:25.322 [2024-11-26 08:31:11.140414] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.322 [2024-11-26 08:31:11.140423] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.180771] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.585 [2024-11-26 08:31:11.180790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.585 [2024-11-26 08:31:11.180798] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.180805] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.585 [2024-11-26 08:31:11.180816] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:25.585 [2024-11-26 08:31:11.180825] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:25.585 [2024-11-26 08:31:11.180833] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:25.585 [2024-11-26 08:31:11.180840] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:25.585 [2024-11-26 08:31:11.180848] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:25.585 [2024-11-26 08:31:11.180856] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:25.585 [2024-11-26 08:31:11.180876] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:25.585 [2024-11-26 08:31:11.180890] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.180897] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.180904] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.585 [2024-11-26 08:31:11.180915] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:25.585 [2024-11-26 08:31:11.180938] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.585 [2024-11-26 08:31:11.181027] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.585 [2024-11-26 08:31:11.181039] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.585 [2024-11-26 08:31:11.181049] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.181057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3b30) on tqpair=0xb23e10 00:23:25.585 [2024-11-26 08:31:11.181067] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.181074] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.181081] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xb23e10) 00:23:25.585 [2024-11-26 08:31:11.181091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.585 [2024-11-26 08:31:11.181101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.181108] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.585 [2024-11-26 08:31:11.181114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.586 [2024-11-26 08:31:11.181133] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181140] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181146] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.586 [2024-11-26 08:31:11.181165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181171] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181177] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181186] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.586 [2024-11-26 08:31:11.181195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181213] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181248] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181255] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181265] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.586 [2024-11-26 08:31:11.181287] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3b30, cid 0, qid 0 00:23:25.586 [2024-11-26 08:31:11.181313] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3c90, cid 1, qid 0 00:23:25.586 [2024-11-26 08:31:11.181321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3df0, cid 2, qid 0 00:23:25.586 [2024-11-26 08:31:11.181328] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3f50, cid 3, qid 0 00:23:25.586 [2024-11-26 08:31:11.181336] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.586 [2024-11-26 08:31:11.181464] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.586 [2024-11-26 08:31:11.181479] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.586 [2024-11-26 08:31:11.181486] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181492] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.586 [2024-11-26 08:31:11.181500] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:25.586 [2024-11-26 08:31:11.181513] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181528] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181543] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181555] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181563] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181569] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181580] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:25.586 [2024-11-26 08:31:11.181616] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.586 [2024-11-26 08:31:11.181740] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.586 [2024-11-26 08:31:11.181754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.586 [2024-11-26 08:31:11.181761] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181768] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.586 [2024-11-26 08:31:11.181833] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181852] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.181867] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181875] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.181881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.181892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.586 [2024-11-26 08:31:11.181914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.586 [2024-11-26 08:31:11.182026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.586 [2024-11-26 08:31:11.182041] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.586 [2024-11-26 08:31:11.182048] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.182054] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=4096, cccid=4 00:23:25.586 [2024-11-26 08:31:11.182062] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba40b0) on tqpair(0xb23e10): expected_datao=0, payload_size=4096 00:23:25.586 [2024-11-26 08:31:11.182080] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.182089] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.226698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.586 [2024-11-26 08:31:11.226716] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.586 [2024-11-26 08:31:11.226723] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.226730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.586 [2024-11-26 08:31:11.226752] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:25.586 [2024-11-26 08:31:11.226770] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.226812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.226832] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.226840] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.226847] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.226858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.586 [2024-11-26 08:31:11.226883] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.586 [2024-11-26 08:31:11.227015] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.586 [2024-11-26 08:31:11.227027] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.586 [2024-11-26 08:31:11.227034] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.227040] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=4096, cccid=4 00:23:25.586 [2024-11-26 08:31:11.227048] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba40b0) on tqpair(0xb23e10): expected_datao=0, payload_size=4096 00:23:25.586 [2024-11-26 08:31:11.227065] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.227074] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.267787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.586 [2024-11-26 08:31:11.267808] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.586 [2024-11-26 08:31:11.267815] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.267822] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.586 [2024-11-26 08:31:11.267849] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.267869] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.267884] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.267892] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.267899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.586 [2024-11-26 08:31:11.267910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.586 [2024-11-26 08:31:11.267934] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.586 [2024-11-26 08:31:11.268050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.586 [2024-11-26 08:31:11.268065] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.586 [2024-11-26 08:31:11.268072] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.268078] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=4096, cccid=4 00:23:25.586 [2024-11-26 08:31:11.268086] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba40b0) on tqpair(0xb23e10): expected_datao=0, payload_size=4096 00:23:25.586 [2024-11-26 08:31:11.268097] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.268105] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.268117] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.586 [2024-11-26 08:31:11.268127] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.586 [2024-11-26 08:31:11.268134] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.586 [2024-11-26 08:31:11.268140] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.586 [2024-11-26 08:31:11.268154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.268175] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.268192] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.268203] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.268212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:25.586 [2024-11-26 08:31:11.268221] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:25.587 [2024-11-26 08:31:11.268228] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:25.587 [2024-11-26 08:31:11.268237] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:25.587 [2024-11-26 08:31:11.268256] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268264] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268271] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.268282] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.268293] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268300] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.268316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:25.587 [2024-11-26 08:31:11.268351] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.587 [2024-11-26 08:31:11.268363] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4210, cid 5, qid 0 00:23:25.587 [2024-11-26 08:31:11.268471] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.268486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.268492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268499] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.268509] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.268518] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.268525] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268531] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4210) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.268547] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268556] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268563] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.268573] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.268599] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4210, cid 5, qid 0 00:23:25.587 [2024-11-26 08:31:11.268694] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.268708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.268719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268726] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4210) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.268743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268752] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.268769] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.268790] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4210, cid 5, qid 0 00:23:25.587 [2024-11-26 08:31:11.268902] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.268917] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.268924] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268930] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4210) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.268946] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268955] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.268961] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.268972] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.268993] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4210, cid 5, qid 0 00:23:25.587 [2024-11-26 08:31:11.269093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.269108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.269114] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4210) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.269141] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269151] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269157] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.269167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.269180] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269187] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269193] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.269204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.269215] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269223] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269229] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.269238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.269251] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269258] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269264] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xb23e10) 00:23:25.587 [2024-11-26 08:31:11.269293] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.587 [2024-11-26 08:31:11.269316] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4210, cid 5, qid 0 00:23:25.587 [2024-11-26 08:31:11.269327] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba40b0, cid 4, qid 0 00:23:25.587 [2024-11-26 08:31:11.269335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba4370, cid 6, qid 0 00:23:25.587 [2024-11-26 08:31:11.269357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba44d0, cid 7, qid 0 00:23:25.587 [2024-11-26 08:31:11.269541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.587 [2024-11-26 08:31:11.269553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.587 [2024-11-26 08:31:11.269560] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269567] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=8192, cccid=5 00:23:25.587 [2024-11-26 08:31:11.269574] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba4210) on tqpair(0xb23e10): expected_datao=0, payload_size=8192 00:23:25.587 [2024-11-26 08:31:11.269595] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269604] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269616] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.587 [2024-11-26 08:31:11.269626] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.587 [2024-11-26 08:31:11.269632] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269639] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=512, cccid=4 00:23:25.587 [2024-11-26 08:31:11.269646] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba40b0) on tqpair(0xb23e10): expected_datao=0, payload_size=512 00:23:25.587 [2024-11-26 08:31:11.269656] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269664] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269672] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.587 [2024-11-26 08:31:11.269681] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.587 [2024-11-26 08:31:11.269697] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269704] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=512, cccid=6 00:23:25.587 [2024-11-26 08:31:11.269711] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba4370) on tqpair(0xb23e10): expected_datao=0, payload_size=512 00:23:25.587 [2024-11-26 08:31:11.269721] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269728] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269737] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:25.587 [2024-11-26 08:31:11.269745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:25.587 [2024-11-26 08:31:11.269752] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269758] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xb23e10): datao=0, datal=4096, cccid=7 00:23:25.587 [2024-11-26 08:31:11.269765] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xba44d0) on tqpair(0xb23e10): expected_datao=0, payload_size=4096 00:23:25.587 [2024-11-26 08:31:11.269776] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269783] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269795] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.269804] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.269810] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269817] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4210) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.269840] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.587 [2024-11-26 08:31:11.269851] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.587 [2024-11-26 08:31:11.269858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.587 [2024-11-26 08:31:11.269865] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba40b0) on tqpair=0xb23e10 00:23:25.587 [2024-11-26 08:31:11.269879] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.588 [2024-11-26 08:31:11.269889] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.588 [2024-11-26 08:31:11.269896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.588 [2024-11-26 08:31:11.269902] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba4370) on tqpair=0xb23e10 00:23:25.588 [2024-11-26 08:31:11.269913] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.588 [2024-11-26 08:31:11.269922] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.588 [2024-11-26 08:31:11.269929] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.588 [2024-11-26 08:31:11.269950] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba44d0) on tqpair=0xb23e10 00:23:25.588 ===================================================== 00:23:25.588 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.588 ===================================================== 00:23:25.588 Controller Capabilities/Features 00:23:25.588 ================================ 00:23:25.588 Vendor ID: 8086 00:23:25.588 Subsystem Vendor ID: 8086 00:23:25.588 Serial Number: SPDK00000000000001 00:23:25.588 Model Number: SPDK bdev Controller 00:23:25.588 Firmware Version: 24.01.1 00:23:25.588 Recommended Arb Burst: 6 00:23:25.588 IEEE OUI Identifier: e4 d2 5c 00:23:25.588 Multi-path I/O 00:23:25.588 May have multiple subsystem ports: Yes 00:23:25.588 May have multiple controllers: Yes 00:23:25.588 Associated with SR-IOV VF: No 00:23:25.588 Max Data Transfer Size: 131072 00:23:25.588 Max Number of Namespaces: 32 00:23:25.588 Max Number of I/O Queues: 127 00:23:25.588 NVMe Specification Version (VS): 1.3 00:23:25.588 NVMe Specification Version (Identify): 1.3 00:23:25.588 Maximum Queue Entries: 128 00:23:25.588 Contiguous Queues Required: Yes 00:23:25.588 Arbitration Mechanisms Supported 00:23:25.588 Weighted Round Robin: Not Supported 00:23:25.588 Vendor Specific: Not Supported 00:23:25.588 Reset Timeout: 15000 ms 00:23:25.588 Doorbell Stride: 4 bytes 00:23:25.588 NVM Subsystem Reset: Not Supported 00:23:25.588 Command Sets Supported 00:23:25.588 NVM Command Set: Supported 00:23:25.588 Boot Partition: Not Supported 00:23:25.588 Memory Page Size Minimum: 4096 bytes 00:23:25.588 Memory Page Size Maximum: 4096 bytes 00:23:25.588 Persistent Memory Region: Not Supported 00:23:25.588 Optional Asynchronous Events Supported 00:23:25.588 Namespace Attribute Notices: Supported 00:23:25.588 Firmware Activation Notices: Not Supported 00:23:25.588 ANA Change Notices: Not Supported 00:23:25.588 PLE Aggregate Log Change Notices: Not Supported 00:23:25.588 LBA Status Info Alert Notices: Not Supported 00:23:25.588 EGE Aggregate Log Change Notices: Not Supported 00:23:25.588 Normal NVM Subsystem Shutdown event: Not Supported 00:23:25.588 Zone Descriptor Change Notices: Not Supported 00:23:25.588 Discovery Log Change Notices: Not Supported 00:23:25.588 Controller Attributes 00:23:25.588 128-bit Host Identifier: Supported 00:23:25.588 Non-Operational Permissive Mode: Not Supported 00:23:25.588 NVM Sets: Not Supported 00:23:25.588 Read Recovery Levels: Not Supported 00:23:25.588 Endurance Groups: Not Supported 00:23:25.588 Predictable Latency Mode: Not Supported 00:23:25.588 Traffic Based Keep ALive: Not Supported 00:23:25.588 Namespace Granularity: Not Supported 00:23:25.588 SQ Associations: Not Supported 00:23:25.588 UUID List: Not Supported 00:23:25.588 Multi-Domain Subsystem: Not Supported 00:23:25.588 Fixed Capacity Management: Not Supported 00:23:25.588 Variable Capacity Management: Not Supported 00:23:25.588 Delete Endurance Group: Not Supported 00:23:25.588 Delete NVM Set: Not Supported 00:23:25.588 Extended LBA Formats Supported: Not Supported 00:23:25.588 Flexible Data Placement Supported: Not Supported 00:23:25.588 00:23:25.588 Controller Memory Buffer Support 00:23:25.588 ================================ 00:23:25.588 Supported: No 00:23:25.588 00:23:25.588 Persistent Memory Region Support 00:23:25.588 ================================ 00:23:25.588 Supported: No 00:23:25.588 00:23:25.588 Admin Command Set Attributes 00:23:25.588 ============================ 00:23:25.588 Security Send/Receive: Not Supported 00:23:25.588 Format NVM: Not Supported 00:23:25.588 Firmware Activate/Download: Not Supported 00:23:25.588 Namespace Management: Not Supported 00:23:25.588 Device Self-Test: Not Supported 00:23:25.588 Directives: Not Supported 00:23:25.588 NVMe-MI: Not Supported 00:23:25.588 Virtualization Management: Not Supported 00:23:25.588 Doorbell Buffer Config: Not Supported 00:23:25.588 Get LBA Status Capability: Not Supported 00:23:25.588 Command & Feature Lockdown Capability: Not Supported 00:23:25.588 Abort Command Limit: 4 00:23:25.588 Async Event Request Limit: 4 00:23:25.588 Number of Firmware Slots: N/A 00:23:25.588 Firmware Slot 1 Read-Only: N/A 00:23:25.588 Firmware Activation Without Reset: N/A 00:23:25.588 Multiple Update Detection Support: N/A 00:23:25.588 Firmware Update Granularity: No Information Provided 00:23:25.588 Per-Namespace SMART Log: No 00:23:25.588 Asymmetric Namespace Access Log Page: Not Supported 00:23:25.588 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:25.588 Command Effects Log Page: Supported 00:23:25.588 Get Log Page Extended Data: Supported 00:23:25.588 Telemetry Log Pages: Not Supported 00:23:25.588 Persistent Event Log Pages: Not Supported 00:23:25.588 Supported Log Pages Log Page: May Support 00:23:25.588 Commands Supported & Effects Log Page: Not Supported 00:23:25.588 Feature Identifiers & Effects Log Page:May Support 00:23:25.588 NVMe-MI Commands & Effects Log Page: May Support 00:23:25.588 Data Area 4 for Telemetry Log: Not Supported 00:23:25.588 Error Log Page Entries Supported: 128 00:23:25.588 Keep Alive: Supported 00:23:25.588 Keep Alive Granularity: 10000 ms 00:23:25.588 00:23:25.588 NVM Command Set Attributes 00:23:25.588 ========================== 00:23:25.588 Submission Queue Entry Size 00:23:25.588 Max: 64 00:23:25.588 Min: 64 00:23:25.588 Completion Queue Entry Size 00:23:25.588 Max: 16 00:23:25.588 Min: 16 00:23:25.588 Number of Namespaces: 32 00:23:25.588 Compare Command: Supported 00:23:25.588 Write Uncorrectable Command: Not Supported 00:23:25.588 Dataset Management Command: Supported 00:23:25.588 Write Zeroes Command: Supported 00:23:25.588 Set Features Save Field: Not Supported 00:23:25.588 Reservations: Supported 00:23:25.588 Timestamp: Not Supported 00:23:25.588 Copy: Supported 00:23:25.588 Volatile Write Cache: Present 00:23:25.588 Atomic Write Unit (Normal): 1 00:23:25.588 Atomic Write Unit (PFail): 1 00:23:25.588 Atomic Compare & Write Unit: 1 00:23:25.588 Fused Compare & Write: Supported 00:23:25.588 Scatter-Gather List 00:23:25.588 SGL Command Set: Supported 00:23:25.588 SGL Keyed: Supported 00:23:25.588 SGL Bit Bucket Descriptor: Not Supported 00:23:25.588 SGL Metadata Pointer: Not Supported 00:23:25.588 Oversized SGL: Not Supported 00:23:25.588 SGL Metadata Address: Not Supported 00:23:25.588 SGL Offset: Supported 00:23:25.588 Transport SGL Data Block: Not Supported 00:23:25.588 Replay Protected Memory Block: Not Supported 00:23:25.588 00:23:25.588 Firmware Slot Information 00:23:25.588 ========================= 00:23:25.588 Active slot: 1 00:23:25.588 Slot 1 Firmware Revision: 24.01.1 00:23:25.588 00:23:25.588 00:23:25.588 Commands Supported and Effects 00:23:25.588 ============================== 00:23:25.588 Admin Commands 00:23:25.588 -------------- 00:23:25.588 Get Log Page (02h): Supported 00:23:25.588 Identify (06h): Supported 00:23:25.588 Abort (08h): Supported 00:23:25.588 Set Features (09h): Supported 00:23:25.588 Get Features (0Ah): Supported 00:23:25.588 Asynchronous Event Request (0Ch): Supported 00:23:25.588 Keep Alive (18h): Supported 00:23:25.588 I/O Commands 00:23:25.588 ------------ 00:23:25.588 Flush (00h): Supported LBA-Change 00:23:25.588 Write (01h): Supported LBA-Change 00:23:25.588 Read (02h): Supported 00:23:25.588 Compare (05h): Supported 00:23:25.588 Write Zeroes (08h): Supported LBA-Change 00:23:25.588 Dataset Management (09h): Supported LBA-Change 00:23:25.588 Copy (19h): Supported LBA-Change 00:23:25.588 Unknown (79h): Supported LBA-Change 00:23:25.588 Unknown (7Ah): Supported 00:23:25.588 00:23:25.588 Error Log 00:23:25.588 ========= 00:23:25.588 00:23:25.588 Arbitration 00:23:25.588 =========== 00:23:25.588 Arbitration Burst: 1 00:23:25.588 00:23:25.588 Power Management 00:23:25.588 ================ 00:23:25.588 Number of Power States: 1 00:23:25.588 Current Power State: Power State #0 00:23:25.588 Power State #0: 00:23:25.588 Max Power: 0.00 W 00:23:25.588 Non-Operational State: Operational 00:23:25.588 Entry Latency: Not Reported 00:23:25.588 Exit Latency: Not Reported 00:23:25.588 Relative Read Throughput: 0 00:23:25.588 Relative Read Latency: 0 00:23:25.588 Relative Write Throughput: 0 00:23:25.588 Relative Write Latency: 0 00:23:25.589 Idle Power: Not Reported 00:23:25.589 Active Power: Not Reported 00:23:25.589 Non-Operational Permissive Mode: Not Supported 00:23:25.589 00:23:25.589 Health Information 00:23:25.589 ================== 00:23:25.589 Critical Warnings: 00:23:25.589 Available Spare Space: OK 00:23:25.589 Temperature: OK 00:23:25.589 Device Reliability: OK 00:23:25.589 Read Only: No 00:23:25.589 Volatile Memory Backup: OK 00:23:25.589 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:25.589 Temperature Threshold: [2024-11-26 08:31:11.270078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270098] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270105] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xb23e10) 00:23:25.589 [2024-11-26 08:31:11.270115] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.589 [2024-11-26 08:31:11.270137] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba44d0, cid 7, qid 0 00:23:25.589 [2024-11-26 08:31:11.270263] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.589 [2024-11-26 08:31:11.270275] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.589 [2024-11-26 08:31:11.270282] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270289] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba44d0) on tqpair=0xb23e10 00:23:25.589 [2024-11-26 08:31:11.270327] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:25.589 [2024-11-26 08:31:11.270348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.589 [2024-11-26 08:31:11.270360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.589 [2024-11-26 08:31:11.270369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.589 [2024-11-26 08:31:11.270378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:25.589 [2024-11-26 08:31:11.270391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270398] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270405] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb23e10) 00:23:25.589 [2024-11-26 08:31:11.270415] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.589 [2024-11-26 08:31:11.270437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3f50, cid 3, qid 0 00:23:25.589 [2024-11-26 08:31:11.270563] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.589 [2024-11-26 08:31:11.270578] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.589 [2024-11-26 08:31:11.270585] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3f50) on tqpair=0xb23e10 00:23:25.589 [2024-11-26 08:31:11.270603] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270614] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.270621] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb23e10) 00:23:25.589 [2024-11-26 08:31:11.270632] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.589 [2024-11-26 08:31:11.270660] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3f50, cid 3, qid 0 00:23:25.589 [2024-11-26 08:31:11.274697] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.589 [2024-11-26 08:31:11.274715] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.589 [2024-11-26 08:31:11.274722] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.274728] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3f50) on tqpair=0xb23e10 00:23:25.589 [2024-11-26 08:31:11.274736] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:25.589 [2024-11-26 08:31:11.274744] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:25.589 [2024-11-26 08:31:11.274776] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.274785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.274792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xb23e10) 00:23:25.589 [2024-11-26 08:31:11.274803] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:25.589 [2024-11-26 08:31:11.274825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xba3f50, cid 3, qid 0 00:23:25.589 [2024-11-26 08:31:11.274936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:25.589 [2024-11-26 08:31:11.274950] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:25.589 [2024-11-26 08:31:11.274957] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:25.589 [2024-11-26 08:31:11.274964] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xba3f50) on tqpair=0xb23e10 00:23:25.589 [2024-11-26 08:31:11.274977] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 0 milliseconds 00:23:25.589 0 Kelvin (-273 Celsius) 00:23:25.589 Available Spare: 0% 00:23:25.589 Available Spare Threshold: 0% 00:23:25.589 Life Percentage Used: 0% 00:23:25.589 Data Units Read: 0 00:23:25.589 Data Units Written: 0 00:23:25.589 Host Read Commands: 0 00:23:25.589 Host Write Commands: 0 00:23:25.589 Controller Busy Time: 0 minutes 00:23:25.589 Power Cycles: 0 00:23:25.589 Power On Hours: 0 hours 00:23:25.589 Unsafe Shutdowns: 0 00:23:25.589 Unrecoverable Media Errors: 0 00:23:25.589 Lifetime Error Log Entries: 0 00:23:25.589 Warning Temperature Time: 0 minutes 00:23:25.589 Critical Temperature Time: 0 minutes 00:23:25.589 00:23:25.589 Number of Queues 00:23:25.589 ================ 00:23:25.589 Number of I/O Submission Queues: 127 00:23:25.589 Number of I/O Completion Queues: 127 00:23:25.589 00:23:25.589 Active Namespaces 00:23:25.589 ================= 00:23:25.589 Namespace ID:1 00:23:25.589 Error Recovery Timeout: Unlimited 00:23:25.589 Command Set Identifier: NVM (00h) 00:23:25.589 Deallocate: Supported 00:23:25.589 Deallocated/Unwritten Error: Not Supported 00:23:25.589 Deallocated Read Value: Unknown 00:23:25.589 Deallocate in Write Zeroes: Not Supported 00:23:25.589 Deallocated Guard Field: 0xFFFF 00:23:25.589 Flush: Supported 00:23:25.589 Reservation: Supported 00:23:25.589 Namespace Sharing Capabilities: Multiple Controllers 00:23:25.589 Size (in LBAs): 131072 (0GiB) 00:23:25.589 Capacity (in LBAs): 131072 (0GiB) 00:23:25.589 Utilization (in LBAs): 131072 (0GiB) 00:23:25.589 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:25.589 EUI64: ABCDEF0123456789 00:23:25.589 UUID: c11d0a5f-c379-4969-944a-67f1f4ae9ca4 00:23:25.589 Thin Provisioning: Not Supported 00:23:25.589 Per-NS Atomic Units: Yes 00:23:25.589 Atomic Boundary Size (Normal): 0 00:23:25.589 Atomic Boundary Size (PFail): 0 00:23:25.589 Atomic Boundary Offset: 0 00:23:25.589 Maximum Single Source Range Length: 65535 00:23:25.589 Maximum Copy Length: 65535 00:23:25.589 Maximum Source Range Count: 1 00:23:25.589 NGUID/EUI64 Never Reused: No 00:23:25.589 Namespace Write Protected: No 00:23:25.589 Number of LBA Formats: 1 00:23:25.589 Current LBA Format: LBA Format #00 00:23:25.589 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:25.589 00:23:25.589 08:31:11 -- host/identify.sh@51 -- # sync 00:23:25.589 08:31:11 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:25.589 08:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.589 08:31:11 -- common/autotest_common.sh@10 -- # set +x 00:23:25.589 08:31:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.589 08:31:11 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:25.589 08:31:11 -- host/identify.sh@56 -- # nvmftestfini 00:23:25.589 08:31:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:25.589 08:31:11 -- nvmf/common.sh@116 -- # sync 00:23:25.589 08:31:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:25.589 08:31:11 -- nvmf/common.sh@119 -- # set +e 00:23:25.589 08:31:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:25.589 08:31:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:25.589 rmmod nvme_tcp 00:23:25.589 rmmod nvme_fabrics 00:23:25.589 rmmod nvme_keyring 00:23:25.589 08:31:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:25.589 08:31:11 -- nvmf/common.sh@123 -- # set -e 00:23:25.589 08:31:11 -- nvmf/common.sh@124 -- # return 0 00:23:25.589 08:31:11 -- nvmf/common.sh@477 -- # '[' -n 1037375 ']' 00:23:25.589 08:31:11 -- nvmf/common.sh@478 -- # killprocess 1037375 00:23:25.589 08:31:11 -- common/autotest_common.sh@936 -- # '[' -z 1037375 ']' 00:23:25.589 08:31:11 -- common/autotest_common.sh@940 -- # kill -0 1037375 00:23:25.589 08:31:11 -- common/autotest_common.sh@941 -- # uname 00:23:25.589 08:31:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:25.589 08:31:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1037375 00:23:25.589 08:31:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:25.589 08:31:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:25.589 08:31:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1037375' 00:23:25.589 killing process with pid 1037375 00:23:25.589 08:31:11 -- common/autotest_common.sh@955 -- # kill 1037375 00:23:25.589 [2024-11-26 08:31:11.386809] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:25.589 08:31:11 -- common/autotest_common.sh@960 -- # wait 1037375 00:23:25.849 08:31:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:25.849 08:31:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:25.849 08:31:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:25.849 08:31:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:25.849 08:31:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:25.849 08:31:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:25.849 08:31:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:25.849 08:31:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:28.407 08:31:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:28.407 00:23:28.408 real 0m6.274s 00:23:28.408 user 0m7.844s 00:23:28.408 sys 0m1.912s 00:23:28.408 08:31:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:28.408 08:31:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.408 ************************************ 00:23:28.408 END TEST nvmf_identify 00:23:28.408 ************************************ 00:23:28.408 08:31:13 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:28.408 08:31:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:28.408 08:31:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.408 ************************************ 00:23:28.408 START TEST nvmf_perf 00:23:28.408 ************************************ 00:23:28.408 08:31:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:28.408 * Looking for test storage... 00:23:28.408 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:28.408 08:31:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:28.408 08:31:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:28.408 08:31:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:28.408 08:31:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:28.408 08:31:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:28.408 08:31:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:28.408 08:31:13 -- scripts/common.sh@335 -- # IFS=.-: 00:23:28.408 08:31:13 -- scripts/common.sh@335 -- # read -ra ver1 00:23:28.408 08:31:13 -- scripts/common.sh@336 -- # IFS=.-: 00:23:28.408 08:31:13 -- scripts/common.sh@336 -- # read -ra ver2 00:23:28.408 08:31:13 -- scripts/common.sh@337 -- # local 'op=<' 00:23:28.408 08:31:13 -- scripts/common.sh@339 -- # ver1_l=2 00:23:28.408 08:31:13 -- scripts/common.sh@340 -- # ver2_l=1 00:23:28.408 08:31:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:28.408 08:31:13 -- scripts/common.sh@343 -- # case "$op" in 00:23:28.408 08:31:13 -- scripts/common.sh@344 -- # : 1 00:23:28.408 08:31:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:28.408 08:31:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:28.408 08:31:13 -- scripts/common.sh@364 -- # decimal 1 00:23:28.408 08:31:13 -- scripts/common.sh@352 -- # local d=1 00:23:28.408 08:31:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:28.408 08:31:13 -- scripts/common.sh@354 -- # echo 1 00:23:28.408 08:31:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:28.408 08:31:13 -- scripts/common.sh@365 -- # decimal 2 00:23:28.408 08:31:13 -- scripts/common.sh@352 -- # local d=2 00:23:28.408 08:31:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:28.408 08:31:13 -- scripts/common.sh@354 -- # echo 2 00:23:28.408 08:31:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:28.408 08:31:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:28.408 08:31:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:28.408 08:31:13 -- scripts/common.sh@367 -- # return 0 00:23:28.408 08:31:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:28.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:28.408 --rc genhtml_branch_coverage=1 00:23:28.408 --rc genhtml_function_coverage=1 00:23:28.408 --rc genhtml_legend=1 00:23:28.408 --rc geninfo_all_blocks=1 00:23:28.408 --rc geninfo_unexecuted_blocks=1 00:23:28.408 00:23:28.408 ' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:28.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:28.408 --rc genhtml_branch_coverage=1 00:23:28.408 --rc genhtml_function_coverage=1 00:23:28.408 --rc genhtml_legend=1 00:23:28.408 --rc geninfo_all_blocks=1 00:23:28.408 --rc geninfo_unexecuted_blocks=1 00:23:28.408 00:23:28.408 ' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:28.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:28.408 --rc genhtml_branch_coverage=1 00:23:28.408 --rc genhtml_function_coverage=1 00:23:28.408 --rc genhtml_legend=1 00:23:28.408 --rc geninfo_all_blocks=1 00:23:28.408 --rc geninfo_unexecuted_blocks=1 00:23:28.408 00:23:28.408 ' 00:23:28.408 08:31:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:28.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:28.408 --rc genhtml_branch_coverage=1 00:23:28.408 --rc genhtml_function_coverage=1 00:23:28.408 --rc genhtml_legend=1 00:23:28.408 --rc geninfo_all_blocks=1 00:23:28.408 --rc geninfo_unexecuted_blocks=1 00:23:28.408 00:23:28.408 ' 00:23:28.408 08:31:13 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:28.408 08:31:13 -- nvmf/common.sh@7 -- # uname -s 00:23:28.408 08:31:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:28.408 08:31:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:28.408 08:31:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:28.408 08:31:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:28.408 08:31:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:28.408 08:31:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:28.408 08:31:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:28.408 08:31:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:28.408 08:31:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:28.408 08:31:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:28.408 08:31:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:28.408 08:31:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:28.408 08:31:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:28.408 08:31:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:28.408 08:31:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:28.408 08:31:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:28.408 08:31:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:28.408 08:31:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:28.408 08:31:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:28.408 08:31:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:28.408 08:31:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:28.408 08:31:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:28.408 08:31:13 -- paths/export.sh@5 -- # export PATH 00:23:28.408 08:31:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:28.408 08:31:13 -- nvmf/common.sh@46 -- # : 0 00:23:28.408 08:31:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:28.408 08:31:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:28.408 08:31:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:28.408 08:31:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:28.408 08:31:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:28.408 08:31:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:28.408 08:31:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:28.408 08:31:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:28.408 08:31:13 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:28.408 08:31:13 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:28.408 08:31:13 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:28.408 08:31:13 -- host/perf.sh@17 -- # nvmftestinit 00:23:28.408 08:31:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:28.408 08:31:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:28.408 08:31:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:28.408 08:31:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:28.408 08:31:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:28.408 08:31:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:28.408 08:31:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:28.408 08:31:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:28.408 08:31:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:28.408 08:31:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:28.408 08:31:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:28.408 08:31:13 -- common/autotest_common.sh@10 -- # set +x 00:23:30.311 08:31:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:30.311 08:31:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:30.311 08:31:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:30.311 08:31:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:30.311 08:31:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:30.311 08:31:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:30.311 08:31:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:30.311 08:31:15 -- nvmf/common.sh@294 -- # net_devs=() 00:23:30.311 08:31:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:30.311 08:31:15 -- nvmf/common.sh@295 -- # e810=() 00:23:30.311 08:31:15 -- nvmf/common.sh@295 -- # local -ga e810 00:23:30.311 08:31:15 -- nvmf/common.sh@296 -- # x722=() 00:23:30.311 08:31:16 -- nvmf/common.sh@296 -- # local -ga x722 00:23:30.311 08:31:16 -- nvmf/common.sh@297 -- # mlx=() 00:23:30.311 08:31:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:30.311 08:31:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:30.311 08:31:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:30.311 08:31:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:30.311 08:31:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:30.311 08:31:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:30.311 08:31:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:30.311 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:30.311 08:31:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:30.311 08:31:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:30.311 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:30.311 08:31:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:30.311 08:31:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:30.312 08:31:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:30.312 08:31:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:30.312 08:31:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:30.312 08:31:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:30.312 08:31:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:30.312 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:30.312 08:31:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:30.312 08:31:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:30.312 08:31:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:30.312 08:31:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:30.312 08:31:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:30.312 08:31:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:30.312 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:30.312 08:31:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:30.312 08:31:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:30.312 08:31:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:30.312 08:31:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:30.312 08:31:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:30.312 08:31:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:30.312 08:31:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:30.312 08:31:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:30.312 08:31:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:30.312 08:31:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:30.312 08:31:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:30.312 08:31:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:30.312 08:31:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:30.312 08:31:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:30.312 08:31:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:30.312 08:31:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:30.312 08:31:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:30.312 08:31:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:30.312 08:31:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:30.312 08:31:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:30.312 08:31:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:30.312 08:31:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:30.312 08:31:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:30.312 08:31:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:30.312 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:30.312 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:23:30.312 00:23:30.312 --- 10.0.0.2 ping statistics --- 00:23:30.312 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:30.312 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:23:30.312 08:31:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:30.312 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:30.312 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:23:30.312 00:23:30.312 --- 10.0.0.1 ping statistics --- 00:23:30.312 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:30.312 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:23:30.312 08:31:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:30.312 08:31:16 -- nvmf/common.sh@410 -- # return 0 00:23:30.312 08:31:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:30.312 08:31:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:30.312 08:31:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:30.312 08:31:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:30.312 08:31:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:30.312 08:31:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:30.312 08:31:16 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:30.312 08:31:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:30.312 08:31:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:30.312 08:31:16 -- common/autotest_common.sh@10 -- # set +x 00:23:30.312 08:31:16 -- nvmf/common.sh@469 -- # nvmfpid=1039613 00:23:30.312 08:31:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:30.312 08:31:16 -- nvmf/common.sh@470 -- # waitforlisten 1039613 00:23:30.312 08:31:16 -- common/autotest_common.sh@829 -- # '[' -z 1039613 ']' 00:23:30.312 08:31:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:30.312 08:31:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:30.312 08:31:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:30.312 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:30.312 08:31:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:30.312 08:31:16 -- common/autotest_common.sh@10 -- # set +x 00:23:30.572 [2024-11-26 08:31:16.199018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:30.572 [2024-11-26 08:31:16.199089] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:30.572 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.572 [2024-11-26 08:31:16.262841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:30.572 [2024-11-26 08:31:16.368573] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:30.572 [2024-11-26 08:31:16.368717] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:30.572 [2024-11-26 08:31:16.368735] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:30.572 [2024-11-26 08:31:16.368748] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:30.572 [2024-11-26 08:31:16.368807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:30.572 [2024-11-26 08:31:16.368832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:30.572 [2024-11-26 08:31:16.368890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:30.572 [2024-11-26 08:31:16.368893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:31.506 08:31:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:31.506 08:31:17 -- common/autotest_common.sh@862 -- # return 0 00:23:31.506 08:31:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:31.506 08:31:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:31.506 08:31:17 -- common/autotest_common.sh@10 -- # set +x 00:23:31.506 08:31:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:31.506 08:31:17 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:31.506 08:31:17 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:34.804 08:31:20 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:34.804 08:31:20 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:34.804 08:31:20 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:34.804 08:31:20 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:35.371 08:31:20 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:35.371 08:31:20 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:35.371 08:31:20 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:35.371 08:31:20 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:35.371 08:31:20 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:35.371 [2024-11-26 08:31:21.174061] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:35.371 08:31:21 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:35.629 08:31:21 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:35.629 08:31:21 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:35.887 08:31:21 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:35.887 08:31:21 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:36.145 08:31:21 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:36.403 [2024-11-26 08:31:22.189849] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:36.403 08:31:22 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:36.662 08:31:22 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:36.662 08:31:22 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:36.662 08:31:22 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:36.662 08:31:22 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:38.039 Initializing NVMe Controllers 00:23:38.039 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:38.039 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:38.039 Initialization complete. Launching workers. 00:23:38.039 ======================================================== 00:23:38.039 Latency(us) 00:23:38.039 Device Information : IOPS MiB/s Average min max 00:23:38.039 PCIE (0000:88:00.0) NSID 1 from core 0: 86906.65 339.48 367.87 36.83 6247.45 00:23:38.039 ======================================================== 00:23:38.039 Total : 86906.65 339.48 367.87 36.83 6247.45 00:23:38.039 00:23:38.039 08:31:23 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:38.039 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.418 Initializing NVMe Controllers 00:23:39.418 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:39.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:39.418 Initialization complete. Launching workers. 00:23:39.418 ======================================================== 00:23:39.418 Latency(us) 00:23:39.418 Device Information : IOPS MiB/s Average min max 00:23:39.418 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 110.00 0.43 9441.02 148.96 45424.99 00:23:39.418 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 54.00 0.21 19044.77 6973.76 47887.15 00:23:39.418 ======================================================== 00:23:39.418 Total : 164.00 0.64 12603.23 148.96 47887.15 00:23:39.418 00:23:39.418 08:31:25 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.418 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.795 Initializing NVMe Controllers 00:23:40.795 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.795 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.795 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:40.795 Initialization complete. Launching workers. 00:23:40.795 ======================================================== 00:23:40.795 Latency(us) 00:23:40.795 Device Information : IOPS MiB/s Average min max 00:23:40.795 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8583.64 33.53 3729.13 577.83 7967.92 00:23:40.795 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3868.57 15.11 8298.84 5355.22 22740.30 00:23:40.795 ======================================================== 00:23:40.795 Total : 12452.20 48.64 5148.82 577.83 22740.30 00:23:40.795 00:23:40.795 08:31:26 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:40.795 08:31:26 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:40.795 08:31:26 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:40.795 EAL: No free 2048 kB hugepages reported on node 1 00:23:43.334 Initializing NVMe Controllers 00:23:43.334 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:43.334 Controller IO queue size 128, less than required. 00:23:43.334 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:43.334 Controller IO queue size 128, less than required. 00:23:43.334 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:43.334 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:43.334 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:43.334 Initialization complete. Launching workers. 00:23:43.334 ======================================================== 00:23:43.334 Latency(us) 00:23:43.334 Device Information : IOPS MiB/s Average min max 00:23:43.334 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1575.35 393.84 82738.23 62859.51 127862.00 00:23:43.334 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 592.94 148.24 223378.72 78282.92 365983.10 00:23:43.334 ======================================================== 00:23:43.334 Total : 2168.30 542.07 121197.91 62859.51 365983.10 00:23:43.334 00:23:43.334 08:31:28 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:43.334 EAL: No free 2048 kB hugepages reported on node 1 00:23:43.334 No valid NVMe controllers or AIO or URING devices found 00:23:43.334 Initializing NVMe Controllers 00:23:43.334 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:43.335 Controller IO queue size 128, less than required. 00:23:43.335 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:43.335 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:43.335 Controller IO queue size 128, less than required. 00:23:43.335 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:43.335 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:43.335 WARNING: Some requested NVMe devices were skipped 00:23:43.335 08:31:29 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:43.335 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.867 Initializing NVMe Controllers 00:23:45.867 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:45.867 Controller IO queue size 128, less than required. 00:23:45.867 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.867 Controller IO queue size 128, less than required. 00:23:45.867 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.867 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:45.867 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:45.867 Initialization complete. Launching workers. 00:23:45.867 00:23:45.867 ==================== 00:23:45.867 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:45.867 TCP transport: 00:23:45.867 polls: 9097 00:23:45.867 idle_polls: 5621 00:23:45.867 sock_completions: 3476 00:23:45.867 nvme_completions: 5720 00:23:45.867 submitted_requests: 8640 00:23:45.867 queued_requests: 1 00:23:45.867 00:23:45.867 ==================== 00:23:45.867 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:45.867 TCP transport: 00:23:45.867 polls: 12061 00:23:45.867 idle_polls: 8633 00:23:45.867 sock_completions: 3428 00:23:45.867 nvme_completions: 5933 00:23:45.867 submitted_requests: 9066 00:23:45.867 queued_requests: 1 00:23:45.867 ======================================================== 00:23:45.867 Latency(us) 00:23:45.867 Device Information : IOPS MiB/s Average min max 00:23:45.867 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1491.17 372.79 87785.27 54183.99 143862.13 00:23:45.867 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1544.09 386.02 83165.53 47129.37 119549.40 00:23:45.867 ======================================================== 00:23:45.867 Total : 3035.26 758.82 85435.13 47129.37 143862.13 00:23:45.867 00:23:45.867 08:31:31 -- host/perf.sh@66 -- # sync 00:23:45.867 08:31:31 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:46.126 08:31:31 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:46.126 08:31:31 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:46.126 08:31:31 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:49.417 08:31:34 -- host/perf.sh@72 -- # ls_guid=9bf1d2e7-00e1-4834-b50f-949610ce72be 00:23:49.417 08:31:34 -- host/perf.sh@73 -- # get_lvs_free_mb 9bf1d2e7-00e1-4834-b50f-949610ce72be 00:23:49.417 08:31:34 -- common/autotest_common.sh@1353 -- # local lvs_uuid=9bf1d2e7-00e1-4834-b50f-949610ce72be 00:23:49.417 08:31:34 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:49.417 08:31:34 -- common/autotest_common.sh@1355 -- # local fc 00:23:49.417 08:31:34 -- common/autotest_common.sh@1356 -- # local cs 00:23:49.417 08:31:34 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:49.417 08:31:35 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:49.417 { 00:23:49.417 "uuid": "9bf1d2e7-00e1-4834-b50f-949610ce72be", 00:23:49.417 "name": "lvs_0", 00:23:49.417 "base_bdev": "Nvme0n1", 00:23:49.417 "total_data_clusters": 238234, 00:23:49.417 "free_clusters": 238234, 00:23:49.417 "block_size": 512, 00:23:49.418 "cluster_size": 4194304 00:23:49.418 } 00:23:49.418 ]' 00:23:49.418 08:31:35 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="9bf1d2e7-00e1-4834-b50f-949610ce72be") .free_clusters' 00:23:49.745 08:31:35 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:49.745 08:31:35 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="9bf1d2e7-00e1-4834-b50f-949610ce72be") .cluster_size' 00:23:49.745 08:31:35 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:49.745 08:31:35 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:49.745 08:31:35 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:49.745 952936 00:23:49.745 08:31:35 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:49.745 08:31:35 -- host/perf.sh@78 -- # free_mb=20480 00:23:49.745 08:31:35 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9bf1d2e7-00e1-4834-b50f-949610ce72be lbd_0 20480 00:23:50.032 08:31:35 -- host/perf.sh@80 -- # lb_guid=c8262ace-d601-4c91-b315-c2bbc79c83da 00:23:50.032 08:31:35 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore c8262ace-d601-4c91-b315-c2bbc79c83da lvs_n_0 00:23:50.968 08:31:36 -- host/perf.sh@83 -- # ls_nested_guid=300b5260-e808-4e84-b3ec-f498e3da18fe 00:23:50.968 08:31:36 -- host/perf.sh@84 -- # get_lvs_free_mb 300b5260-e808-4e84-b3ec-f498e3da18fe 00:23:50.968 08:31:36 -- common/autotest_common.sh@1353 -- # local lvs_uuid=300b5260-e808-4e84-b3ec-f498e3da18fe 00:23:50.968 08:31:36 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:50.968 08:31:36 -- common/autotest_common.sh@1355 -- # local fc 00:23:50.968 08:31:36 -- common/autotest_common.sh@1356 -- # local cs 00:23:50.968 08:31:36 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:51.226 08:31:36 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:51.226 { 00:23:51.226 "uuid": "9bf1d2e7-00e1-4834-b50f-949610ce72be", 00:23:51.226 "name": "lvs_0", 00:23:51.226 "base_bdev": "Nvme0n1", 00:23:51.226 "total_data_clusters": 238234, 00:23:51.226 "free_clusters": 233114, 00:23:51.226 "block_size": 512, 00:23:51.226 "cluster_size": 4194304 00:23:51.226 }, 00:23:51.226 { 00:23:51.226 "uuid": "300b5260-e808-4e84-b3ec-f498e3da18fe", 00:23:51.226 "name": "lvs_n_0", 00:23:51.226 "base_bdev": "c8262ace-d601-4c91-b315-c2bbc79c83da", 00:23:51.226 "total_data_clusters": 5114, 00:23:51.226 "free_clusters": 5114, 00:23:51.226 "block_size": 512, 00:23:51.226 "cluster_size": 4194304 00:23:51.226 } 00:23:51.226 ]' 00:23:51.226 08:31:36 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="300b5260-e808-4e84-b3ec-f498e3da18fe") .free_clusters' 00:23:51.226 08:31:36 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:51.226 08:31:36 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="300b5260-e808-4e84-b3ec-f498e3da18fe") .cluster_size' 00:23:51.226 08:31:37 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:51.226 08:31:37 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:51.226 08:31:37 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:51.226 20456 00:23:51.226 08:31:37 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:51.226 08:31:37 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 300b5260-e808-4e84-b3ec-f498e3da18fe lbd_nest_0 20456 00:23:51.483 08:31:37 -- host/perf.sh@88 -- # lb_nested_guid=816273ef-017f-4dff-acfd-7aede4860e08 00:23:51.483 08:31:37 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:51.740 08:31:37 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:51.740 08:31:37 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 816273ef-017f-4dff-acfd-7aede4860e08 00:23:51.997 08:31:37 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:52.255 08:31:38 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:52.255 08:31:38 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:52.255 08:31:38 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:52.255 08:31:38 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:52.255 08:31:38 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:52.255 EAL: No free 2048 kB hugepages reported on node 1 00:24:04.469 Initializing NVMe Controllers 00:24:04.469 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:04.469 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:04.469 Initialization complete. Launching workers. 00:24:04.469 ======================================================== 00:24:04.469 Latency(us) 00:24:04.469 Device Information : IOPS MiB/s Average min max 00:24:04.469 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.10 0.02 20834.09 187.08 47880.05 00:24:04.469 ======================================================== 00:24:04.469 Total : 48.10 0.02 20834.09 187.08 47880.05 00:24:04.469 00:24:04.469 08:31:48 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:04.469 08:31:48 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:04.469 EAL: No free 2048 kB hugepages reported on node 1 00:24:14.457 Initializing NVMe Controllers 00:24:14.457 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:14.457 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:14.457 Initialization complete. Launching workers. 00:24:14.457 ======================================================== 00:24:14.457 Latency(us) 00:24:14.457 Device Information : IOPS MiB/s Average min max 00:24:14.457 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.40 9.68 12935.44 5381.57 48880.47 00:24:14.457 ======================================================== 00:24:14.457 Total : 77.40 9.68 12935.44 5381.57 48880.47 00:24:14.457 00:24:14.457 08:31:58 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:14.457 08:31:58 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:14.457 08:31:58 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:14.457 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.431 Initializing NVMe Controllers 00:24:24.431 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:24.431 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:24.431 Initialization complete. Launching workers. 00:24:24.431 ======================================================== 00:24:24.431 Latency(us) 00:24:24.431 Device Information : IOPS MiB/s Average min max 00:24:24.431 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7310.86 3.57 4376.60 266.98 12431.55 00:24:24.431 ======================================================== 00:24:24.431 Total : 7310.86 3.57 4376.60 266.98 12431.55 00:24:24.431 00:24:24.431 08:32:09 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:24.431 08:32:09 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:24.431 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.417 Initializing NVMe Controllers 00:24:34.417 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:34.417 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:34.417 Initialization complete. Launching workers. 00:24:34.417 ======================================================== 00:24:34.417 Latency(us) 00:24:34.417 Device Information : IOPS MiB/s Average min max 00:24:34.417 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3758.16 469.77 8518.46 808.44 47809.20 00:24:34.417 ======================================================== 00:24:34.417 Total : 3758.16 469.77 8518.46 808.44 47809.20 00:24:34.417 00:24:34.417 08:32:19 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:34.417 08:32:19 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:34.417 08:32:19 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:34.417 EAL: No free 2048 kB hugepages reported on node 1 00:24:44.403 Initializing NVMe Controllers 00:24:44.403 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:44.403 Controller IO queue size 128, less than required. 00:24:44.403 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:44.403 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:44.403 Initialization complete. Launching workers. 00:24:44.403 ======================================================== 00:24:44.403 Latency(us) 00:24:44.403 Device Information : IOPS MiB/s Average min max 00:24:44.403 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12058.10 5.89 10621.92 1739.71 26750.31 00:24:44.403 ======================================================== 00:24:44.403 Total : 12058.10 5.89 10621.92 1739.71 26750.31 00:24:44.403 00:24:44.403 08:32:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:44.403 08:32:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:44.403 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.386 Initializing NVMe Controllers 00:24:54.386 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:54.386 Controller IO queue size 128, less than required. 00:24:54.386 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:54.386 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:54.386 Initialization complete. Launching workers. 00:24:54.386 ======================================================== 00:24:54.386 Latency(us) 00:24:54.386 Device Information : IOPS MiB/s Average min max 00:24:54.386 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1197.60 149.70 107267.98 24094.67 219853.58 00:24:54.386 ======================================================== 00:24:54.386 Total : 1197.60 149.70 107267.98 24094.67 219853.58 00:24:54.386 00:24:54.386 08:32:40 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:54.644 08:32:40 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 816273ef-017f-4dff-acfd-7aede4860e08 00:24:55.211 08:32:41 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:55.469 08:32:41 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c8262ace-d601-4c91-b315-c2bbc79c83da 00:24:56.037 08:32:41 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:56.037 08:32:41 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:56.037 08:32:41 -- host/perf.sh@114 -- # nvmftestfini 00:24:56.037 08:32:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:56.037 08:32:41 -- nvmf/common.sh@116 -- # sync 00:24:56.037 08:32:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:56.037 08:32:41 -- nvmf/common.sh@119 -- # set +e 00:24:56.037 08:32:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:56.037 08:32:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:56.037 rmmod nvme_tcp 00:24:56.037 rmmod nvme_fabrics 00:24:56.332 rmmod nvme_keyring 00:24:56.332 08:32:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:56.332 08:32:41 -- nvmf/common.sh@123 -- # set -e 00:24:56.332 08:32:41 -- nvmf/common.sh@124 -- # return 0 00:24:56.332 08:32:41 -- nvmf/common.sh@477 -- # '[' -n 1039613 ']' 00:24:56.332 08:32:41 -- nvmf/common.sh@478 -- # killprocess 1039613 00:24:56.332 08:32:41 -- common/autotest_common.sh@936 -- # '[' -z 1039613 ']' 00:24:56.332 08:32:41 -- common/autotest_common.sh@940 -- # kill -0 1039613 00:24:56.332 08:32:41 -- common/autotest_common.sh@941 -- # uname 00:24:56.332 08:32:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:56.332 08:32:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1039613 00:24:56.332 08:32:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:56.332 08:32:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:56.332 08:32:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1039613' 00:24:56.332 killing process with pid 1039613 00:24:56.332 08:32:41 -- common/autotest_common.sh@955 -- # kill 1039613 00:24:56.332 08:32:41 -- common/autotest_common.sh@960 -- # wait 1039613 00:24:58.261 08:32:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:58.261 08:32:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:58.261 08:32:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:58.261 08:32:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:58.261 08:32:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:58.261 08:32:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:58.261 08:32:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:58.261 08:32:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.163 08:32:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:00.163 00:25:00.163 real 1m31.906s 00:25:00.163 user 5m37.644s 00:25:00.163 sys 0m16.500s 00:25:00.163 08:32:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:00.163 08:32:45 -- common/autotest_common.sh@10 -- # set +x 00:25:00.163 ************************************ 00:25:00.163 END TEST nvmf_perf 00:25:00.163 ************************************ 00:25:00.163 08:32:45 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:00.163 08:32:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:00.163 08:32:45 -- common/autotest_common.sh@10 -- # set +x 00:25:00.163 ************************************ 00:25:00.163 START TEST nvmf_fio_host 00:25:00.163 ************************************ 00:25:00.163 08:32:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:00.163 * Looking for test storage... 00:25:00.163 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:00.163 08:32:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:00.163 08:32:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:00.163 08:32:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:00.163 08:32:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:00.163 08:32:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:00.163 08:32:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:00.163 08:32:45 -- scripts/common.sh@335 -- # IFS=.-: 00:25:00.163 08:32:45 -- scripts/common.sh@335 -- # read -ra ver1 00:25:00.163 08:32:45 -- scripts/common.sh@336 -- # IFS=.-: 00:25:00.163 08:32:45 -- scripts/common.sh@336 -- # read -ra ver2 00:25:00.163 08:32:45 -- scripts/common.sh@337 -- # local 'op=<' 00:25:00.163 08:32:45 -- scripts/common.sh@339 -- # ver1_l=2 00:25:00.163 08:32:45 -- scripts/common.sh@340 -- # ver2_l=1 00:25:00.163 08:32:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:00.163 08:32:45 -- scripts/common.sh@343 -- # case "$op" in 00:25:00.163 08:32:45 -- scripts/common.sh@344 -- # : 1 00:25:00.163 08:32:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:00.163 08:32:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:00.163 08:32:45 -- scripts/common.sh@364 -- # decimal 1 00:25:00.163 08:32:45 -- scripts/common.sh@352 -- # local d=1 00:25:00.163 08:32:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:00.163 08:32:45 -- scripts/common.sh@354 -- # echo 1 00:25:00.163 08:32:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:00.163 08:32:45 -- scripts/common.sh@365 -- # decimal 2 00:25:00.163 08:32:45 -- scripts/common.sh@352 -- # local d=2 00:25:00.163 08:32:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:00.163 08:32:45 -- scripts/common.sh@354 -- # echo 2 00:25:00.163 08:32:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:00.163 08:32:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:00.163 08:32:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:00.163 08:32:45 -- scripts/common.sh@367 -- # return 0 00:25:00.163 08:32:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:00.163 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.163 --rc genhtml_branch_coverage=1 00:25:00.163 --rc genhtml_function_coverage=1 00:25:00.163 --rc genhtml_legend=1 00:25:00.163 --rc geninfo_all_blocks=1 00:25:00.163 --rc geninfo_unexecuted_blocks=1 00:25:00.163 00:25:00.163 ' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:00.163 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.163 --rc genhtml_branch_coverage=1 00:25:00.163 --rc genhtml_function_coverage=1 00:25:00.163 --rc genhtml_legend=1 00:25:00.163 --rc geninfo_all_blocks=1 00:25:00.163 --rc geninfo_unexecuted_blocks=1 00:25:00.163 00:25:00.163 ' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:00.163 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.163 --rc genhtml_branch_coverage=1 00:25:00.163 --rc genhtml_function_coverage=1 00:25:00.163 --rc genhtml_legend=1 00:25:00.163 --rc geninfo_all_blocks=1 00:25:00.163 --rc geninfo_unexecuted_blocks=1 00:25:00.163 00:25:00.163 ' 00:25:00.163 08:32:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:00.163 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.163 --rc genhtml_branch_coverage=1 00:25:00.163 --rc genhtml_function_coverage=1 00:25:00.163 --rc genhtml_legend=1 00:25:00.163 --rc geninfo_all_blocks=1 00:25:00.163 --rc geninfo_unexecuted_blocks=1 00:25:00.163 00:25:00.163 ' 00:25:00.163 08:32:45 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:00.163 08:32:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:00.163 08:32:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:00.163 08:32:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:00.163 08:32:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.163 08:32:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- paths/export.sh@5 -- # export PATH 00:25:00.164 08:32:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:00.164 08:32:45 -- nvmf/common.sh@7 -- # uname -s 00:25:00.164 08:32:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:00.164 08:32:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:00.164 08:32:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:00.164 08:32:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:00.164 08:32:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:00.164 08:32:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:00.164 08:32:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:00.164 08:32:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:00.164 08:32:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:00.164 08:32:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:00.164 08:32:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.164 08:32:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.164 08:32:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:00.164 08:32:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:00.164 08:32:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:00.164 08:32:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:00.164 08:32:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:00.164 08:32:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:00.164 08:32:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:00.164 08:32:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- paths/export.sh@5 -- # export PATH 00:25:00.164 08:32:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.164 08:32:45 -- nvmf/common.sh@46 -- # : 0 00:25:00.164 08:32:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:00.164 08:32:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:00.164 08:32:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:00.164 08:32:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:00.164 08:32:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:00.164 08:32:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:00.164 08:32:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:00.164 08:32:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:00.164 08:32:45 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:00.164 08:32:45 -- host/fio.sh@14 -- # nvmftestinit 00:25:00.164 08:32:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:00.164 08:32:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:00.164 08:32:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:00.164 08:32:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:00.164 08:32:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:00.164 08:32:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.164 08:32:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.164 08:32:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.164 08:32:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:00.164 08:32:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:00.164 08:32:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:00.164 08:32:45 -- common/autotest_common.sh@10 -- # set +x 00:25:02.069 08:32:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.069 08:32:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:02.069 08:32:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:02.069 08:32:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:02.069 08:32:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:02.069 08:32:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:02.069 08:32:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:02.069 08:32:47 -- nvmf/common.sh@294 -- # net_devs=() 00:25:02.069 08:32:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:02.069 08:32:47 -- nvmf/common.sh@295 -- # e810=() 00:25:02.069 08:32:47 -- nvmf/common.sh@295 -- # local -ga e810 00:25:02.069 08:32:47 -- nvmf/common.sh@296 -- # x722=() 00:25:02.069 08:32:47 -- nvmf/common.sh@296 -- # local -ga x722 00:25:02.069 08:32:47 -- nvmf/common.sh@297 -- # mlx=() 00:25:02.069 08:32:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:02.069 08:32:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.069 08:32:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:02.069 08:32:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:02.069 08:32:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.069 08:32:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:02.069 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:02.069 08:32:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.069 08:32:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:02.069 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:02.069 08:32:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.069 08:32:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.069 08:32:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.069 08:32:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:02.069 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:02.069 08:32:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.069 08:32:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.069 08:32:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.069 08:32:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.069 08:32:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:02.069 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:02.069 08:32:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.069 08:32:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:02.069 08:32:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:02.069 08:32:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:02.069 08:32:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:02.069 08:32:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:02.069 08:32:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:02.069 08:32:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:02.069 08:32:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:02.069 08:32:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:02.069 08:32:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:02.069 08:32:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:02.069 08:32:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:02.069 08:32:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:02.069 08:32:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:02.069 08:32:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:02.069 08:32:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:02.328 08:32:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:02.328 08:32:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:02.328 08:32:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:02.328 08:32:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:02.328 08:32:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:02.328 08:32:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:02.328 08:32:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:02.328 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:02.328 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:25:02.328 00:25:02.328 --- 10.0.0.2 ping statistics --- 00:25:02.328 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.328 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:25:02.328 08:32:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:02.328 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:02.328 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:25:02.328 00:25:02.328 --- 10.0.0.1 ping statistics --- 00:25:02.328 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.328 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:25:02.328 08:32:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:02.328 08:32:47 -- nvmf/common.sh@410 -- # return 0 00:25:02.328 08:32:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:02.328 08:32:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:02.328 08:32:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:02.328 08:32:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:02.328 08:32:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:02.328 08:32:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:02.328 08:32:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:02.328 08:32:48 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:02.328 08:32:48 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:02.328 08:32:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:02.328 08:32:48 -- common/autotest_common.sh@10 -- # set +x 00:25:02.328 08:32:48 -- host/fio.sh@24 -- # nvmfpid=1052056 00:25:02.328 08:32:48 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:02.328 08:32:48 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:02.328 08:32:48 -- host/fio.sh@28 -- # waitforlisten 1052056 00:25:02.328 08:32:48 -- common/autotest_common.sh@829 -- # '[' -z 1052056 ']' 00:25:02.328 08:32:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:02.328 08:32:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:02.328 08:32:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:02.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:02.328 08:32:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:02.328 08:32:48 -- common/autotest_common.sh@10 -- # set +x 00:25:02.328 [2024-11-26 08:32:48.070508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:02.328 [2024-11-26 08:32:48.070591] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:02.328 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.328 [2024-11-26 08:32:48.144312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:02.588 [2024-11-26 08:32:48.258906] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:02.588 [2024-11-26 08:32:48.259067] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:02.588 [2024-11-26 08:32:48.259085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:02.588 [2024-11-26 08:32:48.259109] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:02.588 [2024-11-26 08:32:48.259191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:02.588 [2024-11-26 08:32:48.259247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:02.588 [2024-11-26 08:32:48.259314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:02.588 [2024-11-26 08:32:48.259317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:03.537 08:32:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:03.537 08:32:49 -- common/autotest_common.sh@862 -- # return 0 00:25:03.537 08:32:49 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:03.537 [2024-11-26 08:32:49.263860] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:03.537 08:32:49 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:03.537 08:32:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:03.537 08:32:49 -- common/autotest_common.sh@10 -- # set +x 00:25:03.537 08:32:49 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:03.801 Malloc1 00:25:03.801 08:32:49 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:04.059 08:32:49 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:04.317 08:32:50 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:04.574 [2024-11-26 08:32:50.354788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:04.574 08:32:50 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:04.832 08:32:50 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:04.832 08:32:50 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.833 08:32:50 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.833 08:32:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:04.833 08:32:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:04.833 08:32:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:04.833 08:32:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.833 08:32:50 -- common/autotest_common.sh@1330 -- # shift 00:25:04.833 08:32:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:04.833 08:32:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:04.833 08:32:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:04.833 08:32:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:04.833 08:32:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:04.833 08:32:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:04.833 08:32:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:04.833 08:32:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.091 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:05.091 fio-3.35 00:25:05.091 Starting 1 thread 00:25:05.091 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.622 00:25:07.622 test: (groupid=0, jobs=1): err= 0: pid=1052559: Tue Nov 26 08:32:53 2024 00:25:07.622 read: IOPS=9509, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2006msec) 00:25:07.622 slat (nsec): min=1893, max=111760, avg=2430.07, stdev=1637.02 00:25:07.622 clat (usec): min=2365, max=12940, avg=7432.22, stdev=554.16 00:25:07.622 lat (usec): min=2382, max=12942, avg=7434.65, stdev=554.11 00:25:07.622 clat percentiles (usec): 00:25:07.622 | 1.00th=[ 6194], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 6980], 00:25:07.622 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:25:07.622 | 70.00th=[ 7701], 80.00th=[ 7832], 90.00th=[ 8094], 95.00th=[ 8291], 00:25:07.622 | 99.00th=[ 8717], 99.50th=[ 8848], 99.90th=[10683], 99.95th=[11863], 00:25:07.622 | 99.99th=[12780] 00:25:07.622 bw ( KiB/s): min=37080, max=38904, per=99.94%, avg=38014.00, stdev=747.14, samples=4 00:25:07.622 iops : min= 9270, max= 9726, avg=9503.50, stdev=186.79, samples=4 00:25:07.622 write: IOPS=9517, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec); 0 zone resets 00:25:07.622 slat (nsec): min=1989, max=97742, avg=2539.75, stdev=1464.14 00:25:07.622 clat (usec): min=976, max=11530, avg=5985.06, stdev=489.37 00:25:07.622 lat (usec): min=982, max=11532, avg=5987.60, stdev=489.34 00:25:07.622 clat percentiles (usec): 00:25:07.622 | 1.00th=[ 4948], 5.00th=[ 5276], 10.00th=[ 5473], 20.00th=[ 5604], 00:25:07.622 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:25:07.622 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6652], 00:25:07.622 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[ 9896], 99.95th=[11207], 00:25:07.622 | 99.99th=[11469] 00:25:07.622 bw ( KiB/s): min=37976, max=38144, per=100.00%, avg=38070.00, stdev=69.55, samples=4 00:25:07.622 iops : min= 9494, max= 9536, avg=9517.50, stdev=17.39, samples=4 00:25:07.622 lat (usec) : 1000=0.01% 00:25:07.622 lat (msec) : 2=0.03%, 4=0.11%, 10=99.75%, 20=0.12% 00:25:07.622 cpu : usr=63.59%, sys=33.17%, ctx=79, majf=0, minf=37 00:25:07.622 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:07.622 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:07.622 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:07.622 issued rwts: total=19076,19093,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:07.622 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:07.622 00:25:07.622 Run status group 0 (all jobs): 00:25:07.622 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2006-2006msec 00:25:07.622 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:25:07.622 08:32:53 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.622 08:32:53 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.622 08:32:53 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:07.622 08:32:53 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:07.622 08:32:53 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:07.622 08:32:53 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.622 08:32:53 -- common/autotest_common.sh@1330 -- # shift 00:25:07.622 08:32:53 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:07.622 08:32:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.622 08:32:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.622 08:32:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.622 08:32:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.622 08:32:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.622 08:32:53 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:07.622 08:32:53 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.622 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:07.622 fio-3.35 00:25:07.622 Starting 1 thread 00:25:07.881 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.411 00:25:10.411 test: (groupid=0, jobs=1): err= 0: pid=1052894: Tue Nov 26 08:32:55 2024 00:25:10.411 read: IOPS=8694, BW=136MiB/s (142MB/s)(273MiB/2009msec) 00:25:10.411 slat (usec): min=2, max=118, avg= 3.73, stdev= 2.08 00:25:10.411 clat (usec): min=2023, max=16700, avg=8701.32, stdev=2019.10 00:25:10.411 lat (usec): min=2027, max=16703, avg=8705.05, stdev=2019.19 00:25:10.411 clat percentiles (usec): 00:25:10.411 | 1.00th=[ 4555], 5.00th=[ 5473], 10.00th=[ 6063], 20.00th=[ 6980], 00:25:10.411 | 30.00th=[ 7570], 40.00th=[ 8094], 50.00th=[ 8717], 60.00th=[ 9241], 00:25:10.411 | 70.00th=[ 9765], 80.00th=[10552], 90.00th=[11076], 95.00th=[11863], 00:25:10.411 | 99.00th=[13698], 99.50th=[14615], 99.90th=[16057], 99.95th=[16450], 00:25:10.411 | 99.99th=[16581] 00:25:10.411 bw ( KiB/s): min=61920, max=80960, per=51.84%, avg=72120.00, stdev=10050.70, samples=4 00:25:10.411 iops : min= 3870, max= 5060, avg=4507.50, stdev=628.17, samples=4 00:25:10.411 write: IOPS=5213, BW=81.5MiB/s (85.4MB/s)(147MiB/1808msec); 0 zone resets 00:25:10.411 slat (usec): min=30, max=199, avg=33.94, stdev= 6.06 00:25:10.411 clat (usec): min=3382, max=16786, avg=10604.98, stdev=1859.17 00:25:10.411 lat (usec): min=3416, max=16818, avg=10638.91, stdev=1859.22 00:25:10.411 clat percentiles (usec): 00:25:10.411 | 1.00th=[ 6980], 5.00th=[ 7963], 10.00th=[ 8586], 20.00th=[ 9110], 00:25:10.411 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10814], 00:25:10.411 | 70.00th=[11338], 80.00th=[11994], 90.00th=[13173], 95.00th=[14222], 00:25:10.411 | 99.00th=[15664], 99.50th=[16188], 99.90th=[16712], 99.95th=[16712], 00:25:10.411 | 99.99th=[16909] 00:25:10.411 bw ( KiB/s): min=65088, max=83552, per=89.97%, avg=75048.00, stdev=9807.93, samples=4 00:25:10.411 iops : min= 4068, max= 5222, avg=4690.50, stdev=613.00, samples=4 00:25:10.411 lat (msec) : 4=0.28%, 10=61.81%, 20=37.91% 00:25:10.411 cpu : usr=74.20%, sys=23.90%, ctx=31, majf=0, minf=71 00:25:10.411 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:25:10.411 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:10.411 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:10.411 issued rwts: total=17468,9426,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:10.411 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:10.411 00:25:10.411 Run status group 0 (all jobs): 00:25:10.411 READ: bw=136MiB/s (142MB/s), 136MiB/s-136MiB/s (142MB/s-142MB/s), io=273MiB (286MB), run=2009-2009msec 00:25:10.411 WRITE: bw=81.5MiB/s (85.4MB/s), 81.5MiB/s-81.5MiB/s (85.4MB/s-85.4MB/s), io=147MiB (154MB), run=1808-1808msec 00:25:10.412 08:32:55 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:10.412 08:32:56 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:10.412 08:32:56 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:10.412 08:32:56 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:10.412 08:32:56 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:10.412 08:32:56 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:10.412 08:32:56 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:10.412 08:32:56 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:10.412 08:32:56 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:10.412 08:32:56 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:10.412 08:32:56 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:10.412 08:32:56 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:13.695 Nvme0n1 00:25:13.695 08:32:59 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:16.220 08:33:02 -- host/fio.sh@53 -- # ls_guid=5914e7bd-9e32-47f8-8028-dbcf00f3e134 00:25:16.220 08:33:02 -- host/fio.sh@54 -- # get_lvs_free_mb 5914e7bd-9e32-47f8-8028-dbcf00f3e134 00:25:16.220 08:33:02 -- common/autotest_common.sh@1353 -- # local lvs_uuid=5914e7bd-9e32-47f8-8028-dbcf00f3e134 00:25:16.220 08:33:02 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:16.220 08:33:02 -- common/autotest_common.sh@1355 -- # local fc 00:25:16.220 08:33:02 -- common/autotest_common.sh@1356 -- # local cs 00:25:16.220 08:33:02 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:16.478 08:33:02 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:16.478 { 00:25:16.478 "uuid": "5914e7bd-9e32-47f8-8028-dbcf00f3e134", 00:25:16.478 "name": "lvs_0", 00:25:16.478 "base_bdev": "Nvme0n1", 00:25:16.478 "total_data_clusters": 930, 00:25:16.478 "free_clusters": 930, 00:25:16.478 "block_size": 512, 00:25:16.478 "cluster_size": 1073741824 00:25:16.478 } 00:25:16.478 ]' 00:25:16.478 08:33:02 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="5914e7bd-9e32-47f8-8028-dbcf00f3e134") .free_clusters' 00:25:16.737 08:33:02 -- common/autotest_common.sh@1358 -- # fc=930 00:25:16.737 08:33:02 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="5914e7bd-9e32-47f8-8028-dbcf00f3e134") .cluster_size' 00:25:16.737 08:33:02 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:16.737 08:33:02 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:16.737 08:33:02 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:16.737 952320 00:25:16.737 08:33:02 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:16.995 082af1a1-5108-4f51-943d-0e0002cddf96 00:25:16.995 08:33:02 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:17.253 08:33:03 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:17.511 08:33:03 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:17.769 08:33:03 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:17.769 08:33:03 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:17.769 08:33:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:17.769 08:33:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:17.769 08:33:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:17.769 08:33:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:17.769 08:33:03 -- common/autotest_common.sh@1330 -- # shift 00:25:17.769 08:33:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:17.769 08:33:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:17.769 08:33:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:17.769 08:33:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:17.769 08:33:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.029 08:33:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.029 08:33:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.029 08:33:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.029 08:33:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.030 08:33:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:18.030 08:33:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.030 08:33:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.030 08:33:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.030 08:33:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:18.030 08:33:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.030 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:18.030 fio-3.35 00:25:18.030 Starting 1 thread 00:25:18.030 EAL: No free 2048 kB hugepages reported on node 1 00:25:20.558 00:25:20.558 test: (groupid=0, jobs=1): err= 0: pid=1054325: Tue Nov 26 08:33:06 2024 00:25:20.558 read: IOPS=6540, BW=25.5MiB/s (26.8MB/s)(51.3MiB/2007msec) 00:25:20.558 slat (nsec): min=1941, max=189094, avg=2607.37, stdev=2521.02 00:25:20.558 clat (usec): min=940, max=170752, avg=10740.02, stdev=11215.14 00:25:20.558 lat (usec): min=943, max=170784, avg=10742.63, stdev=11215.48 00:25:20.558 clat percentiles (msec): 00:25:20.558 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:20.558 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11], 00:25:20.558 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 11], 95.00th=[ 12], 00:25:20.558 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:20.558 | 99.99th=[ 171] 00:25:20.558 bw ( KiB/s): min=18168, max=28888, per=99.81%, avg=26112.00, stdev=5298.90, samples=4 00:25:20.558 iops : min= 4542, max= 7222, avg=6528.00, stdev=1324.73, samples=4 00:25:20.558 write: IOPS=6548, BW=25.6MiB/s (26.8MB/s)(51.3MiB/2007msec); 0 zone resets 00:25:20.558 slat (usec): min=2, max=133, avg= 2.71, stdev= 1.82 00:25:20.558 clat (usec): min=296, max=168779, avg=8647.58, stdev=10496.69 00:25:20.558 lat (usec): min=300, max=168786, avg=8650.29, stdev=10497.01 00:25:20.558 clat percentiles (msec): 00:25:20.558 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:20.558 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 9], 00:25:20.558 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:20.558 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:20.558 | 99.99th=[ 169] 00:25:20.558 bw ( KiB/s): min=19112, max=28760, per=99.91%, avg=26170.00, stdev=4709.71, samples=4 00:25:20.558 iops : min= 4778, max= 7190, avg=6542.50, stdev=1177.43, samples=4 00:25:20.558 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:20.558 lat (msec) : 2=0.03%, 4=0.15%, 10=75.83%, 20=23.47%, 250=0.49% 00:25:20.558 cpu : usr=61.67%, sys=35.84%, ctx=89, majf=0, minf=37 00:25:20.558 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:20.558 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:20.558 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:20.558 issued rwts: total=13126,13142,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:20.558 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:20.558 00:25:20.558 Run status group 0 (all jobs): 00:25:20.558 READ: bw=25.5MiB/s (26.8MB/s), 25.5MiB/s-25.5MiB/s (26.8MB/s-26.8MB/s), io=51.3MiB (53.8MB), run=2007-2007msec 00:25:20.558 WRITE: bw=25.6MiB/s (26.8MB/s), 25.6MiB/s-25.6MiB/s (26.8MB/s-26.8MB/s), io=51.3MiB (53.8MB), run=2007-2007msec 00:25:20.558 08:33:06 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:20.816 08:33:06 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:22.193 08:33:07 -- host/fio.sh@64 -- # ls_nested_guid=f44b4ec2-c022-4eda-94d0-8be991dccbd8 00:25:22.193 08:33:07 -- host/fio.sh@65 -- # get_lvs_free_mb f44b4ec2-c022-4eda-94d0-8be991dccbd8 00:25:22.193 08:33:07 -- common/autotest_common.sh@1353 -- # local lvs_uuid=f44b4ec2-c022-4eda-94d0-8be991dccbd8 00:25:22.194 08:33:07 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:22.194 08:33:07 -- common/autotest_common.sh@1355 -- # local fc 00:25:22.194 08:33:07 -- common/autotest_common.sh@1356 -- # local cs 00:25:22.194 08:33:07 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:22.194 08:33:07 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:22.194 { 00:25:22.194 "uuid": "5914e7bd-9e32-47f8-8028-dbcf00f3e134", 00:25:22.194 "name": "lvs_0", 00:25:22.194 "base_bdev": "Nvme0n1", 00:25:22.194 "total_data_clusters": 930, 00:25:22.194 "free_clusters": 0, 00:25:22.194 "block_size": 512, 00:25:22.194 "cluster_size": 1073741824 00:25:22.194 }, 00:25:22.194 { 00:25:22.194 "uuid": "f44b4ec2-c022-4eda-94d0-8be991dccbd8", 00:25:22.194 "name": "lvs_n_0", 00:25:22.194 "base_bdev": "082af1a1-5108-4f51-943d-0e0002cddf96", 00:25:22.194 "total_data_clusters": 237847, 00:25:22.194 "free_clusters": 237847, 00:25:22.194 "block_size": 512, 00:25:22.194 "cluster_size": 4194304 00:25:22.194 } 00:25:22.194 ]' 00:25:22.194 08:33:07 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="f44b4ec2-c022-4eda-94d0-8be991dccbd8") .free_clusters' 00:25:22.194 08:33:08 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:22.194 08:33:08 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="f44b4ec2-c022-4eda-94d0-8be991dccbd8") .cluster_size' 00:25:22.451 08:33:08 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:22.451 08:33:08 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:22.451 08:33:08 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:22.451 951388 00:25:22.451 08:33:08 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:23.017 c9b77e2a-9c20-4443-ba14-dbb8042bd47f 00:25:23.017 08:33:08 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:23.276 08:33:09 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:23.534 08:33:09 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:23.793 08:33:09 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:23.793 08:33:09 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:23.793 08:33:09 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:23.793 08:33:09 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:23.793 08:33:09 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:23.793 08:33:09 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:23.793 08:33:09 -- common/autotest_common.sh@1330 -- # shift 00:25:23.793 08:33:09 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:23.793 08:33:09 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:23.793 08:33:09 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:23.793 08:33:09 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:23.793 08:33:09 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:23.793 08:33:09 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:23.793 08:33:09 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:23.793 08:33:09 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:24.052 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:24.052 fio-3.35 00:25:24.052 Starting 1 thread 00:25:24.052 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.580 00:25:26.580 test: (groupid=0, jobs=1): err= 0: pid=1055727: Tue Nov 26 08:33:12 2024 00:25:26.580 read: IOPS=6198, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2008msec) 00:25:26.580 slat (nsec): min=1911, max=137534, avg=2469.82, stdev=2020.18 00:25:26.580 clat (usec): min=4373, max=19749, avg=11400.28, stdev=968.13 00:25:26.580 lat (usec): min=4378, max=19752, avg=11402.75, stdev=968.07 00:25:26.580 clat percentiles (usec): 00:25:26.580 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:25:26.580 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[11600], 00:25:26.580 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12911], 00:25:26.580 | 99.00th=[13566], 99.50th=[13698], 99.90th=[18220], 99.95th=[18482], 00:25:26.580 | 99.99th=[19792] 00:25:26.580 bw ( KiB/s): min=23472, max=25344, per=99.86%, avg=24760.00, stdev=866.49, samples=4 00:25:26.580 iops : min= 5868, max= 6336, avg=6190.00, stdev=216.62, samples=4 00:25:26.580 write: IOPS=6191, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2008msec); 0 zone resets 00:25:26.580 slat (usec): min=2, max=101, avg= 2.59, stdev= 1.40 00:25:26.580 clat (usec): min=2112, max=15519, avg=9106.97, stdev=830.23 00:25:26.580 lat (usec): min=2118, max=15522, avg=9109.55, stdev=830.22 00:25:26.580 clat percentiles (usec): 00:25:26.580 | 1.00th=[ 7177], 5.00th=[ 7832], 10.00th=[ 8094], 20.00th=[ 8455], 00:25:26.580 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9110], 60.00th=[ 9241], 00:25:26.580 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10028], 95.00th=[10290], 00:25:26.580 | 99.00th=[10945], 99.50th=[11207], 99.90th=[13829], 99.95th=[14222], 00:25:26.580 | 99.99th=[15401] 00:25:26.580 bw ( KiB/s): min=24536, max=24896, per=99.91%, avg=24742.00, stdev=150.00, samples=4 00:25:26.580 iops : min= 6134, max= 6224, avg=6185.50, stdev=37.50, samples=4 00:25:26.580 lat (msec) : 4=0.04%, 10=46.87%, 20=53.08% 00:25:26.580 cpu : usr=60.24%, sys=37.42%, ctx=121, majf=0, minf=37 00:25:26.580 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:26.580 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:26.580 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:26.580 issued rwts: total=12447,12432,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:26.580 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:26.580 00:25:26.580 Run status group 0 (all jobs): 00:25:26.580 READ: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (51.0MB), run=2008-2008msec 00:25:26.580 WRITE: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (50.9MB), run=2008-2008msec 00:25:26.580 08:33:12 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:26.837 08:33:12 -- host/fio.sh@74 -- # sync 00:25:26.837 08:33:12 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:31.103 08:33:16 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:31.103 08:33:16 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:33.634 08:33:19 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:33.891 08:33:19 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:36.430 08:33:21 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:36.430 08:33:21 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:36.430 08:33:21 -- host/fio.sh@86 -- # nvmftestfini 00:25:36.430 08:33:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:36.430 08:33:21 -- nvmf/common.sh@116 -- # sync 00:25:36.430 08:33:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:36.430 08:33:21 -- nvmf/common.sh@119 -- # set +e 00:25:36.430 08:33:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:36.430 08:33:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:36.430 rmmod nvme_tcp 00:25:36.430 rmmod nvme_fabrics 00:25:36.430 rmmod nvme_keyring 00:25:36.430 08:33:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:36.430 08:33:21 -- nvmf/common.sh@123 -- # set -e 00:25:36.430 08:33:21 -- nvmf/common.sh@124 -- # return 0 00:25:36.430 08:33:21 -- nvmf/common.sh@477 -- # '[' -n 1052056 ']' 00:25:36.430 08:33:21 -- nvmf/common.sh@478 -- # killprocess 1052056 00:25:36.430 08:33:21 -- common/autotest_common.sh@936 -- # '[' -z 1052056 ']' 00:25:36.430 08:33:21 -- common/autotest_common.sh@940 -- # kill -0 1052056 00:25:36.430 08:33:21 -- common/autotest_common.sh@941 -- # uname 00:25:36.430 08:33:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:36.430 08:33:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1052056 00:25:36.430 08:33:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:36.430 08:33:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:36.430 08:33:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1052056' 00:25:36.430 killing process with pid 1052056 00:25:36.430 08:33:21 -- common/autotest_common.sh@955 -- # kill 1052056 00:25:36.430 08:33:21 -- common/autotest_common.sh@960 -- # wait 1052056 00:25:36.430 08:33:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:36.430 08:33:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:36.430 08:33:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:36.430 08:33:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:36.430 08:33:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:36.430 08:33:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.430 08:33:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.430 08:33:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.340 08:33:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:38.340 00:25:38.340 real 0m38.398s 00:25:38.340 user 2m26.344s 00:25:38.340 sys 0m7.471s 00:25:38.340 08:33:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:38.340 08:33:24 -- common/autotest_common.sh@10 -- # set +x 00:25:38.340 ************************************ 00:25:38.340 END TEST nvmf_fio_host 00:25:38.340 ************************************ 00:25:38.340 08:33:24 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:38.340 08:33:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:38.340 08:33:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:38.340 08:33:24 -- common/autotest_common.sh@10 -- # set +x 00:25:38.340 ************************************ 00:25:38.340 START TEST nvmf_failover 00:25:38.340 ************************************ 00:25:38.340 08:33:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:38.340 * Looking for test storage... 00:25:38.340 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:38.340 08:33:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:38.340 08:33:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:38.340 08:33:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:38.601 08:33:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:38.602 08:33:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:38.602 08:33:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:38.602 08:33:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:38.602 08:33:24 -- scripts/common.sh@335 -- # IFS=.-: 00:25:38.602 08:33:24 -- scripts/common.sh@335 -- # read -ra ver1 00:25:38.602 08:33:24 -- scripts/common.sh@336 -- # IFS=.-: 00:25:38.602 08:33:24 -- scripts/common.sh@336 -- # read -ra ver2 00:25:38.602 08:33:24 -- scripts/common.sh@337 -- # local 'op=<' 00:25:38.602 08:33:24 -- scripts/common.sh@339 -- # ver1_l=2 00:25:38.602 08:33:24 -- scripts/common.sh@340 -- # ver2_l=1 00:25:38.602 08:33:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:38.602 08:33:24 -- scripts/common.sh@343 -- # case "$op" in 00:25:38.602 08:33:24 -- scripts/common.sh@344 -- # : 1 00:25:38.602 08:33:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:38.602 08:33:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:38.602 08:33:24 -- scripts/common.sh@364 -- # decimal 1 00:25:38.602 08:33:24 -- scripts/common.sh@352 -- # local d=1 00:25:38.602 08:33:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:38.602 08:33:24 -- scripts/common.sh@354 -- # echo 1 00:25:38.602 08:33:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:38.602 08:33:24 -- scripts/common.sh@365 -- # decimal 2 00:25:38.602 08:33:24 -- scripts/common.sh@352 -- # local d=2 00:25:38.602 08:33:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:38.602 08:33:24 -- scripts/common.sh@354 -- # echo 2 00:25:38.602 08:33:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:38.602 08:33:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:38.602 08:33:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:38.602 08:33:24 -- scripts/common.sh@367 -- # return 0 00:25:38.602 08:33:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:38.602 08:33:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.602 --rc genhtml_branch_coverage=1 00:25:38.602 --rc genhtml_function_coverage=1 00:25:38.602 --rc genhtml_legend=1 00:25:38.602 --rc geninfo_all_blocks=1 00:25:38.602 --rc geninfo_unexecuted_blocks=1 00:25:38.602 00:25:38.602 ' 00:25:38.602 08:33:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.602 --rc genhtml_branch_coverage=1 00:25:38.602 --rc genhtml_function_coverage=1 00:25:38.602 --rc genhtml_legend=1 00:25:38.602 --rc geninfo_all_blocks=1 00:25:38.602 --rc geninfo_unexecuted_blocks=1 00:25:38.602 00:25:38.602 ' 00:25:38.602 08:33:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.602 --rc genhtml_branch_coverage=1 00:25:38.602 --rc genhtml_function_coverage=1 00:25:38.602 --rc genhtml_legend=1 00:25:38.602 --rc geninfo_all_blocks=1 00:25:38.602 --rc geninfo_unexecuted_blocks=1 00:25:38.602 00:25:38.602 ' 00:25:38.602 08:33:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:38.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.602 --rc genhtml_branch_coverage=1 00:25:38.602 --rc genhtml_function_coverage=1 00:25:38.602 --rc genhtml_legend=1 00:25:38.602 --rc geninfo_all_blocks=1 00:25:38.602 --rc geninfo_unexecuted_blocks=1 00:25:38.602 00:25:38.602 ' 00:25:38.602 08:33:24 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:38.602 08:33:24 -- nvmf/common.sh@7 -- # uname -s 00:25:38.602 08:33:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:38.602 08:33:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:38.602 08:33:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:38.602 08:33:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:38.602 08:33:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:38.602 08:33:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:38.602 08:33:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:38.602 08:33:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:38.602 08:33:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:38.602 08:33:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:38.602 08:33:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.602 08:33:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.602 08:33:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:38.602 08:33:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:38.602 08:33:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:38.602 08:33:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:38.602 08:33:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:38.602 08:33:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:38.602 08:33:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:38.602 08:33:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.602 08:33:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.602 08:33:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.602 08:33:24 -- paths/export.sh@5 -- # export PATH 00:25:38.602 08:33:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.602 08:33:24 -- nvmf/common.sh@46 -- # : 0 00:25:38.602 08:33:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:38.602 08:33:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:38.602 08:33:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:38.602 08:33:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:38.602 08:33:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:38.602 08:33:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:38.602 08:33:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:38.602 08:33:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:38.602 08:33:24 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:38.602 08:33:24 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:38.602 08:33:24 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:38.602 08:33:24 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:38.602 08:33:24 -- host/failover.sh@18 -- # nvmftestinit 00:25:38.602 08:33:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:38.602 08:33:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:38.603 08:33:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:38.603 08:33:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:38.603 08:33:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:38.603 08:33:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.603 08:33:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.603 08:33:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.603 08:33:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:38.603 08:33:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:38.603 08:33:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:38.603 08:33:24 -- common/autotest_common.sh@10 -- # set +x 00:25:40.508 08:33:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.508 08:33:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.508 08:33:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.508 08:33:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.508 08:33:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.508 08:33:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.508 08:33:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.508 08:33:26 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.508 08:33:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.508 08:33:26 -- nvmf/common.sh@295 -- # e810=() 00:25:40.508 08:33:26 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.508 08:33:26 -- nvmf/common.sh@296 -- # x722=() 00:25:40.508 08:33:26 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.508 08:33:26 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.508 08:33:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.508 08:33:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.508 08:33:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.508 08:33:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.508 08:33:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.508 08:33:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.508 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.508 08:33:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.508 08:33:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.508 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.508 08:33:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.508 08:33:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.508 08:33:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.508 08:33:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.508 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.508 08:33:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.508 08:33:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.508 08:33:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.508 08:33:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.508 08:33:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.508 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.508 08:33:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.508 08:33:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.508 08:33:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.508 08:33:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.508 08:33:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.508 08:33:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.508 08:33:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.508 08:33:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.508 08:33:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.508 08:33:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.508 08:33:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.508 08:33:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.508 08:33:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.508 08:33:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.508 08:33:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.508 08:33:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.508 08:33:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:40.508 08:33:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:40.508 08:33:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:40.508 08:33:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:40.508 08:33:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:40.768 08:33:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:40.768 08:33:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:40.768 08:33:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:40.768 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:40.768 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:25:40.768 00:25:40.768 --- 10.0.0.2 ping statistics --- 00:25:40.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.768 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:25:40.768 08:33:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:40.768 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:40.768 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:25:40.768 00:25:40.768 --- 10.0.0.1 ping statistics --- 00:25:40.768 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.768 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:25:40.768 08:33:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:40.768 08:33:26 -- nvmf/common.sh@410 -- # return 0 00:25:40.768 08:33:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:40.768 08:33:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:40.768 08:33:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:40.768 08:33:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:40.768 08:33:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:40.768 08:33:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:40.768 08:33:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:40.768 08:33:26 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:40.768 08:33:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:40.768 08:33:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:40.768 08:33:26 -- common/autotest_common.sh@10 -- # set +x 00:25:40.768 08:33:26 -- nvmf/common.sh@469 -- # nvmfpid=1059037 00:25:40.768 08:33:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:40.768 08:33:26 -- nvmf/common.sh@470 -- # waitforlisten 1059037 00:25:40.768 08:33:26 -- common/autotest_common.sh@829 -- # '[' -z 1059037 ']' 00:25:40.768 08:33:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:40.768 08:33:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:40.768 08:33:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:40.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:40.768 08:33:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:40.768 08:33:26 -- common/autotest_common.sh@10 -- # set +x 00:25:40.768 [2024-11-26 08:33:26.457884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:40.768 [2024-11-26 08:33:26.457956] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:40.768 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.768 [2024-11-26 08:33:26.528645] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:41.027 [2024-11-26 08:33:26.642662] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:41.027 [2024-11-26 08:33:26.642829] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:41.027 [2024-11-26 08:33:26.642849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:41.027 [2024-11-26 08:33:26.642863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:41.027 [2024-11-26 08:33:26.642951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:41.027 [2024-11-26 08:33:26.643065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:41.027 [2024-11-26 08:33:26.643069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:41.597 08:33:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:41.597 08:33:27 -- common/autotest_common.sh@862 -- # return 0 00:25:41.597 08:33:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:41.597 08:33:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:41.597 08:33:27 -- common/autotest_common.sh@10 -- # set +x 00:25:41.597 08:33:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:41.597 08:33:27 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:41.855 [2024-11-26 08:33:27.681903] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:41.855 08:33:27 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:42.114 Malloc0 00:25:42.373 08:33:27 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:42.632 08:33:28 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:42.892 08:33:28 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:42.892 [2024-11-26 08:33:28.721119] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:42.892 08:33:28 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:43.150 [2024-11-26 08:33:28.965813] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:43.150 08:33:28 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:43.408 [2024-11-26 08:33:29.230759] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:43.408 08:33:29 -- host/failover.sh@31 -- # bdevperf_pid=1059435 00:25:43.408 08:33:29 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:43.408 08:33:29 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.408 08:33:29 -- host/failover.sh@34 -- # waitforlisten 1059435 /var/tmp/bdevperf.sock 00:25:43.408 08:33:29 -- common/autotest_common.sh@829 -- # '[' -z 1059435 ']' 00:25:43.408 08:33:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:43.408 08:33:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.408 08:33:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:43.408 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:43.408 08:33:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.408 08:33:29 -- common/autotest_common.sh@10 -- # set +x 00:25:44.784 08:33:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.784 08:33:30 -- common/autotest_common.sh@862 -- # return 0 00:25:44.784 08:33:30 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:45.043 NVMe0n1 00:25:45.043 08:33:30 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:45.302 00:25:45.302 08:33:31 -- host/failover.sh@39 -- # run_test_pid=1059619 00:25:45.302 08:33:31 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:45.302 08:33:31 -- host/failover.sh@41 -- # sleep 1 00:25:46.683 08:33:32 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:46.683 [2024-11-26 08:33:32.371536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.371998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 [2024-11-26 08:33:32.372284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d11cb0 is same with the state(5) to be set 00:25:46.683 08:33:32 -- host/failover.sh@45 -- # sleep 3 00:25:49.974 08:33:35 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.974 00:25:49.974 08:33:35 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:50.233 [2024-11-26 08:33:36.081838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.081995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.233 [2024-11-26 08:33:36.082353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.234 [2024-11-26 08:33:36.082548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d133a0 is same with the state(5) to be set 00:25:50.492 08:33:36 -- host/failover.sh@50 -- # sleep 3 00:25:53.780 08:33:39 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:53.780 [2024-11-26 08:33:39.389582] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:53.780 08:33:39 -- host/failover.sh@55 -- # sleep 1 00:25:54.715 08:33:40 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:54.976 [2024-11-26 08:33:40.664303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 [2024-11-26 08:33:40.664750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d13a80 is same with the state(5) to be set 00:25:54.976 08:33:40 -- host/failover.sh@59 -- # wait 1059619 00:26:01.552 0 00:26:01.552 08:33:46 -- host/failover.sh@61 -- # killprocess 1059435 00:26:01.552 08:33:46 -- common/autotest_common.sh@936 -- # '[' -z 1059435 ']' 00:26:01.552 08:33:46 -- common/autotest_common.sh@940 -- # kill -0 1059435 00:26:01.552 08:33:46 -- common/autotest_common.sh@941 -- # uname 00:26:01.552 08:33:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:01.552 08:33:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1059435 00:26:01.552 08:33:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:01.552 08:33:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:01.552 08:33:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1059435' 00:26:01.552 killing process with pid 1059435 00:26:01.552 08:33:46 -- common/autotest_common.sh@955 -- # kill 1059435 00:26:01.552 08:33:46 -- common/autotest_common.sh@960 -- # wait 1059435 00:26:01.552 08:33:46 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:01.552 [2024-11-26 08:33:29.287988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:01.552 [2024-11-26 08:33:29.288113] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1059435 ] 00:26:01.552 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.552 [2024-11-26 08:33:29.348305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:01.552 [2024-11-26 08:33:29.457100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:01.552 Running I/O for 15 seconds... 00:26:01.552 [2024-11-26 08:33:32.372583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.372959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.372973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.552 [2024-11-26 08:33:32.373540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.552 [2024-11-26 08:33:32.373553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.373824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:116328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:116336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.373977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.373990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.553 [2024-11-26 08:33:32.374531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.553 [2024-11-26 08:33:32.374586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.553 [2024-11-26 08:33:32.374600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.374669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.374715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.374774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.374803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.374983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.374996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:116688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:116696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.554 [2024-11-26 08:33:32.375656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.554 [2024-11-26 08:33:32.375683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.554 [2024-11-26 08:33:32.375708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.375953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.555 [2024-11-26 08:33:32.375981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.375995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.555 [2024-11-26 08:33:32.376008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.555 [2024-11-26 08:33:32.376036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:116752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.555 [2024-11-26 08:33:32.376064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.555 [2024-11-26 08:33:32.376091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:32.376289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4b6a0 is same with the state(5) to be set 00:26:01.555 [2024-11-26 08:33:32.376319] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:01.555 [2024-11-26 08:33:32.376330] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:01.555 [2024-11-26 08:33:32.376346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116304 len:8 PRP1 0x0 PRP2 0x0 00:26:01.555 [2024-11-26 08:33:32.376360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376420] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d4b6a0 was disconnected and freed. reset controller. 00:26:01.555 [2024-11-26 08:33:32.376444] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:01.555 [2024-11-26 08:33:32.376481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.555 [2024-11-26 08:33:32.376500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.555 [2024-11-26 08:33:32.376528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376541] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.555 [2024-11-26 08:33:32.376554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.555 [2024-11-26 08:33:32.376579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:32.376592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.555 [2024-11-26 08:33:32.376630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2c870 (9): Bad file descriptor 00:26:01.555 [2024-11-26 08:33:32.378722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.555 [2024-11-26 08:33:32.406073] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:01.555 [2024-11-26 08:33:36.082718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:114600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.082959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.082988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.083002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.083017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.083030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.555 [2024-11-26 08:33:36.083044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.555 [2024-11-26 08:33:36.083073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:114736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:114152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:114176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:114184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:114192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:114200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:114240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:114256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:114272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:114768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:114784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:114816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:114864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:114872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:114880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:114888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:114896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:114904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:114912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.083793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:114288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:114296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:114304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:114312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:114320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:114368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.083975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.083991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.084018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.084034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:114392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.556 [2024-11-26 08:33:36.084046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.084061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:114920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.084073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.556 [2024-11-26 08:33:36.084088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:114928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.556 [2024-11-26 08:33:36.084100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:114936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:114944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:114952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:114960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:114976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:114984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:114408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:114456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:114480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:115008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:115016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:115040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:115064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:115072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:115080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:115096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.557 [2024-11-26 08:33:36.084950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.084964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.084991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:114488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:114512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:114528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:114536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:114560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:114584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.557 [2024-11-26 08:33:36.085247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.557 [2024-11-26 08:33:36.085262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:115144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:115152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:115160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:115168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:115176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:114592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:114616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:114680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:114712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:115192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:115200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:115216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:115232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.085962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.085977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:115240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.085989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:115248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:115256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:115272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:115304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:115312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:115320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:115352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.558 [2024-11-26 08:33:36.086441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:114744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.558 [2024-11-26 08:33:36.086469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.558 [2024-11-26 08:33:36.086484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:114752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:114800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:114824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:114832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:114840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:36.086681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d38d10 is same with the state(5) to be set 00:26:01.559 [2024-11-26 08:33:36.086722] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:01.559 [2024-11-26 08:33:36.086734] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:01.559 [2024-11-26 08:33:36.086747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114848 len:8 PRP1 0x0 PRP2 0x0 00:26:01.559 [2024-11-26 08:33:36.086760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086821] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d38d10 was disconnected and freed. reset controller. 00:26:01.559 [2024-11-26 08:33:36.086839] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:26:01.559 [2024-11-26 08:33:36.086874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.559 [2024-11-26 08:33:36.086893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.559 [2024-11-26 08:33:36.086921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.559 [2024-11-26 08:33:36.086958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.559 [2024-11-26 08:33:36.086985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:36.086999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.559 [2024-11-26 08:33:36.087037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2c870 (9): Bad file descriptor 00:26:01.559 [2024-11-26 08:33:36.089247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.559 [2024-11-26 08:33:36.119943] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:01.559 [2024-11-26 08:33:40.664882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:70200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.664923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.664951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:70224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.664976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.664993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:70240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:70248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:70296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:70304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:70312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:70336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:70352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:70360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:70376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:70408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:70416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:70424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:70432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:70440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:70448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:70456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:70464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:70472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:70480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:70488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:70496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:70504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.559 [2024-11-26 08:33:40.665642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.559 [2024-11-26 08:33:40.665657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:70512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.559 [2024-11-26 08:33:40.665670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:70520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:69760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:69800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:69808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:69816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:69824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:69856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:69872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:69904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:70528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.665969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.665984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:70536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.665997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:70544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:70552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:70560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:70568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:70576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:70584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:70592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:70600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:70608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:70616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:70624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:70632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:70640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:70648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:70656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:70664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.560 [2024-11-26 08:33:40.666453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:70672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:70680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:69920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:69936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:69944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:69952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:69968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:69976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:70000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:70008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.560 [2024-11-26 08:33:40.666753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.560 [2024-11-26 08:33:40.666767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:70688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.666781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:70696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.666808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:70704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.666836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:70712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.666865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:70720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.666893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:70728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.666926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:70736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.666954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:70744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.666982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.666997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:70752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:70760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:70768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:70776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:70784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:70792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:70800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:70808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:70816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:70824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:70832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:70040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:70048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:70064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:70072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:70088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:70096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:70168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:70184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:70840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:70848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:70856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:70864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.561 [2024-11-26 08:33:40.667643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:70872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:70880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.561 [2024-11-26 08:33:40.667723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:70888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.561 [2024-11-26 08:33:40.667745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:70896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:70904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.667801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:70912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.667829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:70920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:70928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.667884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:70192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:70208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:70216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.667982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:70232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.667999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:70256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:70264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:70272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:70280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:70936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.668140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:70944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:70952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:70960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:70968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:70976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.668277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:70984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.668304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:70992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.668331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:71000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:71008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:71016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:01.562 [2024-11-26 08:33:40.668418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:70288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:70320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:70328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:70344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:70368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:70384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:70392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:01.562 [2024-11-26 08:33:40.668610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4f630 is same with the state(5) to be set 00:26:01.562 [2024-11-26 08:33:40.668640] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:01.562 [2024-11-26 08:33:40.668651] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:01.562 [2024-11-26 08:33:40.668663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:70400 len:8 PRP1 0x0 PRP2 0x0 00:26:01.562 [2024-11-26 08:33:40.668676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668760] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d4f630 was disconnected and freed. reset controller. 00:26:01.562 [2024-11-26 08:33:40.668779] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:26:01.562 [2024-11-26 08:33:40.668819] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.562 [2024-11-26 08:33:40.668838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.562 [2024-11-26 08:33:40.668865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.562 [2024-11-26 08:33:40.668890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:01.562 [2024-11-26 08:33:40.668916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:01.562 [2024-11-26 08:33:40.668930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.563 [2024-11-26 08:33:40.668982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d2c870 (9): Bad file descriptor 00:26:01.563 [2024-11-26 08:33:40.671238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.563 [2024-11-26 08:33:40.743303] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:01.563 00:26:01.563 Latency(us) 00:26:01.563 [2024-11-26T07:33:47.423Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:01.563 [2024-11-26T07:33:47.423Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:01.563 Verification LBA range: start 0x0 length 0x4000 00:26:01.563 NVMe0n1 : 15.01 12842.23 50.16 495.06 0.00 9580.47 564.34 17282.09 00:26:01.563 [2024-11-26T07:33:47.423Z] =================================================================================================================== 00:26:01.563 [2024-11-26T07:33:47.423Z] Total : 12842.23 50.16 495.06 0.00 9580.47 564.34 17282.09 00:26:01.563 Received shutdown signal, test time was about 15.000000 seconds 00:26:01.563 00:26:01.563 Latency(us) 00:26:01.563 [2024-11-26T07:33:47.423Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:01.563 [2024-11-26T07:33:47.423Z] =================================================================================================================== 00:26:01.563 [2024-11-26T07:33:47.423Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:01.563 08:33:46 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:26:01.563 08:33:46 -- host/failover.sh@65 -- # count=3 00:26:01.563 08:33:46 -- host/failover.sh@67 -- # (( count != 3 )) 00:26:01.563 08:33:46 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:26:01.563 08:33:46 -- host/failover.sh@73 -- # bdevperf_pid=1061508 00:26:01.563 08:33:46 -- host/failover.sh@75 -- # waitforlisten 1061508 /var/tmp/bdevperf.sock 00:26:01.563 08:33:46 -- common/autotest_common.sh@829 -- # '[' -z 1061508 ']' 00:26:01.563 08:33:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:01.563 08:33:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:01.563 08:33:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:01.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:01.563 08:33:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:01.563 08:33:46 -- common/autotest_common.sh@10 -- # set +x 00:26:01.821 08:33:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:01.821 08:33:47 -- common/autotest_common.sh@862 -- # return 0 00:26:01.821 08:33:47 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:02.079 [2024-11-26 08:33:47.852833] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:02.079 08:33:47 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:02.337 [2024-11-26 08:33:48.097477] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:02.337 08:33:48 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:02.595 NVMe0n1 00:26:02.595 08:33:48 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.160 00:26:03.160 08:33:48 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.417 00:26:03.417 08:33:49 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.417 08:33:49 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:03.746 08:33:49 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.033 08:33:49 -- host/failover.sh@87 -- # sleep 3 00:26:07.319 08:33:52 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.319 08:33:52 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:07.319 08:33:52 -- host/failover.sh@90 -- # run_test_pid=1062218 00:26:07.319 08:33:52 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:07.319 08:33:52 -- host/failover.sh@92 -- # wait 1062218 00:26:08.257 0 00:26:08.257 08:33:53 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.257 [2024-11-26 08:33:46.661795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:08.257 [2024-11-26 08:33:46.661877] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1061508 ] 00:26:08.257 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.257 [2024-11-26 08:33:46.723586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:08.257 [2024-11-26 08:33:46.829446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:08.257 [2024-11-26 08:33:49.548454] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:08.257 [2024-11-26 08:33:49.548543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.257 [2024-11-26 08:33:49.548567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.257 [2024-11-26 08:33:49.548584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.257 [2024-11-26 08:33:49.548598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.257 [2024-11-26 08:33:49.548612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.257 [2024-11-26 08:33:49.548625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.257 [2024-11-26 08:33:49.548650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.257 [2024-11-26 08:33:49.548664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.257 [2024-11-26 08:33:49.548678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:08.257 [2024-11-26 08:33:49.548723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:08.257 [2024-11-26 08:33:49.548755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcdb870 (9): Bad file descriptor 00:26:08.257 [2024-11-26 08:33:49.555305] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:08.257 Running I/O for 1 seconds... 00:26:08.257 00:26:08.257 Latency(us) 00:26:08.257 [2024-11-26T07:33:54.117Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:08.257 [2024-11-26T07:33:54.117Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:08.257 Verification LBA range: start 0x0 length 0x4000 00:26:08.257 NVMe0n1 : 1.01 12923.91 50.48 0.00 0.00 9859.48 1159.02 14272.28 00:26:08.257 [2024-11-26T07:33:54.117Z] =================================================================================================================== 00:26:08.257 [2024-11-26T07:33:54.117Z] Total : 12923.91 50.48 0.00 0.00 9859.48 1159.02 14272.28 00:26:08.257 08:33:53 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:08.257 08:33:53 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:08.516 08:33:54 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:08.775 08:33:54 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:08.775 08:33:54 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:09.033 08:33:54 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:09.291 08:33:54 -- host/failover.sh@101 -- # sleep 3 00:26:12.581 08:33:57 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:12.581 08:33:57 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:12.581 08:33:58 -- host/failover.sh@108 -- # killprocess 1061508 00:26:12.581 08:33:58 -- common/autotest_common.sh@936 -- # '[' -z 1061508 ']' 00:26:12.581 08:33:58 -- common/autotest_common.sh@940 -- # kill -0 1061508 00:26:12.581 08:33:58 -- common/autotest_common.sh@941 -- # uname 00:26:12.581 08:33:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.581 08:33:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1061508 00:26:12.581 08:33:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:12.581 08:33:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:12.581 08:33:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1061508' 00:26:12.581 killing process with pid 1061508 00:26:12.581 08:33:58 -- common/autotest_common.sh@955 -- # kill 1061508 00:26:12.581 08:33:58 -- common/autotest_common.sh@960 -- # wait 1061508 00:26:12.839 08:33:58 -- host/failover.sh@110 -- # sync 00:26:12.839 08:33:58 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:13.097 08:33:58 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:13.097 08:33:58 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:13.097 08:33:58 -- host/failover.sh@116 -- # nvmftestfini 00:26:13.097 08:33:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:13.097 08:33:58 -- nvmf/common.sh@116 -- # sync 00:26:13.097 08:33:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:13.097 08:33:58 -- nvmf/common.sh@119 -- # set +e 00:26:13.097 08:33:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:13.097 08:33:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:13.097 rmmod nvme_tcp 00:26:13.097 rmmod nvme_fabrics 00:26:13.097 rmmod nvme_keyring 00:26:13.097 08:33:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:13.097 08:33:58 -- nvmf/common.sh@123 -- # set -e 00:26:13.097 08:33:58 -- nvmf/common.sh@124 -- # return 0 00:26:13.097 08:33:58 -- nvmf/common.sh@477 -- # '[' -n 1059037 ']' 00:26:13.097 08:33:58 -- nvmf/common.sh@478 -- # killprocess 1059037 00:26:13.097 08:33:58 -- common/autotest_common.sh@936 -- # '[' -z 1059037 ']' 00:26:13.097 08:33:58 -- common/autotest_common.sh@940 -- # kill -0 1059037 00:26:13.097 08:33:58 -- common/autotest_common.sh@941 -- # uname 00:26:13.097 08:33:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:13.097 08:33:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1059037 00:26:13.097 08:33:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:13.097 08:33:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:13.097 08:33:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1059037' 00:26:13.097 killing process with pid 1059037 00:26:13.097 08:33:58 -- common/autotest_common.sh@955 -- # kill 1059037 00:26:13.097 08:33:58 -- common/autotest_common.sh@960 -- # wait 1059037 00:26:13.680 08:33:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:13.680 08:33:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:13.680 08:33:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:13.680 08:33:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:13.680 08:33:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:13.680 08:33:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:13.680 08:33:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:13.680 08:33:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.583 08:34:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:15.583 00:26:15.583 real 0m37.145s 00:26:15.583 user 2m9.538s 00:26:15.583 sys 0m6.910s 00:26:15.583 08:34:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:15.583 08:34:01 -- common/autotest_common.sh@10 -- # set +x 00:26:15.583 ************************************ 00:26:15.583 END TEST nvmf_failover 00:26:15.583 ************************************ 00:26:15.583 08:34:01 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:15.583 08:34:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:15.583 08:34:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:15.583 08:34:01 -- common/autotest_common.sh@10 -- # set +x 00:26:15.583 ************************************ 00:26:15.583 START TEST nvmf_discovery 00:26:15.583 ************************************ 00:26:15.583 08:34:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:15.583 * Looking for test storage... 00:26:15.583 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:15.583 08:34:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:15.583 08:34:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:15.583 08:34:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:15.583 08:34:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:15.583 08:34:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:15.583 08:34:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:15.583 08:34:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:15.583 08:34:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:15.583 08:34:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:15.583 08:34:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:15.583 08:34:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:15.583 08:34:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:15.583 08:34:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:15.583 08:34:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:15.583 08:34:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:15.583 08:34:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:15.583 08:34:01 -- scripts/common.sh@344 -- # : 1 00:26:15.583 08:34:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:15.583 08:34:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:15.583 08:34:01 -- scripts/common.sh@364 -- # decimal 1 00:26:15.583 08:34:01 -- scripts/common.sh@352 -- # local d=1 00:26:15.583 08:34:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:15.583 08:34:01 -- scripts/common.sh@354 -- # echo 1 00:26:15.583 08:34:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:15.583 08:34:01 -- scripts/common.sh@365 -- # decimal 2 00:26:15.583 08:34:01 -- scripts/common.sh@352 -- # local d=2 00:26:15.583 08:34:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:15.583 08:34:01 -- scripts/common.sh@354 -- # echo 2 00:26:15.583 08:34:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:15.583 08:34:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:15.583 08:34:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:15.583 08:34:01 -- scripts/common.sh@367 -- # return 0 00:26:15.583 08:34:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:15.583 08:34:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:15.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.584 --rc genhtml_branch_coverage=1 00:26:15.584 --rc genhtml_function_coverage=1 00:26:15.584 --rc genhtml_legend=1 00:26:15.584 --rc geninfo_all_blocks=1 00:26:15.584 --rc geninfo_unexecuted_blocks=1 00:26:15.584 00:26:15.584 ' 00:26:15.584 08:34:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:15.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.584 --rc genhtml_branch_coverage=1 00:26:15.584 --rc genhtml_function_coverage=1 00:26:15.584 --rc genhtml_legend=1 00:26:15.584 --rc geninfo_all_blocks=1 00:26:15.584 --rc geninfo_unexecuted_blocks=1 00:26:15.584 00:26:15.584 ' 00:26:15.584 08:34:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:15.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.584 --rc genhtml_branch_coverage=1 00:26:15.584 --rc genhtml_function_coverage=1 00:26:15.584 --rc genhtml_legend=1 00:26:15.584 --rc geninfo_all_blocks=1 00:26:15.584 --rc geninfo_unexecuted_blocks=1 00:26:15.584 00:26:15.584 ' 00:26:15.584 08:34:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:15.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.584 --rc genhtml_branch_coverage=1 00:26:15.584 --rc genhtml_function_coverage=1 00:26:15.584 --rc genhtml_legend=1 00:26:15.584 --rc geninfo_all_blocks=1 00:26:15.584 --rc geninfo_unexecuted_blocks=1 00:26:15.584 00:26:15.584 ' 00:26:15.584 08:34:01 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:15.584 08:34:01 -- nvmf/common.sh@7 -- # uname -s 00:26:15.584 08:34:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:15.584 08:34:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:15.584 08:34:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:15.584 08:34:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:15.584 08:34:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:15.584 08:34:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:15.584 08:34:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:15.584 08:34:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:15.584 08:34:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:15.584 08:34:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:15.842 08:34:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.842 08:34:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.842 08:34:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:15.842 08:34:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:15.842 08:34:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:15.842 08:34:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:15.842 08:34:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:15.842 08:34:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:15.842 08:34:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:15.843 08:34:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.843 08:34:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.843 08:34:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.843 08:34:01 -- paths/export.sh@5 -- # export PATH 00:26:15.843 08:34:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.843 08:34:01 -- nvmf/common.sh@46 -- # : 0 00:26:15.843 08:34:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:15.843 08:34:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:15.843 08:34:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:15.843 08:34:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:15.843 08:34:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:15.843 08:34:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:15.843 08:34:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:15.843 08:34:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:15.843 08:34:01 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:15.843 08:34:01 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:15.843 08:34:01 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:15.843 08:34:01 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:15.843 08:34:01 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:15.843 08:34:01 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:15.843 08:34:01 -- host/discovery.sh@25 -- # nvmftestinit 00:26:15.843 08:34:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:15.843 08:34:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:15.843 08:34:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:15.843 08:34:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:15.843 08:34:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:15.843 08:34:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.843 08:34:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.843 08:34:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.843 08:34:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:15.843 08:34:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:15.843 08:34:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:15.843 08:34:01 -- common/autotest_common.sh@10 -- # set +x 00:26:17.746 08:34:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:17.746 08:34:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:17.746 08:34:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:17.746 08:34:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:17.746 08:34:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:17.746 08:34:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:17.746 08:34:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:17.746 08:34:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:17.746 08:34:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:17.746 08:34:03 -- nvmf/common.sh@295 -- # e810=() 00:26:17.746 08:34:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:17.746 08:34:03 -- nvmf/common.sh@296 -- # x722=() 00:26:17.746 08:34:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:17.746 08:34:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:17.746 08:34:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:17.746 08:34:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:17.746 08:34:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.746 08:34:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:17.746 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:17.746 08:34:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.746 08:34:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:17.746 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:17.746 08:34:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.746 08:34:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.746 08:34:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.746 08:34:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:17.746 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:17.746 08:34:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.746 08:34:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.746 08:34:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.746 08:34:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:17.746 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:17.746 08:34:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:17.746 08:34:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:17.746 08:34:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:17.746 08:34:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:17.746 08:34:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:17.746 08:34:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:17.746 08:34:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:17.746 08:34:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:17.746 08:34:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:17.746 08:34:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:17.746 08:34:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:17.746 08:34:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:17.746 08:34:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:17.746 08:34:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:17.746 08:34:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:17.746 08:34:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:17.746 08:34:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:17.746 08:34:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:17.746 08:34:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:17.746 08:34:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:17.746 08:34:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:17.746 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:17.746 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:26:17.746 00:26:17.746 --- 10.0.0.2 ping statistics --- 00:26:17.746 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.746 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:26:17.746 08:34:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:17.746 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:17.746 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:26:17.746 00:26:17.746 --- 10.0.0.1 ping statistics --- 00:26:17.746 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.746 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:26:17.746 08:34:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:17.746 08:34:03 -- nvmf/common.sh@410 -- # return 0 00:26:17.746 08:34:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:17.746 08:34:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:17.746 08:34:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:17.746 08:34:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:17.747 08:34:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:17.747 08:34:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:17.747 08:34:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:18.006 08:34:03 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:18.006 08:34:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:18.006 08:34:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:18.006 08:34:03 -- common/autotest_common.sh@10 -- # set +x 00:26:18.006 08:34:03 -- nvmf/common.sh@469 -- # nvmfpid=1064975 00:26:18.006 08:34:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:18.006 08:34:03 -- nvmf/common.sh@470 -- # waitforlisten 1064975 00:26:18.006 08:34:03 -- common/autotest_common.sh@829 -- # '[' -z 1064975 ']' 00:26:18.006 08:34:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:18.006 08:34:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:18.006 08:34:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:18.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:18.006 08:34:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:18.006 08:34:03 -- common/autotest_common.sh@10 -- # set +x 00:26:18.006 [2024-11-26 08:34:03.650283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:18.006 [2024-11-26 08:34:03.650358] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:18.006 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.006 [2024-11-26 08:34:03.718680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:18.006 [2024-11-26 08:34:03.831139] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:18.006 [2024-11-26 08:34:03.831296] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:18.006 [2024-11-26 08:34:03.831328] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:18.006 [2024-11-26 08:34:03.831341] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:18.006 [2024-11-26 08:34:03.831369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:18.941 08:34:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:18.941 08:34:04 -- common/autotest_common.sh@862 -- # return 0 00:26:18.941 08:34:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:18.941 08:34:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.941 08:34:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:18.941 08:34:04 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:18.941 08:34:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.941 [2024-11-26 08:34:04.637552] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:18.941 08:34:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.941 08:34:04 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:18.941 08:34:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.941 [2024-11-26 08:34:04.645750] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:18.941 08:34:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.941 08:34:04 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:18.941 08:34:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.941 null0 00:26:18.941 08:34:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.941 08:34:04 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:18.941 08:34:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.941 null1 00:26:18.941 08:34:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.941 08:34:04 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:18.941 08:34:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.941 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.942 08:34:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.942 08:34:04 -- host/discovery.sh@45 -- # hostpid=1065132 00:26:18.942 08:34:04 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:18.942 08:34:04 -- host/discovery.sh@46 -- # waitforlisten 1065132 /tmp/host.sock 00:26:18.942 08:34:04 -- common/autotest_common.sh@829 -- # '[' -z 1065132 ']' 00:26:18.942 08:34:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:18.942 08:34:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:18.942 08:34:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:18.942 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:18.942 08:34:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:18.942 08:34:04 -- common/autotest_common.sh@10 -- # set +x 00:26:18.942 [2024-11-26 08:34:04.713642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:18.942 [2024-11-26 08:34:04.713732] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1065132 ] 00:26:18.942 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.942 [2024-11-26 08:34:04.774458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:19.200 [2024-11-26 08:34:04.887588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:19.200 [2024-11-26 08:34:04.887795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:20.135 08:34:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:20.135 08:34:05 -- common/autotest_common.sh@862 -- # return 0 00:26:20.135 08:34:05 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:20.135 08:34:05 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@72 -- # notify_id=0 00:26:20.135 08:34:05 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@79 -- # get_bdev_list 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@83 -- # get_bdev_list 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@87 -- # get_bdev_list 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@55 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:20.135 08:34:05 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 [2024-11-26 08:34:05.945342] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 08:34:05 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.135 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # sort 00:26:20.135 08:34:05 -- host/discovery.sh@59 -- # xargs 00:26:20.135 08:34:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.395 08:34:05 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:20.395 08:34:05 -- host/discovery.sh@93 -- # get_bdev_list 00:26:20.395 08:34:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.395 08:34:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.395 08:34:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.395 08:34:05 -- common/autotest_common.sh@10 -- # set +x 00:26:20.395 08:34:05 -- host/discovery.sh@55 -- # sort 00:26:20.395 08:34:05 -- host/discovery.sh@55 -- # xargs 00:26:20.395 08:34:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.395 08:34:06 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:20.395 08:34:06 -- host/discovery.sh@94 -- # get_notification_count 00:26:20.395 08:34:06 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:20.395 08:34:06 -- host/discovery.sh@74 -- # jq '. | length' 00:26:20.395 08:34:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.395 08:34:06 -- common/autotest_common.sh@10 -- # set +x 00:26:20.395 08:34:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.395 08:34:06 -- host/discovery.sh@74 -- # notification_count=0 00:26:20.395 08:34:06 -- host/discovery.sh@75 -- # notify_id=0 00:26:20.395 08:34:06 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:20.395 08:34:06 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:20.395 08:34:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.395 08:34:06 -- common/autotest_common.sh@10 -- # set +x 00:26:20.395 08:34:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.395 08:34:06 -- host/discovery.sh@100 -- # sleep 1 00:26:20.963 [2024-11-26 08:34:06.718471] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:20.963 [2024-11-26 08:34:06.718524] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:20.963 [2024-11-26 08:34:06.718558] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:21.223 [2024-11-26 08:34:06.847026] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:21.223 [2024-11-26 08:34:06.907877] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:21.223 [2024-11-26 08:34:06.907901] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:21.482 08:34:07 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:21.482 08:34:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.482 08:34:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.482 08:34:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.482 08:34:07 -- common/autotest_common.sh@10 -- # set +x 00:26:21.482 08:34:07 -- host/discovery.sh@59 -- # sort 00:26:21.482 08:34:07 -- host/discovery.sh@59 -- # xargs 00:26:21.482 08:34:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@102 -- # get_bdev_list 00:26:21.482 08:34:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.482 08:34:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.482 08:34:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.482 08:34:07 -- common/autotest_common.sh@10 -- # set +x 00:26:21.482 08:34:07 -- host/discovery.sh@55 -- # sort 00:26:21.482 08:34:07 -- host/discovery.sh@55 -- # xargs 00:26:21.482 08:34:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:21.482 08:34:07 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:21.482 08:34:07 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:21.482 08:34:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.482 08:34:07 -- common/autotest_common.sh@10 -- # set +x 00:26:21.482 08:34:07 -- host/discovery.sh@63 -- # sort -n 00:26:21.482 08:34:07 -- host/discovery.sh@63 -- # xargs 00:26:21.482 08:34:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:21.482 08:34:07 -- host/discovery.sh@104 -- # get_notification_count 00:26:21.482 08:34:07 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:21.482 08:34:07 -- host/discovery.sh@74 -- # jq '. | length' 00:26:21.482 08:34:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.482 08:34:07 -- common/autotest_common.sh@10 -- # set +x 00:26:21.483 08:34:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.483 08:34:07 -- host/discovery.sh@74 -- # notification_count=1 00:26:21.483 08:34:07 -- host/discovery.sh@75 -- # notify_id=1 00:26:21.483 08:34:07 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:21.483 08:34:07 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:21.483 08:34:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.483 08:34:07 -- common/autotest_common.sh@10 -- # set +x 00:26:21.483 08:34:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.483 08:34:07 -- host/discovery.sh@109 -- # sleep 1 00:26:22.419 08:34:08 -- host/discovery.sh@110 -- # get_bdev_list 00:26:22.419 08:34:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.419 08:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.419 08:34:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.419 08:34:08 -- common/autotest_common.sh@10 -- # set +x 00:26:22.419 08:34:08 -- host/discovery.sh@55 -- # sort 00:26:22.419 08:34:08 -- host/discovery.sh@55 -- # xargs 00:26:22.419 08:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.677 08:34:08 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.677 08:34:08 -- host/discovery.sh@111 -- # get_notification_count 00:26:22.677 08:34:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:22.677 08:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.677 08:34:08 -- host/discovery.sh@74 -- # jq '. | length' 00:26:22.677 08:34:08 -- common/autotest_common.sh@10 -- # set +x 00:26:22.677 08:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.677 08:34:08 -- host/discovery.sh@74 -- # notification_count=1 00:26:22.677 08:34:08 -- host/discovery.sh@75 -- # notify_id=2 00:26:22.677 08:34:08 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:22.677 08:34:08 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:22.677 08:34:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.677 08:34:08 -- common/autotest_common.sh@10 -- # set +x 00:26:22.677 [2024-11-26 08:34:08.324318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:22.677 [2024-11-26 08:34:08.324860] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:22.677 [2024-11-26 08:34:08.324897] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.677 08:34:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.677 08:34:08 -- host/discovery.sh@117 -- # sleep 1 00:26:22.677 [2024-11-26 08:34:08.452307] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:22.935 [2024-11-26 08:34:08.713565] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:22.935 [2024-11-26 08:34:08.713598] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:22.935 [2024-11-26 08:34:08.713609] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:23.502 08:34:09 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:23.502 08:34:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:23.502 08:34:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.502 08:34:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:23.502 08:34:09 -- host/discovery.sh@59 -- # sort 00:26:23.502 08:34:09 -- common/autotest_common.sh@10 -- # set +x 00:26:23.502 08:34:09 -- host/discovery.sh@59 -- # xargs 00:26:23.502 08:34:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@119 -- # get_bdev_list 00:26:23.762 08:34:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.762 08:34:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.762 08:34:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.762 08:34:09 -- common/autotest_common.sh@10 -- # set +x 00:26:23.762 08:34:09 -- host/discovery.sh@55 -- # sort 00:26:23.762 08:34:09 -- host/discovery.sh@55 -- # xargs 00:26:23.762 08:34:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:23.762 08:34:09 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:23.762 08:34:09 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:23.762 08:34:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.762 08:34:09 -- host/discovery.sh@63 -- # sort -n 00:26:23.762 08:34:09 -- common/autotest_common.sh@10 -- # set +x 00:26:23.762 08:34:09 -- host/discovery.sh@63 -- # xargs 00:26:23.762 08:34:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@121 -- # get_notification_count 00:26:23.762 08:34:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:23.762 08:34:09 -- host/discovery.sh@74 -- # jq '. | length' 00:26:23.762 08:34:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.762 08:34:09 -- common/autotest_common.sh@10 -- # set +x 00:26:23.762 08:34:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@74 -- # notification_count=0 00:26:23.762 08:34:09 -- host/discovery.sh@75 -- # notify_id=2 00:26:23.762 08:34:09 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:23.762 08:34:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.762 08:34:09 -- common/autotest_common.sh@10 -- # set +x 00:26:23.762 [2024-11-26 08:34:09.512218] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:23.762 [2024-11-26 08:34:09.512249] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:23.762 08:34:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.762 08:34:09 -- host/discovery.sh@127 -- # sleep 1 00:26:23.762 [2024-11-26 08:34:09.519824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.762 [2024-11-26 08:34:09.519855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.762 [2024-11-26 08:34:09.519872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.762 [2024-11-26 08:34:09.519900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.762 [2024-11-26 08:34:09.519915] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.762 [2024-11-26 08:34:09.519928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.762 [2024-11-26 08:34:09.519941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.762 [2024-11-26 08:34:09.519954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.762 [2024-11-26 08:34:09.519967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.762 [2024-11-26 08:34:09.529819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.762 [2024-11-26 08:34:09.539864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.762 [2024-11-26 08:34:09.540070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.540224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.540253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.762 [2024-11-26 08:34:09.540271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.762 [2024-11-26 08:34:09.540296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.762 [2024-11-26 08:34:09.540336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.762 [2024-11-26 08:34:09.540356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.762 [2024-11-26 08:34:09.540383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.762 [2024-11-26 08:34:09.540406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.762 [2024-11-26 08:34:09.549936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.762 [2024-11-26 08:34:09.550165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.550296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.550322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.762 [2024-11-26 08:34:09.550337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.762 [2024-11-26 08:34:09.550359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.762 [2024-11-26 08:34:09.550411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.762 [2024-11-26 08:34:09.550431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.762 [2024-11-26 08:34:09.550446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.762 [2024-11-26 08:34:09.550467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.762 [2024-11-26 08:34:09.560037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.762 [2024-11-26 08:34:09.560214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.560364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-11-26 08:34:09.560392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.763 [2024-11-26 08:34:09.560409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.763 [2024-11-26 08:34:09.560433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.763 [2024-11-26 08:34:09.560471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.763 [2024-11-26 08:34:09.560490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.763 [2024-11-26 08:34:09.560505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.763 [2024-11-26 08:34:09.560538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.763 [2024-11-26 08:34:09.570120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.763 [2024-11-26 08:34:09.570307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.570421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.570450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.763 [2024-11-26 08:34:09.570467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.763 [2024-11-26 08:34:09.570491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.763 [2024-11-26 08:34:09.570527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.763 [2024-11-26 08:34:09.570546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.763 [2024-11-26 08:34:09.570560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.763 [2024-11-26 08:34:09.570586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.763 [2024-11-26 08:34:09.580199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.763 [2024-11-26 08:34:09.580388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.580511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.580541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.763 [2024-11-26 08:34:09.580558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.763 [2024-11-26 08:34:09.580582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.763 [2024-11-26 08:34:09.580631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.763 [2024-11-26 08:34:09.580651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.763 [2024-11-26 08:34:09.580665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.763 [2024-11-26 08:34:09.580696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.763 [2024-11-26 08:34:09.590277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.763 [2024-11-26 08:34:09.590449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.590581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-11-26 08:34:09.590609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x162c810 with addr=10.0.0.2, port=4420 00:26:23.763 [2024-11-26 08:34:09.590626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x162c810 is same with the state(5) to be set 00:26:23.763 [2024-11-26 08:34:09.590650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162c810 (9): Bad file descriptor 00:26:23.763 [2024-11-26 08:34:09.590695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.763 [2024-11-26 08:34:09.590729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.763 [2024-11-26 08:34:09.590743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.763 [2024-11-26 08:34:09.590763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.763 [2024-11-26 08:34:09.598704] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:23.763 [2024-11-26 08:34:09.598749] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:24.699 08:34:10 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:24.699 08:34:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:24.699 08:34:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.699 08:34:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:24.699 08:34:10 -- common/autotest_common.sh@10 -- # set +x 00:26:24.699 08:34:10 -- host/discovery.sh@59 -- # sort 00:26:24.699 08:34:10 -- host/discovery.sh@59 -- # xargs 00:26:24.699 08:34:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@129 -- # get_bdev_list 00:26:24.958 08:34:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.958 08:34:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.958 08:34:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:24.958 08:34:10 -- common/autotest_common.sh@10 -- # set +x 00:26:24.958 08:34:10 -- host/discovery.sh@55 -- # sort 00:26:24.958 08:34:10 -- host/discovery.sh@55 -- # xargs 00:26:24.958 08:34:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:24.958 08:34:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:24.958 08:34:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.958 08:34:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:24.958 08:34:10 -- common/autotest_common.sh@10 -- # set +x 00:26:24.958 08:34:10 -- host/discovery.sh@63 -- # sort -n 00:26:24.958 08:34:10 -- host/discovery.sh@63 -- # xargs 00:26:24.958 08:34:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@131 -- # get_notification_count 00:26:24.958 08:34:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:24.958 08:34:10 -- host/discovery.sh@74 -- # jq '. | length' 00:26:24.958 08:34:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.958 08:34:10 -- common/autotest_common.sh@10 -- # set +x 00:26:24.958 08:34:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@74 -- # notification_count=0 00:26:24.958 08:34:10 -- host/discovery.sh@75 -- # notify_id=2 00:26:24.958 08:34:10 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:24.958 08:34:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.958 08:34:10 -- common/autotest_common.sh@10 -- # set +x 00:26:24.958 08:34:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.958 08:34:10 -- host/discovery.sh@135 -- # sleep 1 00:26:25.898 08:34:11 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:25.898 08:34:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:25.898 08:34:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:25.898 08:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.898 08:34:11 -- common/autotest_common.sh@10 -- # set +x 00:26:25.898 08:34:11 -- host/discovery.sh@59 -- # sort 00:26:25.898 08:34:11 -- host/discovery.sh@59 -- # xargs 00:26:25.898 08:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.898 08:34:11 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:25.898 08:34:11 -- host/discovery.sh@137 -- # get_bdev_list 00:26:25.898 08:34:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.898 08:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.898 08:34:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:25.898 08:34:11 -- common/autotest_common.sh@10 -- # set +x 00:26:25.898 08:34:11 -- host/discovery.sh@55 -- # sort 00:26:25.898 08:34:11 -- host/discovery.sh@55 -- # xargs 00:26:25.898 08:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.157 08:34:11 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:26.157 08:34:11 -- host/discovery.sh@138 -- # get_notification_count 00:26:26.157 08:34:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:26.157 08:34:11 -- host/discovery.sh@74 -- # jq '. | length' 00:26:26.157 08:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.157 08:34:11 -- common/autotest_common.sh@10 -- # set +x 00:26:26.157 08:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.157 08:34:11 -- host/discovery.sh@74 -- # notification_count=2 00:26:26.157 08:34:11 -- host/discovery.sh@75 -- # notify_id=4 00:26:26.157 08:34:11 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:26.157 08:34:11 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.157 08:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.157 08:34:11 -- common/autotest_common.sh@10 -- # set +x 00:26:27.092 [2024-11-26 08:34:12.883878] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:27.092 [2024-11-26 08:34:12.883921] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:27.092 [2024-11-26 08:34:12.883945] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:27.351 [2024-11-26 08:34:12.970236] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:27.351 [2024-11-26 08:34:13.037372] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:27.351 [2024-11-26 08:34:13.037433] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.351 08:34:13 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@650 -- # local es=0 00:26:27.351 08:34:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.351 08:34:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 request: 00:26:27.351 { 00:26:27.351 "name": "nvme", 00:26:27.351 "trtype": "tcp", 00:26:27.351 "traddr": "10.0.0.2", 00:26:27.351 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:27.351 "adrfam": "ipv4", 00:26:27.351 "trsvcid": "8009", 00:26:27.351 "wait_for_attach": true, 00:26:27.351 "method": "bdev_nvme_start_discovery", 00:26:27.351 "req_id": 1 00:26:27.351 } 00:26:27.351 Got JSON-RPC error response 00:26:27.351 response: 00:26:27.351 { 00:26:27.351 "code": -17, 00:26:27.351 "message": "File exists" 00:26:27.351 } 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:27.351 08:34:13 -- common/autotest_common.sh@653 -- # es=1 00:26:27.351 08:34:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:27.351 08:34:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:27.351 08:34:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:27.351 08:34:13 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # sort 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # xargs 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.351 08:34:13 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:27.351 08:34:13 -- host/discovery.sh@147 -- # get_bdev_list 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # sort 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # xargs 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.351 08:34:13 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:27.351 08:34:13 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@650 -- # local es=0 00:26:27.351 08:34:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:27.351 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.351 08:34:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 request: 00:26:27.351 { 00:26:27.351 "name": "nvme_second", 00:26:27.351 "trtype": "tcp", 00:26:27.351 "traddr": "10.0.0.2", 00:26:27.351 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:27.351 "adrfam": "ipv4", 00:26:27.351 "trsvcid": "8009", 00:26:27.351 "wait_for_attach": true, 00:26:27.351 "method": "bdev_nvme_start_discovery", 00:26:27.351 "req_id": 1 00:26:27.351 } 00:26:27.351 Got JSON-RPC error response 00:26:27.351 response: 00:26:27.351 { 00:26:27.351 "code": -17, 00:26:27.351 "message": "File exists" 00:26:27.351 } 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:27.351 08:34:13 -- common/autotest_common.sh@653 -- # es=1 00:26:27.351 08:34:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:27.351 08:34:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:27.351 08:34:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:27.351 08:34:13 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # sort 00:26:27.351 08:34:13 -- host/discovery.sh@67 -- # xargs 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.351 08:34:13 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:27.351 08:34:13 -- host/discovery.sh@153 -- # get_bdev_list 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:27.351 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # sort 00:26:27.351 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:27.351 08:34:13 -- host/discovery.sh@55 -- # xargs 00:26:27.351 08:34:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.609 08:34:13 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:27.609 08:34:13 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:27.609 08:34:13 -- common/autotest_common.sh@650 -- # local es=0 00:26:27.609 08:34:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:27.609 08:34:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:27.609 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.609 08:34:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:27.609 08:34:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:27.609 08:34:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:27.609 08:34:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.609 08:34:13 -- common/autotest_common.sh@10 -- # set +x 00:26:28.544 [2024-11-26 08:34:14.236859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.544 [2024-11-26 08:34:14.237064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.544 [2024-11-26 08:34:14.237094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16503d0 with addr=10.0.0.2, port=8010 00:26:28.544 [2024-11-26 08:34:14.237120] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:28.544 [2024-11-26 08:34:14.237136] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:28.544 [2024-11-26 08:34:14.237149] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:29.479 [2024-11-26 08:34:15.239237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:29.479 [2024-11-26 08:34:15.239407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:29.479 [2024-11-26 08:34:15.239433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x161cd30 with addr=10.0.0.2, port=8010 00:26:29.479 [2024-11-26 08:34:15.239470] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:29.479 [2024-11-26 08:34:15.239485] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:29.479 [2024-11-26 08:34:15.239498] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:30.412 [2024-11-26 08:34:16.241494] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:30.412 request: 00:26:30.412 { 00:26:30.412 "name": "nvme_second", 00:26:30.412 "trtype": "tcp", 00:26:30.412 "traddr": "10.0.0.2", 00:26:30.412 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:30.412 "adrfam": "ipv4", 00:26:30.412 "trsvcid": "8010", 00:26:30.412 "attach_timeout_ms": 3000, 00:26:30.412 "method": "bdev_nvme_start_discovery", 00:26:30.412 "req_id": 1 00:26:30.412 } 00:26:30.412 Got JSON-RPC error response 00:26:30.412 response: 00:26:30.412 { 00:26:30.412 "code": -110, 00:26:30.412 "message": "Connection timed out" 00:26:30.412 } 00:26:30.412 08:34:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:30.412 08:34:16 -- common/autotest_common.sh@653 -- # es=1 00:26:30.412 08:34:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:30.412 08:34:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:30.412 08:34:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:30.412 08:34:16 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:30.412 08:34:16 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:30.412 08:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.412 08:34:16 -- common/autotest_common.sh@10 -- # set +x 00:26:30.412 08:34:16 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:30.412 08:34:16 -- host/discovery.sh@67 -- # sort 00:26:30.412 08:34:16 -- host/discovery.sh@67 -- # xargs 00:26:30.412 08:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.670 08:34:16 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:30.670 08:34:16 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:30.670 08:34:16 -- host/discovery.sh@162 -- # kill 1065132 00:26:30.670 08:34:16 -- host/discovery.sh@163 -- # nvmftestfini 00:26:30.670 08:34:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:30.670 08:34:16 -- nvmf/common.sh@116 -- # sync 00:26:30.670 08:34:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:30.670 08:34:16 -- nvmf/common.sh@119 -- # set +e 00:26:30.670 08:34:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:30.670 08:34:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:30.670 rmmod nvme_tcp 00:26:30.670 rmmod nvme_fabrics 00:26:30.670 rmmod nvme_keyring 00:26:30.670 08:34:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:30.670 08:34:16 -- nvmf/common.sh@123 -- # set -e 00:26:30.670 08:34:16 -- nvmf/common.sh@124 -- # return 0 00:26:30.670 08:34:16 -- nvmf/common.sh@477 -- # '[' -n 1064975 ']' 00:26:30.670 08:34:16 -- nvmf/common.sh@478 -- # killprocess 1064975 00:26:30.670 08:34:16 -- common/autotest_common.sh@936 -- # '[' -z 1064975 ']' 00:26:30.670 08:34:16 -- common/autotest_common.sh@940 -- # kill -0 1064975 00:26:30.670 08:34:16 -- common/autotest_common.sh@941 -- # uname 00:26:30.670 08:34:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:30.670 08:34:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1064975 00:26:30.670 08:34:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:30.670 08:34:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:30.670 08:34:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1064975' 00:26:30.670 killing process with pid 1064975 00:26:30.670 08:34:16 -- common/autotest_common.sh@955 -- # kill 1064975 00:26:30.670 08:34:16 -- common/autotest_common.sh@960 -- # wait 1064975 00:26:30.928 08:34:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:30.928 08:34:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:30.928 08:34:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:30.928 08:34:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:30.928 08:34:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:30.928 08:34:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:30.928 08:34:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:30.928 08:34:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:33.466 08:34:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:33.466 00:26:33.466 real 0m17.442s 00:26:33.466 user 0m26.885s 00:26:33.466 sys 0m2.949s 00:26:33.466 08:34:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:33.466 08:34:18 -- common/autotest_common.sh@10 -- # set +x 00:26:33.466 ************************************ 00:26:33.466 END TEST nvmf_discovery 00:26:33.466 ************************************ 00:26:33.466 08:34:18 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:33.466 08:34:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:33.466 08:34:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:33.466 08:34:18 -- common/autotest_common.sh@10 -- # set +x 00:26:33.466 ************************************ 00:26:33.466 START TEST nvmf_discovery_remove_ifc 00:26:33.466 ************************************ 00:26:33.466 08:34:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:33.466 * Looking for test storage... 00:26:33.466 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:33.467 08:34:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:33.467 08:34:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:33.467 08:34:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:33.467 08:34:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:33.467 08:34:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:33.467 08:34:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:33.467 08:34:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:33.467 08:34:18 -- scripts/common.sh@335 -- # IFS=.-: 00:26:33.467 08:34:18 -- scripts/common.sh@335 -- # read -ra ver1 00:26:33.467 08:34:18 -- scripts/common.sh@336 -- # IFS=.-: 00:26:33.467 08:34:18 -- scripts/common.sh@336 -- # read -ra ver2 00:26:33.467 08:34:18 -- scripts/common.sh@337 -- # local 'op=<' 00:26:33.467 08:34:18 -- scripts/common.sh@339 -- # ver1_l=2 00:26:33.467 08:34:18 -- scripts/common.sh@340 -- # ver2_l=1 00:26:33.467 08:34:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:33.467 08:34:18 -- scripts/common.sh@343 -- # case "$op" in 00:26:33.467 08:34:18 -- scripts/common.sh@344 -- # : 1 00:26:33.467 08:34:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:33.467 08:34:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:33.467 08:34:18 -- scripts/common.sh@364 -- # decimal 1 00:26:33.467 08:34:18 -- scripts/common.sh@352 -- # local d=1 00:26:33.467 08:34:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:33.467 08:34:18 -- scripts/common.sh@354 -- # echo 1 00:26:33.467 08:34:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:33.467 08:34:18 -- scripts/common.sh@365 -- # decimal 2 00:26:33.467 08:34:18 -- scripts/common.sh@352 -- # local d=2 00:26:33.467 08:34:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:33.467 08:34:18 -- scripts/common.sh@354 -- # echo 2 00:26:33.467 08:34:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:33.467 08:34:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:33.467 08:34:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:33.467 08:34:18 -- scripts/common.sh@367 -- # return 0 00:26:33.467 08:34:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:33.467 08:34:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:33.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:33.467 --rc genhtml_branch_coverage=1 00:26:33.467 --rc genhtml_function_coverage=1 00:26:33.467 --rc genhtml_legend=1 00:26:33.467 --rc geninfo_all_blocks=1 00:26:33.467 --rc geninfo_unexecuted_blocks=1 00:26:33.467 00:26:33.467 ' 00:26:33.467 08:34:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:33.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:33.467 --rc genhtml_branch_coverage=1 00:26:33.467 --rc genhtml_function_coverage=1 00:26:33.467 --rc genhtml_legend=1 00:26:33.467 --rc geninfo_all_blocks=1 00:26:33.467 --rc geninfo_unexecuted_blocks=1 00:26:33.467 00:26:33.467 ' 00:26:33.467 08:34:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:33.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:33.467 --rc genhtml_branch_coverage=1 00:26:33.467 --rc genhtml_function_coverage=1 00:26:33.467 --rc genhtml_legend=1 00:26:33.467 --rc geninfo_all_blocks=1 00:26:33.467 --rc geninfo_unexecuted_blocks=1 00:26:33.467 00:26:33.467 ' 00:26:33.467 08:34:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:33.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:33.467 --rc genhtml_branch_coverage=1 00:26:33.467 --rc genhtml_function_coverage=1 00:26:33.467 --rc genhtml_legend=1 00:26:33.467 --rc geninfo_all_blocks=1 00:26:33.467 --rc geninfo_unexecuted_blocks=1 00:26:33.467 00:26:33.467 ' 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:33.467 08:34:18 -- nvmf/common.sh@7 -- # uname -s 00:26:33.467 08:34:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:33.467 08:34:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:33.467 08:34:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:33.467 08:34:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:33.467 08:34:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:33.467 08:34:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:33.467 08:34:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:33.467 08:34:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:33.467 08:34:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:33.467 08:34:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:33.467 08:34:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:33.467 08:34:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:33.467 08:34:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:33.467 08:34:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:33.467 08:34:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:33.467 08:34:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:33.467 08:34:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:33.467 08:34:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:33.467 08:34:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:33.467 08:34:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.467 08:34:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.467 08:34:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.467 08:34:18 -- paths/export.sh@5 -- # export PATH 00:26:33.467 08:34:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.467 08:34:18 -- nvmf/common.sh@46 -- # : 0 00:26:33.467 08:34:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:33.467 08:34:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:33.467 08:34:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:33.467 08:34:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:33.467 08:34:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:33.467 08:34:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:33.467 08:34:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:33.467 08:34:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:33.467 08:34:18 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:33.467 08:34:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:33.467 08:34:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:33.467 08:34:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:33.467 08:34:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:33.467 08:34:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:33.467 08:34:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:33.467 08:34:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:33.467 08:34:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:33.467 08:34:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:33.467 08:34:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:33.467 08:34:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:33.467 08:34:18 -- common/autotest_common.sh@10 -- # set +x 00:26:35.395 08:34:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:35.395 08:34:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:35.395 08:34:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:35.395 08:34:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:35.395 08:34:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:35.395 08:34:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:35.395 08:34:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:35.395 08:34:20 -- nvmf/common.sh@294 -- # net_devs=() 00:26:35.395 08:34:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:35.395 08:34:20 -- nvmf/common.sh@295 -- # e810=() 00:26:35.395 08:34:20 -- nvmf/common.sh@295 -- # local -ga e810 00:26:35.395 08:34:20 -- nvmf/common.sh@296 -- # x722=() 00:26:35.395 08:34:20 -- nvmf/common.sh@296 -- # local -ga x722 00:26:35.395 08:34:20 -- nvmf/common.sh@297 -- # mlx=() 00:26:35.395 08:34:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:35.395 08:34:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:35.395 08:34:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:35.395 08:34:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:35.395 08:34:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:35.395 08:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:35.395 08:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:35.395 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:35.395 08:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:35.395 08:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:35.395 08:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:35.396 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:35.396 08:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:35.396 08:34:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:35.396 08:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:35.396 08:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:35.396 08:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:35.396 08:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:35.396 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:35.396 08:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:35.396 08:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:35.396 08:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:35.396 08:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:35.396 08:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:35.396 08:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:35.396 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:35.396 08:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:35.396 08:34:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:35.396 08:34:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:35.396 08:34:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:35.396 08:34:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:35.396 08:34:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:35.396 08:34:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:35.396 08:34:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:35.396 08:34:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:35.396 08:34:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:35.396 08:34:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:35.396 08:34:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:35.396 08:34:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:35.396 08:34:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:35.396 08:34:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:35.396 08:34:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:35.396 08:34:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:35.396 08:34:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:35.396 08:34:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:35.396 08:34:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:35.396 08:34:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:35.396 08:34:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:35.396 08:34:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:35.396 08:34:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:35.396 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:35.396 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.166 ms 00:26:35.396 00:26:35.396 --- 10.0.0.2 ping statistics --- 00:26:35.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:35.396 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:26:35.396 08:34:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:35.396 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:35.396 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:26:35.396 00:26:35.396 --- 10.0.0.1 ping statistics --- 00:26:35.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:35.396 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:26:35.396 08:34:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:35.396 08:34:20 -- nvmf/common.sh@410 -- # return 0 00:26:35.396 08:34:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:35.396 08:34:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:35.396 08:34:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:35.396 08:34:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:35.396 08:34:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:35.396 08:34:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:35.396 08:34:21 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:35.396 08:34:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:35.396 08:34:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:35.396 08:34:21 -- common/autotest_common.sh@10 -- # set +x 00:26:35.396 08:34:21 -- nvmf/common.sh@469 -- # nvmfpid=1068612 00:26:35.396 08:34:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:35.396 08:34:21 -- nvmf/common.sh@470 -- # waitforlisten 1068612 00:26:35.396 08:34:21 -- common/autotest_common.sh@829 -- # '[' -z 1068612 ']' 00:26:35.396 08:34:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:35.396 08:34:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:35.396 08:34:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:35.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:35.396 08:34:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:35.396 08:34:21 -- common/autotest_common.sh@10 -- # set +x 00:26:35.396 [2024-11-26 08:34:21.053530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:35.396 [2024-11-26 08:34:21.053612] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:35.396 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.396 [2024-11-26 08:34:21.123546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:35.396 [2024-11-26 08:34:21.239908] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:35.396 [2024-11-26 08:34:21.240051] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:35.396 [2024-11-26 08:34:21.240069] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:35.396 [2024-11-26 08:34:21.240082] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:35.396 [2024-11-26 08:34:21.240108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:36.329 08:34:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:36.329 08:34:22 -- common/autotest_common.sh@862 -- # return 0 00:26:36.329 08:34:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:36.329 08:34:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:36.329 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:36.329 08:34:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:36.329 08:34:22 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:36.329 08:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.329 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:36.329 [2024-11-26 08:34:22.063667] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:36.329 [2024-11-26 08:34:22.071858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:36.329 null0 00:26:36.329 [2024-11-26 08:34:22.103811] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:36.329 08:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.329 08:34:22 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1068764 00:26:36.329 08:34:22 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1068764 /tmp/host.sock 00:26:36.329 08:34:22 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:36.329 08:34:22 -- common/autotest_common.sh@829 -- # '[' -z 1068764 ']' 00:26:36.329 08:34:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:36.329 08:34:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:36.329 08:34:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:36.329 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:36.329 08:34:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:36.329 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:36.329 [2024-11-26 08:34:22.165785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:36.329 [2024-11-26 08:34:22.165855] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1068764 ] 00:26:36.587 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.587 [2024-11-26 08:34:22.228882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.587 [2024-11-26 08:34:22.343459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:36.587 [2024-11-26 08:34:22.343628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:36.587 08:34:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:36.587 08:34:22 -- common/autotest_common.sh@862 -- # return 0 00:26:36.587 08:34:22 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:36.587 08:34:22 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:36.587 08:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.588 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:36.588 08:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.588 08:34:22 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:36.588 08:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.588 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:36.846 08:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.846 08:34:22 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:36.846 08:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.846 08:34:22 -- common/autotest_common.sh@10 -- # set +x 00:26:37.780 [2024-11-26 08:34:23.551460] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:37.780 [2024-11-26 08:34:23.551496] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:37.780 [2024-11-26 08:34:23.551524] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:38.038 [2024-11-26 08:34:23.679923] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:38.296 [2024-11-26 08:34:23.904033] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:38.296 [2024-11-26 08:34:23.904092] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:38.296 [2024-11-26 08:34:23.904135] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:38.296 [2024-11-26 08:34:23.904162] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:38.296 [2024-11-26 08:34:23.904191] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:38.296 08:34:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.296 08:34:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.296 08:34:23 -- common/autotest_common.sh@10 -- # set +x 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.296 [2024-11-26 08:34:23.910097] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x188dd40 was disconnected and freed. delete nvme_qpair. 00:26:38.296 08:34:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:38.296 08:34:23 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.296 08:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.296 08:34:24 -- common/autotest_common.sh@10 -- # set +x 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.296 08:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.296 08:34:24 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.229 08:34:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.229 08:34:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.229 08:34:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.229 08:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.229 08:34:25 -- common/autotest_common.sh@10 -- # set +x 00:26:39.229 08:34:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.229 08:34:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.229 08:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.487 08:34:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:39.487 08:34:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:40.421 08:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.421 08:34:26 -- common/autotest_common.sh@10 -- # set +x 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:40.421 08:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:40.421 08:34:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.354 08:34:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.354 08:34:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.354 08:34:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.355 08:34:27 -- common/autotest_common.sh@10 -- # set +x 00:26:41.355 08:34:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.355 08:34:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.355 08:34:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.355 08:34:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.355 08:34:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:41.355 08:34:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.728 08:34:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.728 08:34:28 -- common/autotest_common.sh@10 -- # set +x 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.728 08:34:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.728 08:34:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.661 08:34:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.661 08:34:29 -- common/autotest_common.sh@10 -- # set +x 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.661 08:34:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:43.661 08:34:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:43.661 [2024-11-26 08:34:29.345747] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:43.661 [2024-11-26 08:34:29.345825] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:43.661 [2024-11-26 08:34:29.345848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:43.661 [2024-11-26 08:34:29.345875] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:43.661 [2024-11-26 08:34:29.345888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:43.661 [2024-11-26 08:34:29.345902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:43.661 [2024-11-26 08:34:29.345915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:43.661 [2024-11-26 08:34:29.345928] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:43.661 [2024-11-26 08:34:29.345940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:43.661 [2024-11-26 08:34:29.345953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:43.661 [2024-11-26 08:34:29.345966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:43.661 [2024-11-26 08:34:29.345978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1854430 is same with the state(5) to be set 00:26:43.661 [2024-11-26 08:34:29.355765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1854430 (9): Bad file descriptor 00:26:43.661 [2024-11-26 08:34:29.365814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:44.594 08:34:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:44.594 08:34:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:44.594 08:34:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:44.594 08:34:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:44.594 08:34:30 -- common/autotest_common.sh@10 -- # set +x 00:26:44.594 08:34:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:44.594 08:34:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:44.594 [2024-11-26 08:34:30.401780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:45.967 [2024-11-26 08:34:31.425748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:45.967 [2024-11-26 08:34:31.425803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1854430 with addr=10.0.0.2, port=4420 00:26:45.967 [2024-11-26 08:34:31.425835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1854430 is same with the state(5) to be set 00:26:45.967 [2024-11-26 08:34:31.425880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:45.967 [2024-11-26 08:34:31.425898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:45.967 [2024-11-26 08:34:31.425911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:45.967 [2024-11-26 08:34:31.425927] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:45.967 [2024-11-26 08:34:31.426424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1854430 (9): Bad file descriptor 00:26:45.967 [2024-11-26 08:34:31.426471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.967 [2024-11-26 08:34:31.426517] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:45.967 [2024-11-26 08:34:31.426558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.967 [2024-11-26 08:34:31.426583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.967 [2024-11-26 08:34:31.426604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.967 [2024-11-26 08:34:31.426627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.967 [2024-11-26 08:34:31.426644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.967 [2024-11-26 08:34:31.426658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.967 [2024-11-26 08:34:31.426673] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.967 [2024-11-26 08:34:31.426702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.967 [2024-11-26 08:34:31.426721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.967 [2024-11-26 08:34:31.426751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.968 [2024-11-26 08:34:31.426765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:45.968 [2024-11-26 08:34:31.426876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1854840 (9): Bad file descriptor 00:26:45.968 [2024-11-26 08:34:31.427899] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:45.968 [2024-11-26 08:34:31.427922] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:45.968 08:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.968 08:34:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:45.968 08:34:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.902 08:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.902 08:34:32 -- common/autotest_common.sh@10 -- # set +x 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.902 08:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.902 08:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.902 08:34:32 -- common/autotest_common.sh@10 -- # set +x 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.902 08:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:46.902 08:34:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:47.835 [2024-11-26 08:34:33.477870] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:47.835 [2024-11-26 08:34:33.477896] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:47.835 [2024-11-26 08:34:33.477920] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:47.835 [2024-11-26 08:34:33.564209] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:47.835 08:34:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:47.835 08:34:33 -- common/autotest_common.sh@10 -- # set +x 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:47.835 08:34:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:47.835 08:34:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:47.835 [2024-11-26 08:34:33.628034] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:47.835 [2024-11-26 08:34:33.628091] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:47.835 [2024-11-26 08:34:33.628127] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:47.835 [2024-11-26 08:34:33.628153] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:47.835 [2024-11-26 08:34:33.628168] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:47.835 [2024-11-26 08:34:33.636278] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1862ef0 was disconnected and freed. delete nvme_qpair. 00:26:48.766 08:34:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:48.766 08:34:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:48.766 08:34:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:48.766 08:34:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.766 08:34:34 -- common/autotest_common.sh@10 -- # set +x 00:26:48.766 08:34:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:48.766 08:34:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:49.023 08:34:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.023 08:34:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:49.023 08:34:34 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:49.023 08:34:34 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1068764 00:26:49.023 08:34:34 -- common/autotest_common.sh@936 -- # '[' -z 1068764 ']' 00:26:49.023 08:34:34 -- common/autotest_common.sh@940 -- # kill -0 1068764 00:26:49.023 08:34:34 -- common/autotest_common.sh@941 -- # uname 00:26:49.023 08:34:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.023 08:34:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068764 00:26:49.023 08:34:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:49.023 08:34:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:49.023 08:34:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068764' 00:26:49.023 killing process with pid 1068764 00:26:49.023 08:34:34 -- common/autotest_common.sh@955 -- # kill 1068764 00:26:49.023 08:34:34 -- common/autotest_common.sh@960 -- # wait 1068764 00:26:49.280 08:34:34 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:49.280 08:34:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:49.280 08:34:34 -- nvmf/common.sh@116 -- # sync 00:26:49.280 08:34:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:49.280 08:34:34 -- nvmf/common.sh@119 -- # set +e 00:26:49.280 08:34:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:49.280 08:34:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:49.280 rmmod nvme_tcp 00:26:49.280 rmmod nvme_fabrics 00:26:49.280 rmmod nvme_keyring 00:26:49.280 08:34:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:49.280 08:34:35 -- nvmf/common.sh@123 -- # set -e 00:26:49.280 08:34:35 -- nvmf/common.sh@124 -- # return 0 00:26:49.280 08:34:35 -- nvmf/common.sh@477 -- # '[' -n 1068612 ']' 00:26:49.280 08:34:35 -- nvmf/common.sh@478 -- # killprocess 1068612 00:26:49.280 08:34:35 -- common/autotest_common.sh@936 -- # '[' -z 1068612 ']' 00:26:49.280 08:34:35 -- common/autotest_common.sh@940 -- # kill -0 1068612 00:26:49.280 08:34:35 -- common/autotest_common.sh@941 -- # uname 00:26:49.280 08:34:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.280 08:34:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068612 00:26:49.280 08:34:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:49.280 08:34:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:49.280 08:34:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068612' 00:26:49.280 killing process with pid 1068612 00:26:49.280 08:34:35 -- common/autotest_common.sh@955 -- # kill 1068612 00:26:49.280 08:34:35 -- common/autotest_common.sh@960 -- # wait 1068612 00:26:49.537 08:34:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:49.537 08:34:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:49.537 08:34:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:49.537 08:34:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:49.537 08:34:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:49.537 08:34:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:49.537 08:34:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:49.537 08:34:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.072 08:34:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:52.072 00:26:52.072 real 0m18.611s 00:26:52.072 user 0m26.021s 00:26:52.072 sys 0m2.881s 00:26:52.072 08:34:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:52.072 08:34:37 -- common/autotest_common.sh@10 -- # set +x 00:26:52.072 ************************************ 00:26:52.072 END TEST nvmf_discovery_remove_ifc 00:26:52.072 ************************************ 00:26:52.072 08:34:37 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:52.072 08:34:37 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:52.072 08:34:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:52.072 08:34:37 -- common/autotest_common.sh@10 -- # set +x 00:26:52.072 ************************************ 00:26:52.072 START TEST nvmf_digest 00:26:52.072 ************************************ 00:26:52.072 08:34:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:52.072 * Looking for test storage... 00:26:52.072 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:52.072 08:34:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:52.072 08:34:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:52.072 08:34:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:52.072 08:34:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:52.072 08:34:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:52.072 08:34:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:52.072 08:34:37 -- scripts/common.sh@335 -- # IFS=.-: 00:26:52.072 08:34:37 -- scripts/common.sh@335 -- # read -ra ver1 00:26:52.072 08:34:37 -- scripts/common.sh@336 -- # IFS=.-: 00:26:52.072 08:34:37 -- scripts/common.sh@336 -- # read -ra ver2 00:26:52.072 08:34:37 -- scripts/common.sh@337 -- # local 'op=<' 00:26:52.072 08:34:37 -- scripts/common.sh@339 -- # ver1_l=2 00:26:52.072 08:34:37 -- scripts/common.sh@340 -- # ver2_l=1 00:26:52.072 08:34:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:52.072 08:34:37 -- scripts/common.sh@343 -- # case "$op" in 00:26:52.072 08:34:37 -- scripts/common.sh@344 -- # : 1 00:26:52.072 08:34:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:52.072 08:34:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:52.072 08:34:37 -- scripts/common.sh@364 -- # decimal 1 00:26:52.072 08:34:37 -- scripts/common.sh@352 -- # local d=1 00:26:52.072 08:34:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:52.072 08:34:37 -- scripts/common.sh@354 -- # echo 1 00:26:52.072 08:34:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:52.072 08:34:37 -- scripts/common.sh@365 -- # decimal 2 00:26:52.072 08:34:37 -- scripts/common.sh@352 -- # local d=2 00:26:52.072 08:34:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:52.072 08:34:37 -- scripts/common.sh@354 -- # echo 2 00:26:52.072 08:34:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:52.072 08:34:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:52.072 08:34:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:52.072 08:34:37 -- scripts/common.sh@367 -- # return 0 00:26:52.072 08:34:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:52.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.072 --rc genhtml_branch_coverage=1 00:26:52.072 --rc genhtml_function_coverage=1 00:26:52.072 --rc genhtml_legend=1 00:26:52.072 --rc geninfo_all_blocks=1 00:26:52.072 --rc geninfo_unexecuted_blocks=1 00:26:52.072 00:26:52.072 ' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:52.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.072 --rc genhtml_branch_coverage=1 00:26:52.072 --rc genhtml_function_coverage=1 00:26:52.072 --rc genhtml_legend=1 00:26:52.072 --rc geninfo_all_blocks=1 00:26:52.072 --rc geninfo_unexecuted_blocks=1 00:26:52.072 00:26:52.072 ' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:52.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.072 --rc genhtml_branch_coverage=1 00:26:52.072 --rc genhtml_function_coverage=1 00:26:52.072 --rc genhtml_legend=1 00:26:52.072 --rc geninfo_all_blocks=1 00:26:52.072 --rc geninfo_unexecuted_blocks=1 00:26:52.072 00:26:52.072 ' 00:26:52.072 08:34:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:52.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.072 --rc genhtml_branch_coverage=1 00:26:52.072 --rc genhtml_function_coverage=1 00:26:52.072 --rc genhtml_legend=1 00:26:52.072 --rc geninfo_all_blocks=1 00:26:52.072 --rc geninfo_unexecuted_blocks=1 00:26:52.072 00:26:52.072 ' 00:26:52.072 08:34:37 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:52.072 08:34:37 -- nvmf/common.sh@7 -- # uname -s 00:26:52.072 08:34:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:52.072 08:34:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:52.072 08:34:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:52.072 08:34:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:52.072 08:34:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:52.072 08:34:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:52.072 08:34:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:52.072 08:34:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:52.072 08:34:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:52.072 08:34:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:52.072 08:34:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.072 08:34:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.072 08:34:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:52.072 08:34:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:52.072 08:34:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:52.072 08:34:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:52.072 08:34:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:52.072 08:34:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:52.072 08:34:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:52.072 08:34:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.072 08:34:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.072 08:34:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.072 08:34:37 -- paths/export.sh@5 -- # export PATH 00:26:52.072 08:34:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.072 08:34:37 -- nvmf/common.sh@46 -- # : 0 00:26:52.072 08:34:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:52.072 08:34:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:52.072 08:34:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:52.072 08:34:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:52.072 08:34:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:52.072 08:34:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:52.072 08:34:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:52.072 08:34:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:52.072 08:34:37 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:52.072 08:34:37 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:52.072 08:34:37 -- host/digest.sh@16 -- # runtime=2 00:26:52.072 08:34:37 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:52.072 08:34:37 -- host/digest.sh@132 -- # nvmftestinit 00:26:52.072 08:34:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:52.072 08:34:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:52.072 08:34:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:52.072 08:34:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:52.072 08:34:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:52.072 08:34:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:52.073 08:34:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:52.073 08:34:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.073 08:34:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:52.073 08:34:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:52.073 08:34:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:52.073 08:34:37 -- common/autotest_common.sh@10 -- # set +x 00:26:53.973 08:34:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:53.973 08:34:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:53.973 08:34:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:53.973 08:34:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:53.973 08:34:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:53.973 08:34:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:53.973 08:34:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:53.973 08:34:39 -- nvmf/common.sh@294 -- # net_devs=() 00:26:53.973 08:34:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:53.973 08:34:39 -- nvmf/common.sh@295 -- # e810=() 00:26:53.973 08:34:39 -- nvmf/common.sh@295 -- # local -ga e810 00:26:53.973 08:34:39 -- nvmf/common.sh@296 -- # x722=() 00:26:53.973 08:34:39 -- nvmf/common.sh@296 -- # local -ga x722 00:26:53.973 08:34:39 -- nvmf/common.sh@297 -- # mlx=() 00:26:53.973 08:34:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:53.973 08:34:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:53.973 08:34:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:53.973 08:34:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:53.973 08:34:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:53.973 08:34:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:53.973 08:34:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:53.973 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:53.973 08:34:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:53.973 08:34:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:53.974 08:34:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:53.974 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:53.974 08:34:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:53.974 08:34:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:53.974 08:34:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.974 08:34:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:53.974 08:34:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.974 08:34:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:53.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:53.974 08:34:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.974 08:34:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:53.974 08:34:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.974 08:34:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:53.974 08:34:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.974 08:34:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:53.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:53.974 08:34:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.974 08:34:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:53.974 08:34:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:53.974 08:34:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:53.974 08:34:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:53.974 08:34:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:53.974 08:34:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:53.974 08:34:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:53.974 08:34:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:53.974 08:34:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:53.974 08:34:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:53.974 08:34:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:53.974 08:34:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:53.974 08:34:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:53.974 08:34:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:53.974 08:34:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:53.974 08:34:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:53.974 08:34:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:53.974 08:34:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:53.974 08:34:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:53.974 08:34:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:53.974 08:34:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:53.974 08:34:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:53.974 08:34:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:53.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:53.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:26:53.974 00:26:53.974 --- 10.0.0.2 ping statistics --- 00:26:53.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:53.974 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:26:53.974 08:34:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:53.974 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:53.974 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:26:53.974 00:26:53.974 --- 10.0.0.1 ping statistics --- 00:26:53.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:53.974 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:26:53.974 08:34:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:53.974 08:34:39 -- nvmf/common.sh@410 -- # return 0 00:26:53.974 08:34:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:53.974 08:34:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:53.974 08:34:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:53.974 08:34:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:53.974 08:34:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:53.974 08:34:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:53.974 08:34:39 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:53.974 08:34:39 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:53.974 08:34:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:53.974 08:34:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:53.974 08:34:39 -- common/autotest_common.sh@10 -- # set +x 00:26:53.974 ************************************ 00:26:53.974 START TEST nvmf_digest_clean 00:26:53.974 ************************************ 00:26:53.974 08:34:39 -- common/autotest_common.sh@1114 -- # run_digest 00:26:53.974 08:34:39 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:53.974 08:34:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:53.974 08:34:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:53.974 08:34:39 -- common/autotest_common.sh@10 -- # set +x 00:26:53.974 08:34:39 -- nvmf/common.sh@469 -- # nvmfpid=1072419 00:26:53.974 08:34:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:53.974 08:34:39 -- nvmf/common.sh@470 -- # waitforlisten 1072419 00:26:53.974 08:34:39 -- common/autotest_common.sh@829 -- # '[' -z 1072419 ']' 00:26:53.974 08:34:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:53.974 08:34:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:53.974 08:34:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:53.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:53.974 08:34:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:53.974 08:34:39 -- common/autotest_common.sh@10 -- # set +x 00:26:54.233 [2024-11-26 08:34:39.842982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:54.233 [2024-11-26 08:34:39.843051] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:54.233 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.233 [2024-11-26 08:34:39.909588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:54.233 [2024-11-26 08:34:40.032872] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:54.233 [2024-11-26 08:34:40.033046] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:54.233 [2024-11-26 08:34:40.033064] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:54.233 [2024-11-26 08:34:40.033077] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:54.233 [2024-11-26 08:34:40.033106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:54.233 08:34:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:54.233 08:34:40 -- common/autotest_common.sh@862 -- # return 0 00:26:54.233 08:34:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:54.233 08:34:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:54.233 08:34:40 -- common/autotest_common.sh@10 -- # set +x 00:26:54.233 08:34:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:54.233 08:34:40 -- host/digest.sh@120 -- # common_target_config 00:26:54.233 08:34:40 -- host/digest.sh@43 -- # rpc_cmd 00:26:54.233 08:34:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:54.233 08:34:40 -- common/autotest_common.sh@10 -- # set +x 00:26:54.492 null0 00:26:54.492 [2024-11-26 08:34:40.206172] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:54.492 [2024-11-26 08:34:40.230443] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:54.492 08:34:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:54.492 08:34:40 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:54.492 08:34:40 -- host/digest.sh@77 -- # local rw bs qd 00:26:54.492 08:34:40 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:54.492 08:34:40 -- host/digest.sh@80 -- # rw=randread 00:26:54.492 08:34:40 -- host/digest.sh@80 -- # bs=4096 00:26:54.492 08:34:40 -- host/digest.sh@80 -- # qd=128 00:26:54.492 08:34:40 -- host/digest.sh@82 -- # bperfpid=1072439 00:26:54.492 08:34:40 -- host/digest.sh@83 -- # waitforlisten 1072439 /var/tmp/bperf.sock 00:26:54.492 08:34:40 -- common/autotest_common.sh@829 -- # '[' -z 1072439 ']' 00:26:54.492 08:34:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:54.492 08:34:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:54.493 08:34:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:54.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:54.493 08:34:40 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:54.493 08:34:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:54.493 08:34:40 -- common/autotest_common.sh@10 -- # set +x 00:26:54.493 [2024-11-26 08:34:40.274716] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:54.493 [2024-11-26 08:34:40.274783] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1072439 ] 00:26:54.493 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.493 [2024-11-26 08:34:40.335696] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:54.751 [2024-11-26 08:34:40.453599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:54.751 08:34:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:54.751 08:34:40 -- common/autotest_common.sh@862 -- # return 0 00:26:54.751 08:34:40 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:54.751 08:34:40 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:54.751 08:34:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:55.009 08:34:40 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:55.009 08:34:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:55.575 nvme0n1 00:26:55.575 08:34:41 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:55.575 08:34:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:55.575 Running I/O for 2 seconds... 00:26:58.107 00:26:58.107 Latency(us) 00:26:58.107 [2024-11-26T07:34:43.967Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:58.107 [2024-11-26T07:34:43.967Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:58.107 nvme0n1 : 2.00 15625.69 61.04 0.00 0.00 8184.99 3422.44 19029.71 00:26:58.107 [2024-11-26T07:34:43.967Z] =================================================================================================================== 00:26:58.107 [2024-11-26T07:34:43.967Z] Total : 15625.69 61.04 0.00 0.00 8184.99 3422.44 19029.71 00:26:58.107 0 00:26:58.107 08:34:43 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:58.107 08:34:43 -- host/digest.sh@92 -- # get_accel_stats 00:26:58.107 08:34:43 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:58.107 08:34:43 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:58.107 | select(.opcode=="crc32c") 00:26:58.107 | "\(.module_name) \(.executed)"' 00:26:58.107 08:34:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:58.107 08:34:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:58.107 08:34:43 -- host/digest.sh@93 -- # exp_module=software 00:26:58.107 08:34:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:58.107 08:34:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:58.107 08:34:43 -- host/digest.sh@97 -- # killprocess 1072439 00:26:58.107 08:34:43 -- common/autotest_common.sh@936 -- # '[' -z 1072439 ']' 00:26:58.107 08:34:43 -- common/autotest_common.sh@940 -- # kill -0 1072439 00:26:58.107 08:34:43 -- common/autotest_common.sh@941 -- # uname 00:26:58.107 08:34:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:58.107 08:34:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1072439 00:26:58.107 08:34:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:58.107 08:34:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:58.107 08:34:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1072439' 00:26:58.107 killing process with pid 1072439 00:26:58.107 08:34:43 -- common/autotest_common.sh@955 -- # kill 1072439 00:26:58.107 Received shutdown signal, test time was about 2.000000 seconds 00:26:58.107 00:26:58.107 Latency(us) 00:26:58.107 [2024-11-26T07:34:43.967Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:58.107 [2024-11-26T07:34:43.967Z] =================================================================================================================== 00:26:58.107 [2024-11-26T07:34:43.967Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:58.107 08:34:43 -- common/autotest_common.sh@960 -- # wait 1072439 00:26:58.107 08:34:43 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:58.107 08:34:43 -- host/digest.sh@77 -- # local rw bs qd 00:26:58.107 08:34:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:58.107 08:34:43 -- host/digest.sh@80 -- # rw=randread 00:26:58.107 08:34:43 -- host/digest.sh@80 -- # bs=131072 00:26:58.107 08:34:43 -- host/digest.sh@80 -- # qd=16 00:26:58.107 08:34:43 -- host/digest.sh@82 -- # bperfpid=1072930 00:26:58.107 08:34:43 -- host/digest.sh@83 -- # waitforlisten 1072930 /var/tmp/bperf.sock 00:26:58.107 08:34:43 -- common/autotest_common.sh@829 -- # '[' -z 1072930 ']' 00:26:58.107 08:34:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:58.107 08:34:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:58.107 08:34:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:58.107 08:34:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:58.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:58.107 08:34:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:58.107 08:34:43 -- common/autotest_common.sh@10 -- # set +x 00:26:58.365 [2024-11-26 08:34:43.979694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:58.365 [2024-11-26 08:34:43.979795] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1072930 ] 00:26:58.365 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:58.365 Zero copy mechanism will not be used. 00:26:58.365 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.365 [2024-11-26 08:34:44.039953] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:58.365 [2024-11-26 08:34:44.148532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.365 08:34:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.365 08:34:44 -- common/autotest_common.sh@862 -- # return 0 00:26:58.365 08:34:44 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:58.365 08:34:44 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:58.365 08:34:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:58.932 08:34:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.932 08:34:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:59.189 nvme0n1 00:26:59.190 08:34:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:59.190 08:34:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:59.448 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:59.448 Zero copy mechanism will not be used. 00:26:59.448 Running I/O for 2 seconds... 00:27:01.347 00:27:01.347 Latency(us) 00:27:01.347 [2024-11-26T07:34:47.207Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.347 [2024-11-26T07:34:47.207Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:01.347 nvme0n1 : 2.00 3919.43 489.93 0.00 0.00 4077.84 1013.38 9806.13 00:27:01.347 [2024-11-26T07:34:47.207Z] =================================================================================================================== 00:27:01.347 [2024-11-26T07:34:47.208Z] Total : 3919.43 489.93 0.00 0.00 4077.84 1013.38 9806.13 00:27:01.348 0 00:27:01.348 08:34:47 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:01.348 08:34:47 -- host/digest.sh@92 -- # get_accel_stats 00:27:01.348 08:34:47 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:01.348 08:34:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:01.348 08:34:47 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:01.348 | select(.opcode=="crc32c") 00:27:01.348 | "\(.module_name) \(.executed)"' 00:27:01.606 08:34:47 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:01.606 08:34:47 -- host/digest.sh@93 -- # exp_module=software 00:27:01.606 08:34:47 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:01.606 08:34:47 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:01.606 08:34:47 -- host/digest.sh@97 -- # killprocess 1072930 00:27:01.606 08:34:47 -- common/autotest_common.sh@936 -- # '[' -z 1072930 ']' 00:27:01.606 08:34:47 -- common/autotest_common.sh@940 -- # kill -0 1072930 00:27:01.606 08:34:47 -- common/autotest_common.sh@941 -- # uname 00:27:01.606 08:34:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.606 08:34:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1072930 00:27:01.865 08:34:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.865 08:34:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.865 08:34:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1072930' 00:27:01.865 killing process with pid 1072930 00:27:01.865 08:34:47 -- common/autotest_common.sh@955 -- # kill 1072930 00:27:01.865 Received shutdown signal, test time was about 2.000000 seconds 00:27:01.865 00:27:01.865 Latency(us) 00:27:01.865 [2024-11-26T07:34:47.725Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.865 [2024-11-26T07:34:47.725Z] =================================================================================================================== 00:27:01.865 [2024-11-26T07:34:47.725Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.865 08:34:47 -- common/autotest_common.sh@960 -- # wait 1072930 00:27:02.123 08:34:47 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:02.123 08:34:47 -- host/digest.sh@77 -- # local rw bs qd 00:27:02.123 08:34:47 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:02.123 08:34:47 -- host/digest.sh@80 -- # rw=randwrite 00:27:02.123 08:34:47 -- host/digest.sh@80 -- # bs=4096 00:27:02.123 08:34:47 -- host/digest.sh@80 -- # qd=128 00:27:02.123 08:34:47 -- host/digest.sh@82 -- # bperfpid=1073408 00:27:02.123 08:34:47 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:02.123 08:34:47 -- host/digest.sh@83 -- # waitforlisten 1073408 /var/tmp/bperf.sock 00:27:02.123 08:34:47 -- common/autotest_common.sh@829 -- # '[' -z 1073408 ']' 00:27:02.123 08:34:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:02.123 08:34:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:02.123 08:34:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:02.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:02.124 08:34:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:02.124 08:34:47 -- common/autotest_common.sh@10 -- # set +x 00:27:02.124 [2024-11-26 08:34:47.770815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.124 [2024-11-26 08:34:47.770886] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1073408 ] 00:27:02.124 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.124 [2024-11-26 08:34:47.830897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.124 [2024-11-26 08:34:47.942569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:02.382 08:34:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:02.382 08:34:47 -- common/autotest_common.sh@862 -- # return 0 00:27:02.382 08:34:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:02.382 08:34:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:02.382 08:34:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:02.669 08:34:48 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.669 08:34:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.951 nvme0n1 00:27:03.209 08:34:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:03.209 08:34:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:03.209 Running I/O for 2 seconds... 00:27:05.109 00:27:05.109 Latency(us) 00:27:05.109 [2024-11-26T07:34:50.969Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.109 [2024-11-26T07:34:50.969Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:05.109 nvme0n1 : 2.00 20945.19 81.82 0.00 0.00 6103.72 2985.53 11747.93 00:27:05.109 [2024-11-26T07:34:50.969Z] =================================================================================================================== 00:27:05.109 [2024-11-26T07:34:50.969Z] Total : 20945.19 81.82 0.00 0.00 6103.72 2985.53 11747.93 00:27:05.109 0 00:27:05.109 08:34:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:05.109 08:34:50 -- host/digest.sh@92 -- # get_accel_stats 00:27:05.109 08:34:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:05.109 08:34:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:05.109 08:34:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:05.109 | select(.opcode=="crc32c") 00:27:05.109 | "\(.module_name) \(.executed)"' 00:27:05.367 08:34:51 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:05.367 08:34:51 -- host/digest.sh@93 -- # exp_module=software 00:27:05.367 08:34:51 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:05.367 08:34:51 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:05.367 08:34:51 -- host/digest.sh@97 -- # killprocess 1073408 00:27:05.367 08:34:51 -- common/autotest_common.sh@936 -- # '[' -z 1073408 ']' 00:27:05.367 08:34:51 -- common/autotest_common.sh@940 -- # kill -0 1073408 00:27:05.367 08:34:51 -- common/autotest_common.sh@941 -- # uname 00:27:05.367 08:34:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:05.367 08:34:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1073408 00:27:05.625 08:34:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:05.625 08:34:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:05.625 08:34:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1073408' 00:27:05.625 killing process with pid 1073408 00:27:05.625 08:34:51 -- common/autotest_common.sh@955 -- # kill 1073408 00:27:05.625 Received shutdown signal, test time was about 2.000000 seconds 00:27:05.625 00:27:05.625 Latency(us) 00:27:05.625 [2024-11-26T07:34:51.485Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.625 [2024-11-26T07:34:51.485Z] =================================================================================================================== 00:27:05.625 [2024-11-26T07:34:51.485Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:05.625 08:34:51 -- common/autotest_common.sh@960 -- # wait 1073408 00:27:05.884 08:34:51 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:05.884 08:34:51 -- host/digest.sh@77 -- # local rw bs qd 00:27:05.884 08:34:51 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:05.884 08:34:51 -- host/digest.sh@80 -- # rw=randwrite 00:27:05.884 08:34:51 -- host/digest.sh@80 -- # bs=131072 00:27:05.884 08:34:51 -- host/digest.sh@80 -- # qd=16 00:27:05.884 08:34:51 -- host/digest.sh@82 -- # bperfpid=1073829 00:27:05.884 08:34:51 -- host/digest.sh@83 -- # waitforlisten 1073829 /var/tmp/bperf.sock 00:27:05.884 08:34:51 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:05.884 08:34:51 -- common/autotest_common.sh@829 -- # '[' -z 1073829 ']' 00:27:05.884 08:34:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:05.884 08:34:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:05.884 08:34:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:05.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:05.884 08:34:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:05.884 08:34:51 -- common/autotest_common.sh@10 -- # set +x 00:27:05.884 [2024-11-26 08:34:51.544221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:05.884 [2024-11-26 08:34:51.544292] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1073829 ] 00:27:05.884 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:05.884 Zero copy mechanism will not be used. 00:27:05.884 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.884 [2024-11-26 08:34:51.606329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:05.884 [2024-11-26 08:34:51.718050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:06.143 08:34:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:06.143 08:34:51 -- common/autotest_common.sh@862 -- # return 0 00:27:06.143 08:34:51 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:06.143 08:34:51 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:06.143 08:34:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:06.401 08:34:52 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.401 08:34:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.659 nvme0n1 00:27:06.659 08:34:52 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:06.659 08:34:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:06.917 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:06.917 Zero copy mechanism will not be used. 00:27:06.917 Running I/O for 2 seconds... 00:27:08.815 00:27:08.815 Latency(us) 00:27:08.815 [2024-11-26T07:34:54.675Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.815 [2024-11-26T07:34:54.675Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:08.815 nvme0n1 : 2.00 4444.79 555.60 0.00 0.00 3589.55 2706.39 14272.28 00:27:08.815 [2024-11-26T07:34:54.675Z] =================================================================================================================== 00:27:08.815 [2024-11-26T07:34:54.675Z] Total : 4444.79 555.60 0.00 0.00 3589.55 2706.39 14272.28 00:27:08.815 0 00:27:08.815 08:34:54 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:08.815 08:34:54 -- host/digest.sh@92 -- # get_accel_stats 00:27:08.815 08:34:54 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:08.816 08:34:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:08.816 08:34:54 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:08.816 | select(.opcode=="crc32c") 00:27:08.816 | "\(.module_name) \(.executed)"' 00:27:09.074 08:34:54 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:09.074 08:34:54 -- host/digest.sh@93 -- # exp_module=software 00:27:09.074 08:34:54 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:09.074 08:34:54 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:09.074 08:34:54 -- host/digest.sh@97 -- # killprocess 1073829 00:27:09.074 08:34:54 -- common/autotest_common.sh@936 -- # '[' -z 1073829 ']' 00:27:09.074 08:34:54 -- common/autotest_common.sh@940 -- # kill -0 1073829 00:27:09.074 08:34:54 -- common/autotest_common.sh@941 -- # uname 00:27:09.074 08:34:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:09.074 08:34:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1073829 00:27:09.074 08:34:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:09.074 08:34:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:09.074 08:34:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1073829' 00:27:09.074 killing process with pid 1073829 00:27:09.074 08:34:54 -- common/autotest_common.sh@955 -- # kill 1073829 00:27:09.074 Received shutdown signal, test time was about 2.000000 seconds 00:27:09.074 00:27:09.074 Latency(us) 00:27:09.074 [2024-11-26T07:34:54.934Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:09.074 [2024-11-26T07:34:54.934Z] =================================================================================================================== 00:27:09.074 [2024-11-26T07:34:54.934Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:09.074 08:34:54 -- common/autotest_common.sh@960 -- # wait 1073829 00:27:09.332 08:34:55 -- host/digest.sh@126 -- # killprocess 1072419 00:27:09.332 08:34:55 -- common/autotest_common.sh@936 -- # '[' -z 1072419 ']' 00:27:09.332 08:34:55 -- common/autotest_common.sh@940 -- # kill -0 1072419 00:27:09.332 08:34:55 -- common/autotest_common.sh@941 -- # uname 00:27:09.332 08:34:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:09.332 08:34:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1072419 00:27:09.332 08:34:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:09.332 08:34:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:09.332 08:34:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1072419' 00:27:09.332 killing process with pid 1072419 00:27:09.332 08:34:55 -- common/autotest_common.sh@955 -- # kill 1072419 00:27:09.332 08:34:55 -- common/autotest_common.sh@960 -- # wait 1072419 00:27:09.591 00:27:09.591 real 0m15.636s 00:27:09.591 user 0m30.551s 00:27:09.591 sys 0m4.379s 00:27:09.591 08:34:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:09.591 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:09.591 ************************************ 00:27:09.591 END TEST nvmf_digest_clean 00:27:09.591 ************************************ 00:27:09.850 08:34:55 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:09.850 08:34:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:09.850 08:34:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:09.850 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:09.850 ************************************ 00:27:09.850 START TEST nvmf_digest_error 00:27:09.850 ************************************ 00:27:09.850 08:34:55 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:09.850 08:34:55 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:09.850 08:34:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:09.850 08:34:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:09.850 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:09.850 08:34:55 -- nvmf/common.sh@469 -- # nvmfpid=1074395 00:27:09.850 08:34:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:09.850 08:34:55 -- nvmf/common.sh@470 -- # waitforlisten 1074395 00:27:09.850 08:34:55 -- common/autotest_common.sh@829 -- # '[' -z 1074395 ']' 00:27:09.850 08:34:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:09.850 08:34:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:09.850 08:34:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:09.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:09.850 08:34:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:09.850 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:09.850 [2024-11-26 08:34:55.510779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:09.850 [2024-11-26 08:34:55.510871] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:09.850 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.850 [2024-11-26 08:34:55.575226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:09.850 [2024-11-26 08:34:55.683449] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:09.850 [2024-11-26 08:34:55.683605] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:09.850 [2024-11-26 08:34:55.683619] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:09.850 [2024-11-26 08:34:55.683631] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:09.850 [2024-11-26 08:34:55.683656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:10.109 08:34:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.110 08:34:55 -- common/autotest_common.sh@862 -- # return 0 00:27:10.110 08:34:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:10.110 08:34:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:10.110 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:10.110 08:34:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:10.110 08:34:55 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:10.110 08:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.110 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:10.110 [2024-11-26 08:34:55.764386] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:10.110 08:34:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.110 08:34:55 -- host/digest.sh@104 -- # common_target_config 00:27:10.110 08:34:55 -- host/digest.sh@43 -- # rpc_cmd 00:27:10.110 08:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.110 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:10.110 null0 00:27:10.110 [2024-11-26 08:34:55.886673] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:10.110 [2024-11-26 08:34:55.910965] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:10.110 08:34:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.110 08:34:55 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:10.110 08:34:55 -- host/digest.sh@54 -- # local rw bs qd 00:27:10.110 08:34:55 -- host/digest.sh@56 -- # rw=randread 00:27:10.110 08:34:55 -- host/digest.sh@56 -- # bs=4096 00:27:10.110 08:34:55 -- host/digest.sh@56 -- # qd=128 00:27:10.110 08:34:55 -- host/digest.sh@58 -- # bperfpid=1074423 00:27:10.110 08:34:55 -- host/digest.sh@60 -- # waitforlisten 1074423 /var/tmp/bperf.sock 00:27:10.110 08:34:55 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:10.110 08:34:55 -- common/autotest_common.sh@829 -- # '[' -z 1074423 ']' 00:27:10.110 08:34:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:10.110 08:34:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:10.110 08:34:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:10.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:10.110 08:34:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:10.110 08:34:55 -- common/autotest_common.sh@10 -- # set +x 00:27:10.110 [2024-11-26 08:34:55.954490] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:10.110 [2024-11-26 08:34:55.954564] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1074423 ] 00:27:10.368 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.368 [2024-11-26 08:34:56.013230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:10.368 [2024-11-26 08:34:56.119756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:11.302 08:34:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.302 08:34:56 -- common/autotest_common.sh@862 -- # return 0 00:27:11.302 08:34:56 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.302 08:34:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.560 08:34:57 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:11.560 08:34:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.560 08:34:57 -- common/autotest_common.sh@10 -- # set +x 00:27:11.560 08:34:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.560 08:34:57 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.560 08:34:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.126 nvme0n1 00:27:12.126 08:34:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:12.126 08:34:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.126 08:34:57 -- common/autotest_common.sh@10 -- # set +x 00:27:12.126 08:34:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.126 08:34:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:12.126 08:34:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:12.126 Running I/O for 2 seconds... 00:27:12.126 [2024-11-26 08:34:57.845849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.845897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:333 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.845934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.863403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.863439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:13254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.863459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.879706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.879763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:2351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.879779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.890398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.890427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.890459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.906064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.906099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.906119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.922901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.922944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:19316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.922959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.938296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.938341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:12975 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.938357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.949405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.126 [2024-11-26 08:34:57.949451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:4091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.126 [2024-11-26 08:34:57.949467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.126 [2024-11-26 08:34:57.966828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.127 [2024-11-26 08:34:57.966875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:25545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.127 [2024-11-26 08:34:57.966894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:57.983977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:57.984007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:57.984039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.000449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.000478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.000510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.015399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.015429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21900 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.015460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.026417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.026451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:14763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.026477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.043202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.043237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.043256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.059743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.059774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9558 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.059806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.076188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.076224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.076243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.092752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.092783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:12949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.092815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.103837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.103866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.103897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.119196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.119231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:11742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.119251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.135697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.135731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:18892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.135764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.152551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.152588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10600 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.152607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.163239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.163274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:22186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.163294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.177761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.177790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:21595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.177821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.194440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.194475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.194494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.385 [2024-11-26 08:34:58.211921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.385 [2024-11-26 08:34:58.211949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:20729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.385 [2024-11-26 08:34:58.211980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.386 [2024-11-26 08:34:58.229092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.386 [2024-11-26 08:34:58.229128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.386 [2024-11-26 08:34:58.229147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.644 [2024-11-26 08:34:58.239712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.644 [2024-11-26 08:34:58.239758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:3542 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.239775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.255911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.255940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1007 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.255971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.272921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.272949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:12805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.272981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.289501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.289535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.289560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.306222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.306251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:12362 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.306284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.323050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.323085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:3843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.323103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.334097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.334127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:20802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.334158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.349730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.349764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:15732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.349782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.367410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.367439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.367470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.383526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.383562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3939 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.383581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.400519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.400554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23886 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.400573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.415932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.415962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:17211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.415995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.427060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.427100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:13487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.427120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.442453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.442488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16150 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.442507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.457181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.457212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:2237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.457249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.468945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.468973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.468989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.645 [2024-11-26 08:34:58.485101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.645 [2024-11-26 08:34:58.485137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.645 [2024-11-26 08:34:58.485156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.903 [2024-11-26 08:34:58.502578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.502614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:13970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.502632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.519498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.519533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.519552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.536225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.536255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.536291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.546769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.546797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:22551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.546828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.562509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.562544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.562563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.579410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.579446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.579465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.594743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.594773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:12275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.594804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.605806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.605834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:10705 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.605866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.622566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.622601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:18153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.622620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.639422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.639458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:2578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.639477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.655039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.655071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:11913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.655088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.666353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.666383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:7181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.666415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.682619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.682649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.682693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.699379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.699414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:15735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.699433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.715848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.715877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.715907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.732333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.732368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.732386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.904 [2024-11-26 08:34:58.749815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:12.904 [2024-11-26 08:34:58.749846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:17620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.904 [2024-11-26 08:34:58.749877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.765898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.765934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:15909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.765952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.782439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.782474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:2179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.782493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.796590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.796620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.796653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.806990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.807033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:2925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.807048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.823119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.823161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21582 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.823181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.839719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.839749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:1715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.839781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.854485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.854515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.854546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.866784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.866814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:16320 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.866830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.882318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.882346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.882377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.899326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.899361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:24049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.899380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.914626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.914672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:3797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.914698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.925547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.925581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:25424 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.925600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.942435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.942470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:21895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.942495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.958443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.958474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:59 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.958508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.969340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.969375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:12388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.969393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:58.983973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:58.984017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:58.984036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:59.000478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:59.000509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:8873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:59.000541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.163 [2024-11-26 08:34:59.017238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.163 [2024-11-26 08:34:59.017273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.163 [2024-11-26 08:34:59.017291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.431 [2024-11-26 08:34:59.033863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.431 [2024-11-26 08:34:59.033892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:19391 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.431 [2024-11-26 08:34:59.033923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.431 [2024-11-26 08:34:59.049182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.431 [2024-11-26 08:34:59.049226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:15478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.049242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.060916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.060946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:4461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.060963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.074425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.074461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:1816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.074494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.090829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.090863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.090882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.106885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.106916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:23877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.106949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.123728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.123763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:8114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.123782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.140246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.140281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:15062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.140299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.157005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.432 [2024-11-26 08:34:59.157034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:16742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.432 [2024-11-26 08:34:59.157066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.432 [2024-11-26 08:34:59.167833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.167862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:7114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.167893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.183797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.183842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:13133 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.183861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.200242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.200277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:25590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.200295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.216925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.216954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:18647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.216985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.233248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.233276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:14776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.233307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.249772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.249800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:15355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.249831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.266446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.433 [2024-11-26 08:34:59.266475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.433 [2024-11-26 08:34:59.266507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.433 [2024-11-26 08:34:59.283069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.434 [2024-11-26 08:34:59.283103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:16473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.434 [2024-11-26 08:34:59.283122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.299834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.299862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.299893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.314659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.314697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.314732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.326570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.326604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:18048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.326622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.343755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.343784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:2003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.343824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.358930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.358961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:16091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.358993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.370187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.370215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.370246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.387154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.387184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:2711 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.387217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.404042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.404073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2081 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.693 [2024-11-26 08:34:59.404089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.693 [2024-11-26 08:34:59.415021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.693 [2024-11-26 08:34:59.415055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.415073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.431331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.431365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:21799 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.431384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.448471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.448508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:14692 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.448527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.465113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.465141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.465172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.480840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.480873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.480905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.497198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.497233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:1147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.497252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.513791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.513819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:18904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.513849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.530537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.530571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:19277 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.530590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.694 [2024-11-26 08:34:59.547119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.694 [2024-11-26 08:34:59.547154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:1296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.694 [2024-11-26 08:34:59.547173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.564062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.564097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.564115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.580717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.580750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:19021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.580768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.597644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.597679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.597707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.614503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.614532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.614547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.631489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.631523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:330 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.631542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.646614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.646660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:20115 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.646680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.657876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.657903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.657933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.673314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.673343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:10834 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.673373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.689399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.689435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:12664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.689454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.705172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.705202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:21990 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.705219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.717308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.717336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:7523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.717367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.732834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.732863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:10651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.732898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.749582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.749623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:14984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.952 [2024-11-26 08:34:59.749643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.952 [2024-11-26 08:34:59.764669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.952 [2024-11-26 08:34:59.764711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:1269 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.953 [2024-11-26 08:34:59.764748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.953 [2024-11-26 08:34:59.776588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.953 [2024-11-26 08:34:59.776623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.953 [2024-11-26 08:34:59.776641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.953 [2024-11-26 08:34:59.793727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:13.953 [2024-11-26 08:34:59.793758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:17248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.953 [2024-11-26 08:34:59.793775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.211 [2024-11-26 08:34:59.810401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:14.211 [2024-11-26 08:34:59.810435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:10156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.211 [2024-11-26 08:34:59.810452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.211 [2024-11-26 08:34:59.821082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22dabb0) 00:27:14.211 [2024-11-26 08:34:59.821117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:988 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.211 [2024-11-26 08:34:59.821137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.211 00:27:14.211 Latency(us) 00:27:14.211 [2024-11-26T07:35:00.071Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.211 [2024-11-26T07:35:00.071Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:14.211 nvme0n1 : 2.01 16639.83 65.00 0.00 0.00 7681.18 3058.35 25826.04 00:27:14.211 [2024-11-26T07:35:00.071Z] =================================================================================================================== 00:27:14.211 [2024-11-26T07:35:00.071Z] Total : 16639.83 65.00 0.00 0.00 7681.18 3058.35 25826.04 00:27:14.211 0 00:27:14.211 08:34:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:14.211 08:34:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:14.211 08:34:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:14.211 08:34:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:14.211 | .driver_specific 00:27:14.212 | .nvme_error 00:27:14.212 | .status_code 00:27:14.212 | .command_transient_transport_error' 00:27:14.469 08:35:00 -- host/digest.sh@71 -- # (( 130 > 0 )) 00:27:14.469 08:35:00 -- host/digest.sh@73 -- # killprocess 1074423 00:27:14.469 08:35:00 -- common/autotest_common.sh@936 -- # '[' -z 1074423 ']' 00:27:14.469 08:35:00 -- common/autotest_common.sh@940 -- # kill -0 1074423 00:27:14.469 08:35:00 -- common/autotest_common.sh@941 -- # uname 00:27:14.469 08:35:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.469 08:35:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1074423 00:27:14.469 08:35:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:14.469 08:35:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:14.469 08:35:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1074423' 00:27:14.469 killing process with pid 1074423 00:27:14.469 08:35:00 -- common/autotest_common.sh@955 -- # kill 1074423 00:27:14.469 Received shutdown signal, test time was about 2.000000 seconds 00:27:14.469 00:27:14.469 Latency(us) 00:27:14.469 [2024-11-26T07:35:00.329Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.469 [2024-11-26T07:35:00.329Z] =================================================================================================================== 00:27:14.469 [2024-11-26T07:35:00.329Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:14.469 08:35:00 -- common/autotest_common.sh@960 -- # wait 1074423 00:27:14.726 08:35:00 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:14.726 08:35:00 -- host/digest.sh@54 -- # local rw bs qd 00:27:14.726 08:35:00 -- host/digest.sh@56 -- # rw=randread 00:27:14.726 08:35:00 -- host/digest.sh@56 -- # bs=131072 00:27:14.726 08:35:00 -- host/digest.sh@56 -- # qd=16 00:27:14.726 08:35:00 -- host/digest.sh@58 -- # bperfpid=1074978 00:27:14.727 08:35:00 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:14.727 08:35:00 -- host/digest.sh@60 -- # waitforlisten 1074978 /var/tmp/bperf.sock 00:27:14.727 08:35:00 -- common/autotest_common.sh@829 -- # '[' -z 1074978 ']' 00:27:14.727 08:35:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:14.727 08:35:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:14.727 08:35:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:14.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:14.727 08:35:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:14.727 08:35:00 -- common/autotest_common.sh@10 -- # set +x 00:27:14.727 [2024-11-26 08:35:00.442842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:14.727 [2024-11-26 08:35:00.442916] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1074978 ] 00:27:14.727 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:14.727 Zero copy mechanism will not be used. 00:27:14.727 EAL: No free 2048 kB hugepages reported on node 1 00:27:14.727 [2024-11-26 08:35:00.502506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:14.985 [2024-11-26 08:35:00.616948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:15.918 08:35:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:15.918 08:35:01 -- common/autotest_common.sh@862 -- # return 0 00:27:15.918 08:35:01 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:15.918 08:35:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:15.918 08:35:01 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:15.918 08:35:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:15.918 08:35:01 -- common/autotest_common.sh@10 -- # set +x 00:27:15.918 08:35:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:15.918 08:35:01 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.918 08:35:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:16.177 nvme0n1 00:27:16.437 08:35:02 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:16.437 08:35:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:16.437 08:35:02 -- common/autotest_common.sh@10 -- # set +x 00:27:16.437 08:35:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:16.437 08:35:02 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:16.437 08:35:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:16.437 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:16.437 Zero copy mechanism will not be used. 00:27:16.437 Running I/O for 2 seconds... 00:27:16.437 [2024-11-26 08:35:02.173758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.173827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.173848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.181838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.181881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.181899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.189809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.189850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.189867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.197796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.197828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.197845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.205708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.205740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.205758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.213557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.213587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.213619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.221450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.221481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.221513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.229772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.229803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.229832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.237952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.237995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.238011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.245786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.245817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.245850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.253625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.253654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.253696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.261596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.261626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.261657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.269576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.269605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.269637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.277319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.277348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.277379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.437 [2024-11-26 08:35:02.285022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.437 [2024-11-26 08:35:02.285052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.437 [2024-11-26 08:35:02.285083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.293189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.293220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.293252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.301262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.301300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.301331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.309116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.309148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.309180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.317230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.317266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.317287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.325737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.325767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.325798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.334142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.334177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.334197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.343452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.343487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.343506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.353231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.353267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.353285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.363034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.363069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.363088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.372706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.372752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.372769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.382001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.382049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.382068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.391071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.391111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.391132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.403317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.403361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.403392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.411885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.411936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.411965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.420890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.420924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.420951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.430464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.430504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.430524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.440236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.440272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.440291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.449837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.449869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.449886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.458316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.458352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.458379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.466623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.466659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.466678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.475004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.475040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.475059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.483200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.483235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.483255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.491450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.491486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.491504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.499629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.499665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.499683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.698 [2024-11-26 08:35:02.507892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.698 [2024-11-26 08:35:02.507922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.698 [2024-11-26 08:35:02.507953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.699 [2024-11-26 08:35:02.516102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.699 [2024-11-26 08:35:02.516138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.699 [2024-11-26 08:35:02.516157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.699 [2024-11-26 08:35:02.524318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.699 [2024-11-26 08:35:02.524354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.699 [2024-11-26 08:35:02.524373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.699 [2024-11-26 08:35:02.532499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.699 [2024-11-26 08:35:02.532535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.699 [2024-11-26 08:35:02.532554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.699 [2024-11-26 08:35:02.540744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.699 [2024-11-26 08:35:02.540776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.699 [2024-11-26 08:35:02.540794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.699 [2024-11-26 08:35:02.549021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.699 [2024-11-26 08:35:02.549057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.699 [2024-11-26 08:35:02.549075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.958 [2024-11-26 08:35:02.557364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.557401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.557420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.565497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.565532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.565551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.573770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.573802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.573819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.581934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.581965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.582002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.590315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.590350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.590369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.598564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.598600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.598627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.606857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.606888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.606920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.615076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.615112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.615131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.623285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.623320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.623340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.631411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.631447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.631466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.639486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.639522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.639541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.647750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.647780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.647813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.656054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.656090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.656109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.664300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.664336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.664355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.672478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.672520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.672541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.680653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.680696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.680717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.688997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.689033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.689052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.697266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.697301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.697320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.705621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.705657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.705676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.713884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.713916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.713949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.722314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.722349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.722368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.730629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.730664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.730694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.739094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.739128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.739148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.747480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.747516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.747534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.755681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.755746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.755764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.763975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.959 [2024-11-26 08:35:02.764006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.959 [2024-11-26 08:35:02.764023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.959 [2024-11-26 08:35:02.772115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.960 [2024-11-26 08:35:02.772150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.960 [2024-11-26 08:35:02.772168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.960 [2024-11-26 08:35:02.780272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.960 [2024-11-26 08:35:02.780307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.960 [2024-11-26 08:35:02.780326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.960 [2024-11-26 08:35:02.788350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.960 [2024-11-26 08:35:02.788385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.960 [2024-11-26 08:35:02.788404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.960 [2024-11-26 08:35:02.796451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.960 [2024-11-26 08:35:02.796486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.960 [2024-11-26 08:35:02.796505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.960 [2024-11-26 08:35:02.804906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:16.960 [2024-11-26 08:35:02.804938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.960 [2024-11-26 08:35:02.804955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.220 [2024-11-26 08:35:02.813279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.220 [2024-11-26 08:35:02.813315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.220 [2024-11-26 08:35:02.813342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.220 [2024-11-26 08:35:02.822071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.220 [2024-11-26 08:35:02.822107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.822125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.831594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.831628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.831647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.840406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.840441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.840460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.848576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.848611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.848631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.856639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.856675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.856703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.864932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.864964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.864981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.873116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.873153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.873172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.881428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.881465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.881484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.889770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.889807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.889840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.897937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.897968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.898003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.906444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.906479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.906498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.914928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.914957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.914992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.923538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.923573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.923592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.931973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.932019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.932035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.940377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.940413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.940431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.948836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.948868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.948885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.957330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.957365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.957396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.965678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.965735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.965753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.973978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.974025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.974045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.982264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.982299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.982318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.990428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.990462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.990481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:02.998755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:02.998786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:02.998820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.006876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.006907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:03.006939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.015030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.015065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:03.015084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.023262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.023297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:03.023316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.031322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.031364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:03.031384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.039490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.039525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.221 [2024-11-26 08:35:03.039544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.221 [2024-11-26 08:35:03.047752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.221 [2024-11-26 08:35:03.047782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.222 [2024-11-26 08:35:03.047814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.222 [2024-11-26 08:35:03.055852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.222 [2024-11-26 08:35:03.055883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.222 [2024-11-26 08:35:03.055915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.222 [2024-11-26 08:35:03.063959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.222 [2024-11-26 08:35:03.064005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.222 [2024-11-26 08:35:03.064025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.222 [2024-11-26 08:35:03.072116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.222 [2024-11-26 08:35:03.072152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.222 [2024-11-26 08:35:03.072171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.080419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.080456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.080476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.088491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.088526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.088545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.096790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.096821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.096853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.105005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.105040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.105059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.113121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.113156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.113175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.121337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.121371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.121390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.129479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.129514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.129533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.137746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.137777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.137809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.146088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.146123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.146142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.154279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.154315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.154334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.162412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.162448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.162466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.170699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.170756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.170779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.178923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.178955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.178987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.187358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.481 [2024-11-26 08:35:03.187395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.481 [2024-11-26 08:35:03.187414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.481 [2024-11-26 08:35:03.195511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.195548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.195567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.203732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.203781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.203799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.212115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.212150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.212168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.220348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.220383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.220402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.228475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.228511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.228530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.236585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.236621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.236640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.244849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.244889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.244923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.253002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.253037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.253057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.261152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.261188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.261207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.269363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.269398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.269417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.277750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.277796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.277814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.286048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.286083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.286102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.294335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.294370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.294389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.302435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.302469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.302488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.310443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.310479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.310497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.318499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.318530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.318563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.326198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.326234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.326253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.482 [2024-11-26 08:35:03.334581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.482 [2024-11-26 08:35:03.334621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.482 [2024-11-26 08:35:03.334640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.342863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.342896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.342913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.351121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.351156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.351176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.359391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.359426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.359445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.367757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.367789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.367806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.376022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.376053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.376085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.384049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.384099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.384126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.392150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.392189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.392209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.400139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.400174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.400193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.408231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.408266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.408285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.416342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.416377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.416396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.424487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.424522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.424542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.432637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.432672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.432700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.440934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.440964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.440997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.449310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.449345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.449364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.457900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.457933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.457950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.466179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.466215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.466234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.474271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.474307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.474327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.482317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.482354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.482373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.490383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.490418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.490438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.498491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.498527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.498546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.506538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.506574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.506594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.514539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.514574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.514593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.522769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.522801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.522823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.530808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.530840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.530857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.538869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.538901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.742 [2024-11-26 08:35:03.538917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.742 [2024-11-26 08:35:03.547082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.742 [2024-11-26 08:35:03.547118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.547137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.743 [2024-11-26 08:35:03.555290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.743 [2024-11-26 08:35:03.555325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.555344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.743 [2024-11-26 08:35:03.563436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.743 [2024-11-26 08:35:03.563471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.563491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.743 [2024-11-26 08:35:03.571734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.743 [2024-11-26 08:35:03.571765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.571796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.743 [2024-11-26 08:35:03.579924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.743 [2024-11-26 08:35:03.579954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.579989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.743 [2024-11-26 08:35:03.588189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:17.743 [2024-11-26 08:35:03.588224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.743 [2024-11-26 08:35:03.588242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.596419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.596461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.596484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.604636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.604671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.604701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.612906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.612937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.612970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.621079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.621115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.621134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.629171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.629207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.629225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.637320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.637355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.637375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.645473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.645509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.645528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.653583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.653618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.653637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.661859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.661889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.661921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.670132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.670167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.670186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.678295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.678331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.678349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.686477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.686512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.686531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.694770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.694801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.002 [2024-11-26 08:35:03.694819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.002 [2024-11-26 08:35:03.703017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.002 [2024-11-26 08:35:03.703062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.703082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.711355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.711391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.711410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.719678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.719737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.719755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.727941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.727997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.728016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.736122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.736158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.736184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.744338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.744374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.744393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.752466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.752502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.752521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.760741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.760772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.760790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.768919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.768951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.768971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.777224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.777259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.777279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.785452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.785487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.785506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.793678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.793736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.793754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.802017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.802052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.802072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.810040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.810081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.810102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.818123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.818164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.818184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.826209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.826245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.826264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.834397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.834433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.834452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.842628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.842664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.842683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.003 [2024-11-26 08:35:03.850828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.003 [2024-11-26 08:35:03.850858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.003 [2024-11-26 08:35:03.850890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.859153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.859189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.859208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.867494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.867530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.867549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.875569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.875604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.875623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.883816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.883847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.883879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.891974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.892004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.892040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.900130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.900165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.900184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.908297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.908333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.908352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.916453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.916489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.916508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.924840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.263 [2024-11-26 08:35:03.924871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.263 [2024-11-26 08:35:03.924903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.263 [2024-11-26 08:35:03.932958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.933005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.933024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.941113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.941148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.941167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.949316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.949357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.949377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.957546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.957581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.957600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.965903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.965935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.965953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.974305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.974340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.974360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.982610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.982645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.982665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.990884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.990916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.990933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:03.999280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:03.999315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:03.999334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.007296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.007332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.007351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.015440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.015476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.015496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.023557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.023592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.023611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.031706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.031753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.031770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.039903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.039936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.039953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.048186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.048221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.048241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.056272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.056307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.056327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.064294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.064329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.064348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.072477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.072512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.072532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.080806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.080837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.080869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.088969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.089018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.089044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.264 [2024-11-26 08:35:04.097065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.264 [2024-11-26 08:35:04.097100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.264 [2024-11-26 08:35:04.097118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.265 [2024-11-26 08:35:04.105247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.265 [2024-11-26 08:35:04.105282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.265 [2024-11-26 08:35:04.105301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.265 [2024-11-26 08:35:04.113393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.265 [2024-11-26 08:35:04.113428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.265 [2024-11-26 08:35:04.113447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.523 [2024-11-26 08:35:04.121762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.523 [2024-11-26 08:35:04.121798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.523 [2024-11-26 08:35:04.121816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.523 [2024-11-26 08:35:04.130037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.523 [2024-11-26 08:35:04.130072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.523 [2024-11-26 08:35:04.130092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.523 [2024-11-26 08:35:04.138161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.523 [2024-11-26 08:35:04.138195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.523 [2024-11-26 08:35:04.138214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.523 [2024-11-26 08:35:04.146295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.524 [2024-11-26 08:35:04.146330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.524 [2024-11-26 08:35:04.146349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.524 [2024-11-26 08:35:04.154403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.524 [2024-11-26 08:35:04.154438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.524 [2024-11-26 08:35:04.154457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.524 [2024-11-26 08:35:04.162477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.524 [2024-11-26 08:35:04.162519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.524 [2024-11-26 08:35:04.162539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.524 [2024-11-26 08:35:04.170509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1183bb0) 00:27:18.524 [2024-11-26 08:35:04.170543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.524 [2024-11-26 08:35:04.170562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.524 00:27:18.524 Latency(us) 00:27:18.524 [2024-11-26T07:35:04.384Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:18.524 [2024-11-26T07:35:04.384Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:18.524 nvme0n1 : 2.00 3753.21 469.15 0.00 0.00 4257.60 3373.89 12815.93 00:27:18.524 [2024-11-26T07:35:04.384Z] =================================================================================================================== 00:27:18.524 [2024-11-26T07:35:04.384Z] Total : 3753.21 469.15 0.00 0.00 4257.60 3373.89 12815.93 00:27:18.524 0 00:27:18.524 08:35:04 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:18.524 08:35:04 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:18.524 08:35:04 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:18.524 | .driver_specific 00:27:18.524 | .nvme_error 00:27:18.524 | .status_code 00:27:18.524 | .command_transient_transport_error' 00:27:18.524 08:35:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:18.783 08:35:04 -- host/digest.sh@71 -- # (( 242 > 0 )) 00:27:18.783 08:35:04 -- host/digest.sh@73 -- # killprocess 1074978 00:27:18.783 08:35:04 -- common/autotest_common.sh@936 -- # '[' -z 1074978 ']' 00:27:18.783 08:35:04 -- common/autotest_common.sh@940 -- # kill -0 1074978 00:27:18.783 08:35:04 -- common/autotest_common.sh@941 -- # uname 00:27:18.783 08:35:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:18.783 08:35:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1074978 00:27:18.783 08:35:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:18.783 08:35:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:18.783 08:35:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1074978' 00:27:18.783 killing process with pid 1074978 00:27:18.783 08:35:04 -- common/autotest_common.sh@955 -- # kill 1074978 00:27:18.783 Received shutdown signal, test time was about 2.000000 seconds 00:27:18.783 00:27:18.783 Latency(us) 00:27:18.783 [2024-11-26T07:35:04.643Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:18.783 [2024-11-26T07:35:04.643Z] =================================================================================================================== 00:27:18.783 [2024-11-26T07:35:04.643Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:18.783 08:35:04 -- common/autotest_common.sh@960 -- # wait 1074978 00:27:19.042 08:35:04 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:19.042 08:35:04 -- host/digest.sh@54 -- # local rw bs qd 00:27:19.042 08:35:04 -- host/digest.sh@56 -- # rw=randwrite 00:27:19.042 08:35:04 -- host/digest.sh@56 -- # bs=4096 00:27:19.042 08:35:04 -- host/digest.sh@56 -- # qd=128 00:27:19.042 08:35:04 -- host/digest.sh@58 -- # bperfpid=1075533 00:27:19.042 08:35:04 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:19.042 08:35:04 -- host/digest.sh@60 -- # waitforlisten 1075533 /var/tmp/bperf.sock 00:27:19.042 08:35:04 -- common/autotest_common.sh@829 -- # '[' -z 1075533 ']' 00:27:19.042 08:35:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:19.042 08:35:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:19.042 08:35:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:19.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:19.042 08:35:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:19.042 08:35:04 -- common/autotest_common.sh@10 -- # set +x 00:27:19.042 [2024-11-26 08:35:04.810019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.042 [2024-11-26 08:35:04.810093] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1075533 ] 00:27:19.042 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.042 [2024-11-26 08:35:04.870117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:19.300 [2024-11-26 08:35:04.980815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:20.236 08:35:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:20.236 08:35:05 -- common/autotest_common.sh@862 -- # return 0 00:27:20.236 08:35:05 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:20.236 08:35:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:20.236 08:35:06 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:20.236 08:35:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.236 08:35:06 -- common/autotest_common.sh@10 -- # set +x 00:27:20.236 08:35:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.236 08:35:06 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:20.236 08:35:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:20.802 nvme0n1 00:27:20.802 08:35:06 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:20.802 08:35:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.802 08:35:06 -- common/autotest_common.sh@10 -- # set +x 00:27:20.802 08:35:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.802 08:35:06 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:20.802 08:35:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:20.802 Running I/O for 2 seconds... 00:27:20.802 [2024-11-26 08:35:06.627194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ee5c8 00:27:20.802 [2024-11-26 08:35:06.628308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:2116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.802 [2024-11-26 08:35:06.628353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:20.802 [2024-11-26 08:35:06.640426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ee5c8 00:27:20.802 [2024-11-26 08:35:06.640833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:20139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.802 [2024-11-26 08:35:06.640863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:20.802 [2024-11-26 08:35:06.652954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:20.802 [2024-11-26 08:35:06.653575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:23564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.802 [2024-11-26 08:35:06.653608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.665338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f4f40 00:27:21.061 [2024-11-26 08:35:06.665945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:3765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.665989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.677778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e7818 00:27:21.061 [2024-11-26 08:35:06.678339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:9352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.678371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.690235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ea680 00:27:21.061 [2024-11-26 08:35:06.690780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:16101 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.690808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.702761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ec840 00:27:21.061 [2024-11-26 08:35:06.703265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:3902 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.703298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.715075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ef270 00:27:21.061 [2024-11-26 08:35:06.715502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:1211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.715534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.727226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e99d8 00:27:21.061 [2024-11-26 08:35:06.727601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:13890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.727633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.739427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e1710 00:27:21.061 [2024-11-26 08:35:06.739781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.739810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.751740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f1ca0 00:27:21.061 [2024-11-26 08:35:06.752011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:16671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.752040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.763932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f31b8 00:27:21.061 [2024-11-26 08:35:06.764178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:23536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.764206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.776254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eea00 00:27:21.061 [2024-11-26 08:35:06.776567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:2256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.776600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.788368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ebfd0 00:27:21.061 [2024-11-26 08:35:06.789699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.789753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.800618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ebfd0 00:27:21.061 [2024-11-26 08:35:06.801832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:22182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.801875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.812749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eea00 00:27:21.061 [2024-11-26 08:35:06.813584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.813616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.825133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f7100 00:27:21.061 [2024-11-26 08:35:06.826259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:24130 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.826293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.837335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f0ff8 00:27:21.061 [2024-11-26 08:35:06.838476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:19970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.838509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.849613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e1b48 00:27:21.061 [2024-11-26 08:35:06.850745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:20091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.850774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.861744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f6cc8 00:27:21.061 [2024-11-26 08:35:06.862876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:9066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.862905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.874049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f4b08 00:27:21.061 [2024-11-26 08:35:06.875187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:16727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.875222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.886942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f7970 00:27:21.061 [2024-11-26 08:35:06.888117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.888146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.899472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.061 [2024-11-26 08:35:06.900305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:21237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.900337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:21.061 [2024-11-26 08:35:06.912087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.061 [2024-11-26 08:35:06.913185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.061 [2024-11-26 08:35:06.913222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:21.321 [2024-11-26 08:35:06.924653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.321 [2024-11-26 08:35:06.925706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:8064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.321 [2024-11-26 08:35:06.925751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.321 [2024-11-26 08:35:06.937057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.321 [2024-11-26 08:35:06.938121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:20169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.321 [2024-11-26 08:35:06.938150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:06.949569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:06.950644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:17437 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:06.950675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:06.962004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:06.963104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:22526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:06.963132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:06.974542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:06.975645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:22235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:06.975676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:06.986941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:06.988095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:11410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:06.988124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:06.999480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.000621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.000653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.011853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.013011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.013040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.024398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.025567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.025598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.036769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.037960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.038001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.049297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.050511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.050542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.061760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.062994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:8073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.063020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.074277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.075519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:20760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.075550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.086707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.087943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.087971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.099179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.100457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:12090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.100488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.111610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.112918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:8626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.112943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.124154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.125451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.125483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.136790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:21.322 [2024-11-26 08:35:07.138081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:12827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.138109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.148488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f1ca0 00:27:21.322 [2024-11-26 08:35:07.148811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:21279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.148839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.161240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.322 [2024-11-26 08:35:07.162281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:12007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.162313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:21.322 [2024-11-26 08:35:07.173651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.322 [2024-11-26 08:35:07.174650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.322 [2024-11-26 08:35:07.174682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.186074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.187142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.187171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.198585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.199628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:23335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.199666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.210998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.212111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:4668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.212139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.223469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.224537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.224567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.235872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.236999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:6109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.237028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:21.583 [2024-11-26 08:35:07.248391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.583 [2024-11-26 08:35:07.249512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:9079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.583 [2024-11-26 08:35:07.249543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.260778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.261922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:16883 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.261950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.273201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.274385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:7592 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.274416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.285520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.286668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:12115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.286708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.297897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.299068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:13290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.299096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.310328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.311519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.311559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.322879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.324085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.324113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.335322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.336540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.336572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.347763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.349007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:10757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.349050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.360158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.361438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:19338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.361469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.372543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.373782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:3701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.373809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.385050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.386327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:7137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.386359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.397490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eff18 00:27:21.584 [2024-11-26 08:35:07.398760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.398788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.409111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e9168 00:27:21.584 [2024-11-26 08:35:07.409435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:7137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.409466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.421745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f5be8 00:27:21.584 [2024-11-26 08:35:07.422779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.422808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:21.584 [2024-11-26 08:35:07.434074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.584 [2024-11-26 08:35:07.435121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:12320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.584 [2024-11-26 08:35:07.435150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.446526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.447537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.447569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.458908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.459980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.460009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.471312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.472388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.472419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.483700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.484797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:2245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.484825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.496086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.497194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:23783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.497222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.508526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.509618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:19636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.509650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.520958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.522082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:4144 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.522110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.533470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.534577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.534608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.545869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.547009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:12465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.547053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.558277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.559445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:18633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.559476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.570924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.572113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.572155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.583416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.584592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:4507 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.584623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.595856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.597068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:22809 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.597095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.608258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.609487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.609518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.620764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.621997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:14514 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.622042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.633277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.634534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:21107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.634572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.645670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.646918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:8134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.646947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.658239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:21.846 [2024-11-26 08:35:07.659511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:19752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.659543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.669999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f3e60 00:27:21.846 [2024-11-26 08:35:07.670313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:12476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.670345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:27:21.846 [2024-11-26 08:35:07.682596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f1868 00:27:21.846 [2024-11-26 08:35:07.683568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:6397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.846 [2024-11-26 08:35:07.683599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:21.847 [2024-11-26 08:35:07.694772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f5be8 00:27:21.847 [2024-11-26 08:35:07.696164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:14866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.847 [2024-11-26 08:35:07.696194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.706897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eb760 00:27:22.107 [2024-11-26 08:35:07.708244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:11818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.708278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.718897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e6300 00:27:22.107 [2024-11-26 08:35:07.719697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:19538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.719730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.731453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e23b8 00:27:22.107 [2024-11-26 08:35:07.732677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.732720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.743648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f5378 00:27:22.107 [2024-11-26 08:35:07.744860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:21250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.744889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.755806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f8e88 00:27:22.107 [2024-11-26 08:35:07.757086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.757115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.768088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f0bc0 00:27:22.107 [2024-11-26 08:35:07.769391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.769423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.780448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ef270 00:27:22.107 [2024-11-26 08:35:07.781760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:4235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.781789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.793235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f7100 00:27:22.107 [2024-11-26 08:35:07.794527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:19790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.794560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.805698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.107 [2024-11-26 08:35:07.806657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:13443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.806707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.818446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.107 [2024-11-26 08:35:07.819620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.819649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.830819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.107 [2024-11-26 08:35:07.832040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:17332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.832079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.843227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.107 [2024-11-26 08:35:07.844440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:6494 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.844479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.855555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.107 [2024-11-26 08:35:07.856780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.107 [2024-11-26 08:35:07.856809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:22.107 [2024-11-26 08:35:07.868032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.869300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.869332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.880446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.881656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:12509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.881697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.892873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.894129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:15176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.894156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.905354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.906634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.906666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.917795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.919081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:15580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.919109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.930112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.931439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.931469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.942346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.943662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.943701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:22.108 [2024-11-26 08:35:07.954853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.108 [2024-11-26 08:35:07.956202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.108 [2024-11-26 08:35:07.956254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:07.967330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.368 [2024-11-26 08:35:07.968672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.368 [2024-11-26 08:35:07.968714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:07.979713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eaab8 00:27:22.368 [2024-11-26 08:35:07.981084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:14738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.368 [2024-11-26 08:35:07.981111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:07.992078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ef6a8 00:27:22.368 [2024-11-26 08:35:07.993507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.368 [2024-11-26 08:35:07.993538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:08.004560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ec408 00:27:22.368 [2024-11-26 08:35:08.006018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:13633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.368 [2024-11-26 08:35:08.006050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:08.017034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e5220 00:27:22.368 [2024-11-26 08:35:08.018468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:2879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.368 [2024-11-26 08:35:08.018499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:22.368 [2024-11-26 08:35:08.029522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f1430 00:27:22.369 [2024-11-26 08:35:08.030951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:22723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.030995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.042066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e9168 00:27:22.369 [2024-11-26 08:35:08.043503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.043536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.053870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190ed4e8 00:27:22.369 [2024-11-26 08:35:08.054365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.054396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.066626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.067841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.067870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.079060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.080272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:3396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.080303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.091588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.092811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:14444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.092839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.103991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.105224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:22365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.105256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.116396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.117631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:9135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.117661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.128874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.130128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.130157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.141391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.142615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.142647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.153907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.155175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:15588 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.155203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.166360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.167642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:13361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.167672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.178826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.180141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8591 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.180169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.191253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.192567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:909 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.192598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.203651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.204977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:10098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.205019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:22.369 [2024-11-26 08:35:08.216183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.369 [2024-11-26 08:35:08.217537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.369 [2024-11-26 08:35:08.217570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.228734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.630 [2024-11-26 08:35:08.230087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:8833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.230113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.241283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.630 [2024-11-26 08:35:08.242643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.242674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.253756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f20d8 00:27:22.630 [2024-11-26 08:35:08.255113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:3336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.255156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.266274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190eea00 00:27:22.630 [2024-11-26 08:35:08.267679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:15959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.267732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.278783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f96f8 00:27:22.630 [2024-11-26 08:35:08.280212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:22288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.280249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.291341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e6300 00:27:22.630 [2024-11-26 08:35:08.292765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.292792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.303881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f81e0 00:27:22.630 [2024-11-26 08:35:08.305324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:14555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.305355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.315583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f2d80 00:27:22.630 [2024-11-26 08:35:08.316049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22187 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.316080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.328193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.329371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:21576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.329403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.340612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.341811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.341839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.352927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.354194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:20814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.354225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.365537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.366737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.366765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.377915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.379136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:3427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.379164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.390418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.391638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.391669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.402821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.404066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:20981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.404108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.415334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.416583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:16046 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.416613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.427764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.429057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.429084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.440143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.441445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:7774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.441476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.452497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.453805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:15763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.453832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.465016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.466358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.466389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:22.630 [2024-11-26 08:35:08.477450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.630 [2024-11-26 08:35:08.478779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:22308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.630 [2024-11-26 08:35:08.478820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.489941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.890 [2024-11-26 08:35:08.491296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.491341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.502421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.890 [2024-11-26 08:35:08.503763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:4123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.503789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.514833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e8088 00:27:22.890 [2024-11-26 08:35:08.516219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.516264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.527292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f7da8 00:27:22.890 [2024-11-26 08:35:08.528674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:14128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.528726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.539807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e7818 00:27:22.890 [2024-11-26 08:35:08.541194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.541236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.552308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f6890 00:27:22.890 [2024-11-26 08:35:08.553700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:21682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.553731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.564753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190e23b8 00:27:22.890 [2024-11-26 08:35:08.566185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:18516 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.566216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.576805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f1430 00:27:22.890 [2024-11-26 08:35:08.578048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:20975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.578076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.589282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f31b8 00:27:22.890 [2024-11-26 08:35:08.590223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.890 [2024-11-26 08:35:08.590254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:22.890 [2024-11-26 08:35:08.601849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f31b8 00:27:22.891 [2024-11-26 08:35:08.603057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:7082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.891 [2024-11-26 08:35:08.603091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:22.891 [2024-11-26 08:35:08.614320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678ad0) with pdu=0x2000190f31b8 00:27:22.891 [2024-11-26 08:35:08.615091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:17386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:22.891 [2024-11-26 08:35:08.615134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:22.891 00:27:22.891 Latency(us) 00:27:22.891 [2024-11-26T07:35:08.751Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.891 [2024-11-26T07:35:08.751Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:22.891 nvme0n1 : 2.00 20518.70 80.15 0.00 0.00 6230.91 3058.35 14854.83 00:27:22.891 [2024-11-26T07:35:08.751Z] =================================================================================================================== 00:27:22.891 [2024-11-26T07:35:08.751Z] Total : 20518.70 80.15 0.00 0.00 6230.91 3058.35 14854.83 00:27:22.891 0 00:27:22.891 08:35:08 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:22.891 08:35:08 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:22.891 08:35:08 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:22.891 | .driver_specific 00:27:22.891 | .nvme_error 00:27:22.891 | .status_code 00:27:22.891 | .command_transient_transport_error' 00:27:22.891 08:35:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:23.150 08:35:08 -- host/digest.sh@71 -- # (( 161 > 0 )) 00:27:23.150 08:35:08 -- host/digest.sh@73 -- # killprocess 1075533 00:27:23.150 08:35:08 -- common/autotest_common.sh@936 -- # '[' -z 1075533 ']' 00:27:23.150 08:35:08 -- common/autotest_common.sh@940 -- # kill -0 1075533 00:27:23.150 08:35:08 -- common/autotest_common.sh@941 -- # uname 00:27:23.150 08:35:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:23.150 08:35:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1075533 00:27:23.150 08:35:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:23.150 08:35:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:23.150 08:35:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1075533' 00:27:23.150 killing process with pid 1075533 00:27:23.150 08:35:08 -- common/autotest_common.sh@955 -- # kill 1075533 00:27:23.150 Received shutdown signal, test time was about 2.000000 seconds 00:27:23.150 00:27:23.150 Latency(us) 00:27:23.150 [2024-11-26T07:35:09.010Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:23.150 [2024-11-26T07:35:09.010Z] =================================================================================================================== 00:27:23.150 [2024-11-26T07:35:09.010Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:23.150 08:35:08 -- common/autotest_common.sh@960 -- # wait 1075533 00:27:23.408 08:35:09 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:23.408 08:35:09 -- host/digest.sh@54 -- # local rw bs qd 00:27:23.408 08:35:09 -- host/digest.sh@56 -- # rw=randwrite 00:27:23.408 08:35:09 -- host/digest.sh@56 -- # bs=131072 00:27:23.408 08:35:09 -- host/digest.sh@56 -- # qd=16 00:27:23.408 08:35:09 -- host/digest.sh@58 -- # bperfpid=1076083 00:27:23.408 08:35:09 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:23.408 08:35:09 -- host/digest.sh@60 -- # waitforlisten 1076083 /var/tmp/bperf.sock 00:27:23.408 08:35:09 -- common/autotest_common.sh@829 -- # '[' -z 1076083 ']' 00:27:23.408 08:35:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:23.408 08:35:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:23.408 08:35:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:23.408 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:23.408 08:35:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:23.408 08:35:09 -- common/autotest_common.sh@10 -- # set +x 00:27:23.408 [2024-11-26 08:35:09.244525] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:23.408 [2024-11-26 08:35:09.244616] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1076083 ] 00:27:23.408 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:23.408 Zero copy mechanism will not be used. 00:27:23.739 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.739 [2024-11-26 08:35:09.307411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:23.739 [2024-11-26 08:35:09.423535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:24.699 08:35:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:24.699 08:35:10 -- common/autotest_common.sh@862 -- # return 0 00:27:24.699 08:35:10 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:24.699 08:35:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:24.699 08:35:10 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:24.699 08:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.699 08:35:10 -- common/autotest_common.sh@10 -- # set +x 00:27:24.699 08:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.699 08:35:10 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:24.699 08:35:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:25.267 nvme0n1 00:27:25.267 08:35:10 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:25.267 08:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.267 08:35:10 -- common/autotest_common.sh@10 -- # set +x 00:27:25.267 08:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.267 08:35:10 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:25.267 08:35:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:25.267 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:25.267 Zero copy mechanism will not be used. 00:27:25.267 Running I/O for 2 seconds... 00:27:25.267 [2024-11-26 08:35:11.048386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.048722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.048772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.054351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.054543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.054574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.061096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.061347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.061378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.067874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.068039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.068068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.073657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.073798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.073828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.079752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.079913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.079944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.085620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.085799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.085828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.091584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.091961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.092003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.097672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.097968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.097997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.103835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.103970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.104000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.109323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.109508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.109538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.267 [2024-11-26 08:35:11.116096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.267 [2024-11-26 08:35:11.116278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.267 [2024-11-26 08:35:11.116311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.122597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.122785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.122815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.128646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.128823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.128852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.134214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.134422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.134453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.141367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.141671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.141710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.147766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.148044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.148074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.153853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.154056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.154086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.159737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.159885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.159917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.165488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.165644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.165672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.171307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.171454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.171489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.176943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.177135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.177163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.182903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.183103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.183135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.188923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.189160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.189189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.194939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.195157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.195186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.200749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.200937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.528 [2024-11-26 08:35:11.200972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.528 [2024-11-26 08:35:11.206706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.528 [2024-11-26 08:35:11.206859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.206891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.212655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.212865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.212893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.218537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.218666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.218706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.224437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.224707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.224737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.230433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.230630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.230660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.236268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.236605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.236635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.242040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.242292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.242321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.247826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.247977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.248006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.253602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.253783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.253811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.259012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.259168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.259197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.264937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.265040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.265067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.270556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.270763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.270799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.276301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.276485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.276515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.282059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.282336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.282365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.287419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.287657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.287695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.292793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.293004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.293033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.298533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.298681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.298716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.304287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.304407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.304435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.310047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.310180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.310208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.315809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.316010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.316038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.321621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.321765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.321794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.327287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.327598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.327630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.332677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.529 [2024-11-26 08:35:11.332815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.529 [2024-11-26 08:35:11.332845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.529 [2024-11-26 08:35:11.338695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.338892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.338921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.344276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.344379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.344406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.349738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.349862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.349890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.355322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.355473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.355503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.361158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.361303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.361332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.366604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.366712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.366739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.372283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.372532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.372561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.530 [2024-11-26 08:35:11.377952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.530 [2024-11-26 08:35:11.378161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.530 [2024-11-26 08:35:11.378194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.790 [2024-11-26 08:35:11.383798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.790 [2024-11-26 08:35:11.383994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.790 [2024-11-26 08:35:11.384024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.790 [2024-11-26 08:35:11.389334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.790 [2024-11-26 08:35:11.389472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.790 [2024-11-26 08:35:11.389500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.790 [2024-11-26 08:35:11.394751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.790 [2024-11-26 08:35:11.394894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.790 [2024-11-26 08:35:11.394922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.790 [2024-11-26 08:35:11.400902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.790 [2024-11-26 08:35:11.401102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.790 [2024-11-26 08:35:11.401131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.790 [2024-11-26 08:35:11.406340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.406511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.406540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.412060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.412216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.412246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.418291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.418504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.418541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.423887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.424073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.424102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.429419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.429670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.429725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.434583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.434778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.434807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.440538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.440683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.440720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.446176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.446365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.446393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.451944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.452092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.452121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.457460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.457610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.457638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.462853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.463071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.463104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.468426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.468615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.468645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.473964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.474183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.474213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.479457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.479615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.479643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.484950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.485064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.485093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.490649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.490805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.490834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.496384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.496569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.496599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.502023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.502133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.502161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.507886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.508067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.508097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.513914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.514062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.514092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.520075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.520266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.791 [2024-11-26 08:35:11.520299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.791 [2024-11-26 08:35:11.525569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.791 [2024-11-26 08:35:11.525713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.525742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.531033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.531170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.531199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.536708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.536910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.536939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.542333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.542545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.542574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.548100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.548214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.548243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.553895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.554092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.554123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.559590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.559755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.559788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.565047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.565305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.565343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.570582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.570757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.570786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.576332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.576487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.576516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.581825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.581965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.581994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.587344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.587491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.587519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.592809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.592975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.593005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.598531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.598718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.598752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.603948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.604083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.604112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.609715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.609954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.609982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.615257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.615410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.615439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.620961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.621157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.621189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.626629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.626789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.626817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.632383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.632533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.632572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.792 [2024-11-26 08:35:11.638431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:25.792 [2024-11-26 08:35:11.638599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.792 [2024-11-26 08:35:11.638627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.645227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.645491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.645520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.652483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.652664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.652709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.658898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.659141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.659173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.665393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.665578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.665607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.671870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.672088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.672116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.678373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.678540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.678569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.685176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.685429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.685457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.691695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.691863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.691891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.698095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.698280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.698309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.704473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.704770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.704800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.711108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.711367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.711396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.717755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.718006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.718034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.724261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.724504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.724533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.731213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.731366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.731394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.737089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.737268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.737297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.743276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.743447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.743475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.749536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.749721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.749750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.755692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.755983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.756012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.762006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.762210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.762239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.767912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.768075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.768104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.774274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.774530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.774559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.780886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.781102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.781130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.787922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.788117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.788150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.794582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.794852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.794882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.800950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.801127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.801155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.807145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.807414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.053 [2024-11-26 08:35:11.807443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.053 [2024-11-26 08:35:11.814146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.053 [2024-11-26 08:35:11.814318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.814346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.820237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.820379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.820411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.826358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.826529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.826557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.832945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.833171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.833204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.839360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.839543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.839572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.845598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.845775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.845804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.852221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.852365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.852397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.858315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.858588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.858619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.864967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.865153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.865181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.871490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.871705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.871770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.877749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.877921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.877953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.883485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.883641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.883669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.890395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.890595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.890624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.896735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.896910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.896938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.054 [2024-11-26 08:35:11.903511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.054 [2024-11-26 08:35:11.903750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.054 [2024-11-26 08:35:11.903781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.909915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.910184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.910217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.916335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.916599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.916629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.922837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.923000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.923028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.929227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.929446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.929475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.935971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.936141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.936169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.942663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.942834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.942863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.949496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.949708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.949739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.956218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.956364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.956391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.962856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.963154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.963182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.968848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.969146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.969175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.975283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.975495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.975523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.982016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.982231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.982259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.988778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.988961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.988987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:11.995262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:11.995453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:11.995480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:12.001863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:12.002126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:12.002158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:12.008430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:12.008670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:12.008705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.314 [2024-11-26 08:35:12.015300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.314 [2024-11-26 08:35:12.015563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.314 [2024-11-26 08:35:12.015591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.021359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.021534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.021561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.027739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.027912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.027940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.033725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.033970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.033998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.040041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.040220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.040248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.045903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.046076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.046103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.052441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.052614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.052641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.058823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.059047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.059076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.065418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.065668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.065724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.071599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.071866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.071895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.077384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.077555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.077583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.083767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.083999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.084026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.090198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.090375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.090402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.096515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.096776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.096806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.102592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.102769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.102796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.109337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.109531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.109559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.115114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.115392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.115420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.120934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.121205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.121232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.126645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.126885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.126916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.133181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.133341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.133371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.139271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.139447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.139475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.146816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.146966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.146997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.153357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.153602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.153629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.159533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.159794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.159822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.315 [2024-11-26 08:35:12.165317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.315 [2024-11-26 08:35:12.165504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.315 [2024-11-26 08:35:12.165537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.171418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.171623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.171652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.177868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.178142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.178171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.184185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.184366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.184394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.190769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.190932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.190959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.197013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.197224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.197252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.203619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.203793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.203820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.210287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.210519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.210547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.217349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.217625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.217652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.224251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.224510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.224538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.230229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.230403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.230430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.236086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.236285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.236313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.242801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.242960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.242991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.248991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.249207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.249250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.254624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.254788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.254815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.261084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.576 [2024-11-26 08:35:12.261379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.576 [2024-11-26 08:35:12.261407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.576 [2024-11-26 08:35:12.267176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.267476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.267505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.273350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.273666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.273708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.279774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.279930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.279957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.286297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.286448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.286478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.293311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.293463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.293490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.299343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.299510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.299538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.305149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.305335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.305362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.311601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.311871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.311900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.317589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.317865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.317893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.323868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.324121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.324151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.330140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.330320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.330351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.336506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.336673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.336728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.342578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.342748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.342777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.348977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.349217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.349245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.355314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.355485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.355511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.361646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.361923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.361953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.367561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.367859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.367888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.373813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.374041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.374068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.379669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.379842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.379869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.385774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.385942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.385970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.392042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.392255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.392285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.398853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.399005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.399032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.405429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.405566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.405593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.411235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.411423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.411451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.417229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.417483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.417510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.422988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.423219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.423246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.577 [2024-11-26 08:35:12.429496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.577 [2024-11-26 08:35:12.429631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.577 [2024-11-26 08:35:12.429659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.435983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.436190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.436223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.442534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.442753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.442784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.448950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.449136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.449163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.454956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.455140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.455170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.461155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.461439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.461468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.467082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.467335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.467363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.473357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.473530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.473559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.479809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.479967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.480012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.486571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.486797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.486825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.492977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.493149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.493190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.499248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.499545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.499574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.505074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.505223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.505250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.511250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.511541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.511569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.517638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.517888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.517921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.523764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.523957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.523984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.529722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.530005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.530035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.535629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.535811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.535838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.541400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.541609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.541636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.547213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.547477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.547504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.553450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.553674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.553710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.559328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.838 [2024-11-26 08:35:12.559649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.838 [2024-11-26 08:35:12.559677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.838 [2024-11-26 08:35:12.565080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.565355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.565385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.571128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.571384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.571412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.577883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.578081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.578109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.584146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.584314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.584341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.590082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.590284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.590312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.595958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.596199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.596246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.602378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.602545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.602574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.608876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.609162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.609189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.614944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.615265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.615293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.621634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.621818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.621846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.627768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.627932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.627960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.634085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.634240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.634268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.640950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.641135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.641161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.647388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.647622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.647664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.653892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.654061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.654088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.660482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.660778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.660807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.667033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.667315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.667344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.673267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.673504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.673536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.678797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.678984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.679028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.684767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.684942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.684969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.839 [2024-11-26 08:35:12.690323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:26.839 [2024-11-26 08:35:12.690489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.839 [2024-11-26 08:35:12.690518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.099 [2024-11-26 08:35:12.696333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.696605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.696634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.702435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.702618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.702646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.708889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.709117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.709148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.715552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.715833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.715863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.721879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.722175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.722203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.728328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.728579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.728607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.734750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.734915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.734953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.740526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.740709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.740762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.746520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.746669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.746705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.752840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.753049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.753077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.759527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.759807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.759841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.765406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.765715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.765745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.771356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.771656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.771684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.777442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.777607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.777636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.784091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.784247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.784277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.790194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.790329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.790358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.796302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.796499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.796526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.802380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.802545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.802573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.808315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.808551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.808578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.814636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.814836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.814863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.820455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.820735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.820763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.826749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.826911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.826939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.833035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.833272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.833300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.839414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.839576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.839606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.845793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.845958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.846001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.852098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.852271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.852307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.100 [2024-11-26 08:35:12.858551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.100 [2024-11-26 08:35:12.858885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.100 [2024-11-26 08:35:12.858915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.864425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.864670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.864723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.870052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.870360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.870406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.876014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.876181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.876207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.881953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.882152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.882180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.888757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.888931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.888958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.894676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.894963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.894992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.900693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.900845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.900875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.906762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.906932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.906960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.912734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.913018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.913045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.918739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.918932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.918965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.924823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.924973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.925001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.930665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.930843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.930870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.937547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.937725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.937756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.943423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.943574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.943602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.101 [2024-11-26 08:35:12.949791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.101 [2024-11-26 08:35:12.950023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.101 [2024-11-26 08:35:12.950051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.956850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.957137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.957166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.963394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.963676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.963715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.969551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.969801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.969831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.975781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.975955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.975998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.981914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.982171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.982199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.988253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.988449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.988477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:12.994355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:12.994525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:12.994553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.000783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.001045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.001073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.006751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.007067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.007095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.013163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.013456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.013484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.019337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.019564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.019595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.025577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.025816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.025845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.031748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.031967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.031999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.037531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.037676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.037714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.360 [2024-11-26 08:35:13.043528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1678fb0) with pdu=0x2000190fef90 00:27:27.360 [2024-11-26 08:35:13.043751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.360 [2024-11-26 08:35:13.043779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.360 00:27:27.360 Latency(us) 00:27:27.360 [2024-11-26T07:35:13.220Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:27.360 [2024-11-26T07:35:13.220Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:27.360 nvme0n1 : 2.00 5048.46 631.06 0.00 0.00 3161.13 2245.21 8398.32 00:27:27.360 [2024-11-26T07:35:13.220Z] =================================================================================================================== 00:27:27.360 [2024-11-26T07:35:13.220Z] Total : 5048.46 631.06 0.00 0.00 3161.13 2245.21 8398.32 00:27:27.360 0 00:27:27.360 08:35:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:27.360 08:35:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:27.360 08:35:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:27.360 08:35:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:27.360 | .driver_specific 00:27:27.360 | .nvme_error 00:27:27.360 | .status_code 00:27:27.360 | .command_transient_transport_error' 00:27:27.619 08:35:13 -- host/digest.sh@71 -- # (( 326 > 0 )) 00:27:27.619 08:35:13 -- host/digest.sh@73 -- # killprocess 1076083 00:27:27.619 08:35:13 -- common/autotest_common.sh@936 -- # '[' -z 1076083 ']' 00:27:27.619 08:35:13 -- common/autotest_common.sh@940 -- # kill -0 1076083 00:27:27.619 08:35:13 -- common/autotest_common.sh@941 -- # uname 00:27:27.619 08:35:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:27.619 08:35:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1076083 00:27:27.619 08:35:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:27.619 08:35:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:27.619 08:35:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1076083' 00:27:27.619 killing process with pid 1076083 00:27:27.619 08:35:13 -- common/autotest_common.sh@955 -- # kill 1076083 00:27:27.619 Received shutdown signal, test time was about 2.000000 seconds 00:27:27.619 00:27:27.619 Latency(us) 00:27:27.619 [2024-11-26T07:35:13.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:27.619 [2024-11-26T07:35:13.479Z] =================================================================================================================== 00:27:27.619 [2024-11-26T07:35:13.479Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:27.619 08:35:13 -- common/autotest_common.sh@960 -- # wait 1076083 00:27:27.877 08:35:13 -- host/digest.sh@115 -- # killprocess 1074395 00:27:27.877 08:35:13 -- common/autotest_common.sh@936 -- # '[' -z 1074395 ']' 00:27:27.877 08:35:13 -- common/autotest_common.sh@940 -- # kill -0 1074395 00:27:27.877 08:35:13 -- common/autotest_common.sh@941 -- # uname 00:27:27.877 08:35:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:27.877 08:35:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1074395 00:27:27.877 08:35:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:27.877 08:35:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:27.877 08:35:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1074395' 00:27:27.877 killing process with pid 1074395 00:27:27.877 08:35:13 -- common/autotest_common.sh@955 -- # kill 1074395 00:27:27.877 08:35:13 -- common/autotest_common.sh@960 -- # wait 1074395 00:27:28.136 00:27:28.136 real 0m18.443s 00:27:28.136 user 0m37.799s 00:27:28.136 sys 0m4.300s 00:27:28.136 08:35:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:28.136 08:35:13 -- common/autotest_common.sh@10 -- # set +x 00:27:28.136 ************************************ 00:27:28.136 END TEST nvmf_digest_error 00:27:28.136 ************************************ 00:27:28.136 08:35:13 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:28.136 08:35:13 -- host/digest.sh@139 -- # nvmftestfini 00:27:28.136 08:35:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:28.136 08:35:13 -- nvmf/common.sh@116 -- # sync 00:27:28.136 08:35:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:28.136 08:35:13 -- nvmf/common.sh@119 -- # set +e 00:27:28.136 08:35:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:28.136 08:35:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:28.136 rmmod nvme_tcp 00:27:28.136 rmmod nvme_fabrics 00:27:28.136 rmmod nvme_keyring 00:27:28.136 08:35:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:28.136 08:35:13 -- nvmf/common.sh@123 -- # set -e 00:27:28.136 08:35:13 -- nvmf/common.sh@124 -- # return 0 00:27:28.136 08:35:13 -- nvmf/common.sh@477 -- # '[' -n 1074395 ']' 00:27:28.136 08:35:13 -- nvmf/common.sh@478 -- # killprocess 1074395 00:27:28.136 08:35:13 -- common/autotest_common.sh@936 -- # '[' -z 1074395 ']' 00:27:28.136 08:35:13 -- common/autotest_common.sh@940 -- # kill -0 1074395 00:27:28.136 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1074395) - No such process 00:27:28.136 08:35:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1074395 is not found' 00:27:28.136 Process with pid 1074395 is not found 00:27:28.136 08:35:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:28.136 08:35:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:28.136 08:35:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:28.136 08:35:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:28.136 08:35:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:28.136 08:35:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:28.136 08:35:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:28.136 08:35:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:30.674 08:35:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:30.674 00:27:30.674 real 0m38.612s 00:27:30.674 user 1m9.264s 00:27:30.674 sys 0m10.296s 00:27:30.674 08:35:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:30.674 08:35:16 -- common/autotest_common.sh@10 -- # set +x 00:27:30.674 ************************************ 00:27:30.674 END TEST nvmf_digest 00:27:30.674 ************************************ 00:27:30.674 08:35:16 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:30.674 08:35:16 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:30.674 08:35:16 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:30.674 08:35:16 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:30.674 08:35:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:30.674 08:35:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:30.674 08:35:16 -- common/autotest_common.sh@10 -- # set +x 00:27:30.674 ************************************ 00:27:30.674 START TEST nvmf_bdevperf 00:27:30.674 ************************************ 00:27:30.674 08:35:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:30.674 * Looking for test storage... 00:27:30.674 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:30.674 08:35:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:30.674 08:35:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:30.674 08:35:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:30.674 08:35:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:30.674 08:35:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:30.674 08:35:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:30.674 08:35:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:30.674 08:35:16 -- scripts/common.sh@335 -- # IFS=.-: 00:27:30.674 08:35:16 -- scripts/common.sh@335 -- # read -ra ver1 00:27:30.674 08:35:16 -- scripts/common.sh@336 -- # IFS=.-: 00:27:30.674 08:35:16 -- scripts/common.sh@336 -- # read -ra ver2 00:27:30.674 08:35:16 -- scripts/common.sh@337 -- # local 'op=<' 00:27:30.674 08:35:16 -- scripts/common.sh@339 -- # ver1_l=2 00:27:30.674 08:35:16 -- scripts/common.sh@340 -- # ver2_l=1 00:27:30.674 08:35:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:30.674 08:35:16 -- scripts/common.sh@343 -- # case "$op" in 00:27:30.674 08:35:16 -- scripts/common.sh@344 -- # : 1 00:27:30.674 08:35:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:30.674 08:35:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:30.674 08:35:16 -- scripts/common.sh@364 -- # decimal 1 00:27:30.674 08:35:16 -- scripts/common.sh@352 -- # local d=1 00:27:30.674 08:35:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:30.674 08:35:16 -- scripts/common.sh@354 -- # echo 1 00:27:30.674 08:35:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:30.674 08:35:16 -- scripts/common.sh@365 -- # decimal 2 00:27:30.674 08:35:16 -- scripts/common.sh@352 -- # local d=2 00:27:30.674 08:35:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:30.674 08:35:16 -- scripts/common.sh@354 -- # echo 2 00:27:30.674 08:35:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:30.674 08:35:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:30.674 08:35:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:30.674 08:35:16 -- scripts/common.sh@367 -- # return 0 00:27:30.674 08:35:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:30.674 08:35:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:30.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:30.674 --rc genhtml_branch_coverage=1 00:27:30.674 --rc genhtml_function_coverage=1 00:27:30.674 --rc genhtml_legend=1 00:27:30.674 --rc geninfo_all_blocks=1 00:27:30.674 --rc geninfo_unexecuted_blocks=1 00:27:30.674 00:27:30.674 ' 00:27:30.674 08:35:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:30.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:30.674 --rc genhtml_branch_coverage=1 00:27:30.674 --rc genhtml_function_coverage=1 00:27:30.674 --rc genhtml_legend=1 00:27:30.674 --rc geninfo_all_blocks=1 00:27:30.674 --rc geninfo_unexecuted_blocks=1 00:27:30.674 00:27:30.674 ' 00:27:30.675 08:35:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:30.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:30.675 --rc genhtml_branch_coverage=1 00:27:30.675 --rc genhtml_function_coverage=1 00:27:30.675 --rc genhtml_legend=1 00:27:30.675 --rc geninfo_all_blocks=1 00:27:30.675 --rc geninfo_unexecuted_blocks=1 00:27:30.675 00:27:30.675 ' 00:27:30.675 08:35:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:30.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:30.675 --rc genhtml_branch_coverage=1 00:27:30.675 --rc genhtml_function_coverage=1 00:27:30.675 --rc genhtml_legend=1 00:27:30.675 --rc geninfo_all_blocks=1 00:27:30.675 --rc geninfo_unexecuted_blocks=1 00:27:30.675 00:27:30.675 ' 00:27:30.675 08:35:16 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:30.675 08:35:16 -- nvmf/common.sh@7 -- # uname -s 00:27:30.675 08:35:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:30.675 08:35:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:30.675 08:35:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:30.675 08:35:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:30.675 08:35:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:30.675 08:35:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:30.675 08:35:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:30.675 08:35:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:30.675 08:35:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:30.675 08:35:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:30.675 08:35:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:30.675 08:35:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:30.675 08:35:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:30.675 08:35:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:30.675 08:35:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:30.675 08:35:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:30.675 08:35:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:30.675 08:35:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:30.675 08:35:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:30.675 08:35:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:30.675 08:35:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:30.675 08:35:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:30.675 08:35:16 -- paths/export.sh@5 -- # export PATH 00:27:30.675 08:35:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:30.675 08:35:16 -- nvmf/common.sh@46 -- # : 0 00:27:30.675 08:35:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:30.675 08:35:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:30.675 08:35:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:30.675 08:35:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:30.675 08:35:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:30.675 08:35:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:30.675 08:35:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:30.675 08:35:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:30.675 08:35:16 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:30.675 08:35:16 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:30.675 08:35:16 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:30.675 08:35:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:30.675 08:35:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:30.675 08:35:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:30.675 08:35:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:30.675 08:35:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:30.675 08:35:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:30.675 08:35:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:30.675 08:35:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:30.675 08:35:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:30.675 08:35:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:30.675 08:35:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:30.675 08:35:16 -- common/autotest_common.sh@10 -- # set +x 00:27:32.581 08:35:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:32.581 08:35:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:32.581 08:35:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:32.581 08:35:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:32.581 08:35:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:32.581 08:35:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:32.581 08:35:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:32.581 08:35:18 -- nvmf/common.sh@294 -- # net_devs=() 00:27:32.581 08:35:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:32.581 08:35:18 -- nvmf/common.sh@295 -- # e810=() 00:27:32.581 08:35:18 -- nvmf/common.sh@295 -- # local -ga e810 00:27:32.581 08:35:18 -- nvmf/common.sh@296 -- # x722=() 00:27:32.581 08:35:18 -- nvmf/common.sh@296 -- # local -ga x722 00:27:32.581 08:35:18 -- nvmf/common.sh@297 -- # mlx=() 00:27:32.581 08:35:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:32.581 08:35:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:32.581 08:35:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:32.581 08:35:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:32.581 08:35:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:32.581 08:35:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:32.581 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:32.581 08:35:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:32.581 08:35:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:32.581 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:32.581 08:35:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:32.581 08:35:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:32.581 08:35:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:32.581 08:35:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:32.581 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:32.581 08:35:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:32.581 08:35:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:32.581 08:35:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:32.581 08:35:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:32.581 08:35:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:32.581 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:32.581 08:35:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:32.581 08:35:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:32.581 08:35:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:32.581 08:35:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:32.581 08:35:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:32.581 08:35:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:32.581 08:35:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:32.581 08:35:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:32.581 08:35:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:32.581 08:35:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:32.581 08:35:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:32.581 08:35:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:32.581 08:35:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:32.581 08:35:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:32.581 08:35:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:32.581 08:35:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:32.581 08:35:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:32.581 08:35:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:32.581 08:35:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:32.581 08:35:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:32.581 08:35:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:32.581 08:35:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:32.581 08:35:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:32.581 08:35:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:32.581 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:32.581 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:27:32.581 00:27:32.581 --- 10.0.0.2 ping statistics --- 00:27:32.581 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:32.581 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:27:32.581 08:35:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:32.581 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:32.581 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:27:32.581 00:27:32.581 --- 10.0.0.1 ping statistics --- 00:27:32.581 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:32.582 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:27:32.582 08:35:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:32.582 08:35:18 -- nvmf/common.sh@410 -- # return 0 00:27:32.582 08:35:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:32.582 08:35:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:32.582 08:35:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:32.582 08:35:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:32.582 08:35:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:32.582 08:35:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:32.582 08:35:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:32.582 08:35:18 -- host/bdevperf.sh@25 -- # tgt_init 00:27:32.582 08:35:18 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:32.582 08:35:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:32.582 08:35:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:32.582 08:35:18 -- common/autotest_common.sh@10 -- # set +x 00:27:32.582 08:35:18 -- nvmf/common.sh@469 -- # nvmfpid=1078596 00:27:32.582 08:35:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:32.582 08:35:18 -- nvmf/common.sh@470 -- # waitforlisten 1078596 00:27:32.582 08:35:18 -- common/autotest_common.sh@829 -- # '[' -z 1078596 ']' 00:27:32.582 08:35:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:32.582 08:35:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:32.582 08:35:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:32.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:32.582 08:35:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:32.582 08:35:18 -- common/autotest_common.sh@10 -- # set +x 00:27:32.582 [2024-11-26 08:35:18.431571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:32.582 [2024-11-26 08:35:18.431676] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:32.841 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.841 [2024-11-26 08:35:18.495137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:32.841 [2024-11-26 08:35:18.600519] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:32.841 [2024-11-26 08:35:18.600700] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:32.841 [2024-11-26 08:35:18.600717] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:32.841 [2024-11-26 08:35:18.600729] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:32.841 [2024-11-26 08:35:18.600846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:32.841 [2024-11-26 08:35:18.600898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:32.841 [2024-11-26 08:35:18.600902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:33.776 08:35:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:33.776 08:35:19 -- common/autotest_common.sh@862 -- # return 0 00:27:33.776 08:35:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:33.776 08:35:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 08:35:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:33.776 08:35:19 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:33.776 08:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 [2024-11-26 08:35:19.432861] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:33.776 08:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.776 08:35:19 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:33.776 08:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 Malloc0 00:27:33.776 08:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.776 08:35:19 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:33.776 08:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 08:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.776 08:35:19 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:33.776 08:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 08:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.776 08:35:19 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:33.776 08:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:33.776 08:35:19 -- common/autotest_common.sh@10 -- # set +x 00:27:33.776 [2024-11-26 08:35:19.495860] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:33.776 08:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:33.776 08:35:19 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:33.776 08:35:19 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:33.776 08:35:19 -- nvmf/common.sh@520 -- # config=() 00:27:33.776 08:35:19 -- nvmf/common.sh@520 -- # local subsystem config 00:27:33.776 08:35:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:33.776 08:35:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:33.776 { 00:27:33.776 "params": { 00:27:33.776 "name": "Nvme$subsystem", 00:27:33.776 "trtype": "$TEST_TRANSPORT", 00:27:33.776 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:33.776 "adrfam": "ipv4", 00:27:33.776 "trsvcid": "$NVMF_PORT", 00:27:33.776 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:33.776 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:33.776 "hdgst": ${hdgst:-false}, 00:27:33.776 "ddgst": ${ddgst:-false} 00:27:33.776 }, 00:27:33.776 "method": "bdev_nvme_attach_controller" 00:27:33.776 } 00:27:33.776 EOF 00:27:33.776 )") 00:27:33.776 08:35:19 -- nvmf/common.sh@542 -- # cat 00:27:33.776 08:35:19 -- nvmf/common.sh@544 -- # jq . 00:27:33.776 08:35:19 -- nvmf/common.sh@545 -- # IFS=, 00:27:33.776 08:35:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:33.776 "params": { 00:27:33.776 "name": "Nvme1", 00:27:33.776 "trtype": "tcp", 00:27:33.776 "traddr": "10.0.0.2", 00:27:33.776 "adrfam": "ipv4", 00:27:33.776 "trsvcid": "4420", 00:27:33.776 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:33.776 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:33.776 "hdgst": false, 00:27:33.776 "ddgst": false 00:27:33.776 }, 00:27:33.776 "method": "bdev_nvme_attach_controller" 00:27:33.776 }' 00:27:33.776 [2024-11-26 08:35:19.540705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:33.776 [2024-11-26 08:35:19.540774] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078756 ] 00:27:33.776 EAL: No free 2048 kB hugepages reported on node 1 00:27:33.776 [2024-11-26 08:35:19.600515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:34.035 [2024-11-26 08:35:19.710055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:34.295 Running I/O for 1 seconds... 00:27:35.229 00:27:35.229 Latency(us) 00:27:35.229 [2024-11-26T07:35:21.089Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:35.229 [2024-11-26T07:35:21.089Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:35.229 Verification LBA range: start 0x0 length 0x4000 00:27:35.229 Nvme1n1 : 1.01 12078.60 47.18 0.00 0.00 10552.72 1231.83 15049.01 00:27:35.229 [2024-11-26T07:35:21.089Z] =================================================================================================================== 00:27:35.229 [2024-11-26T07:35:21.089Z] Total : 12078.60 47.18 0.00 0.00 10552.72 1231.83 15049.01 00:27:35.487 08:35:21 -- host/bdevperf.sh@30 -- # bdevperfpid=1078923 00:27:35.487 08:35:21 -- host/bdevperf.sh@32 -- # sleep 3 00:27:35.487 08:35:21 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:35.487 08:35:21 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:35.487 08:35:21 -- nvmf/common.sh@520 -- # config=() 00:27:35.487 08:35:21 -- nvmf/common.sh@520 -- # local subsystem config 00:27:35.487 08:35:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:35.487 08:35:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:35.487 { 00:27:35.487 "params": { 00:27:35.487 "name": "Nvme$subsystem", 00:27:35.487 "trtype": "$TEST_TRANSPORT", 00:27:35.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:35.487 "adrfam": "ipv4", 00:27:35.487 "trsvcid": "$NVMF_PORT", 00:27:35.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:35.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:35.487 "hdgst": ${hdgst:-false}, 00:27:35.487 "ddgst": ${ddgst:-false} 00:27:35.487 }, 00:27:35.487 "method": "bdev_nvme_attach_controller" 00:27:35.487 } 00:27:35.487 EOF 00:27:35.487 )") 00:27:35.487 08:35:21 -- nvmf/common.sh@542 -- # cat 00:27:35.487 08:35:21 -- nvmf/common.sh@544 -- # jq . 00:27:35.487 08:35:21 -- nvmf/common.sh@545 -- # IFS=, 00:27:35.487 08:35:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:35.487 "params": { 00:27:35.487 "name": "Nvme1", 00:27:35.487 "trtype": "tcp", 00:27:35.487 "traddr": "10.0.0.2", 00:27:35.487 "adrfam": "ipv4", 00:27:35.487 "trsvcid": "4420", 00:27:35.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:35.487 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:35.487 "hdgst": false, 00:27:35.487 "ddgst": false 00:27:35.487 }, 00:27:35.487 "method": "bdev_nvme_attach_controller" 00:27:35.487 }' 00:27:35.747 [2024-11-26 08:35:21.370062] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:35.747 [2024-11-26 08:35:21.370156] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078923 ] 00:27:35.747 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.747 [2024-11-26 08:35:21.431947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:35.747 [2024-11-26 08:35:21.540018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:36.005 Running I/O for 15 seconds... 00:27:38.534 08:35:24 -- host/bdevperf.sh@33 -- # kill -9 1078596 00:27:38.534 08:35:24 -- host/bdevperf.sh@35 -- # sleep 3 00:27:38.534 [2024-11-26 08:35:24.340416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:6152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.534 [2024-11-26 08:35:24.340873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.534 [2024-11-26 08:35:24.340888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.340902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.340918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.340936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.340953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.340994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:6936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:6944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:7000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:7008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:7016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:7024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:7032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.535 [2024-11-26 08:35:24.341706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.535 [2024-11-26 08:35:24.341753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.341956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.341987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:7064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:7072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.535 [2024-11-26 08:35:24.342211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.535 [2024-11-26 08:35:24.342228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:6656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:7080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:7088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:7104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:7112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:7128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:7136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:7152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:7160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:7168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:7176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:7184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:7192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:7200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.342940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.342955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:7208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.342985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:7224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:7232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:7240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:7248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:7256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:7264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:7288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:7296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:7304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:7312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:7320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.536 [2024-11-26 08:35:24.343479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:7336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.536 [2024-11-26 08:35:24.343528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:7344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.536 [2024-11-26 08:35:24.343543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:7352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:7360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:6752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.343973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:6816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.343989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:6840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:6848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:6864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:7368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:7392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.537 [2024-11-26 08:35:24.344275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:7400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.537 [2024-11-26 08:35:24.344306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:7408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.537 [2024-11-26 08:35:24.344342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:7416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.537 [2024-11-26 08:35:24.344373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:7432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:38.537 [2024-11-26 08:35:24.344465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:6872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:6976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:38.537 [2024-11-26 08:35:24.344678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13dc740 is same with the state(5) to be set 00:27:38.537 [2024-11-26 08:35:24.344742] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:38.537 [2024-11-26 08:35:24.344754] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:38.537 [2024-11-26 08:35:24.344766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6992 len:8 PRP1 0x0 PRP2 0x0 00:27:38.537 [2024-11-26 08:35:24.344779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:38.537 [2024-11-26 08:35:24.344844] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13dc740 was disconnected and freed. reset controller. 00:27:38.537 [2024-11-26 08:35:24.347336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.537 [2024-11-26 08:35:24.347412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.537 [2024-11-26 08:35:24.348020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.537 [2024-11-26 08:35:24.348191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.537 [2024-11-26 08:35:24.348219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.538 [2024-11-26 08:35:24.348237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.538 [2024-11-26 08:35:24.348458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.538 [2024-11-26 08:35:24.348628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.538 [2024-11-26 08:35:24.348651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.538 [2024-11-26 08:35:24.348680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.538 [2024-11-26 08:35:24.351195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.538 [2024-11-26 08:35:24.360171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.538 [2024-11-26 08:35:24.360489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.360645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.360674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.538 [2024-11-26 08:35:24.360703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.538 [2024-11-26 08:35:24.360871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.538 [2024-11-26 08:35:24.361023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.538 [2024-11-26 08:35:24.361047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.538 [2024-11-26 08:35:24.361062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.538 [2024-11-26 08:35:24.363408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.538 [2024-11-26 08:35:24.372580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.538 [2024-11-26 08:35:24.372927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.373091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.373117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.538 [2024-11-26 08:35:24.373133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.538 [2024-11-26 08:35:24.373317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.538 [2024-11-26 08:35:24.373506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.538 [2024-11-26 08:35:24.373530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.538 [2024-11-26 08:35:24.373545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.538 [2024-11-26 08:35:24.376151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.538 [2024-11-26 08:35:24.385342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.538 [2024-11-26 08:35:24.385667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.385838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.538 [2024-11-26 08:35:24.385867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.538 [2024-11-26 08:35:24.385884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.538 [2024-11-26 08:35:24.386014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.538 [2024-11-26 08:35:24.386220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.538 [2024-11-26 08:35:24.386243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.538 [2024-11-26 08:35:24.386258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.388553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.397804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.398140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.398311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.398340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.398357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.398521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.398721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.398746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.398761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.400956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.410295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.410620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.410768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.410810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.410826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.411037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.411240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.411264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.411280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.413513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.422681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.423079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.423340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.423369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.423386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.423569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.423788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.423812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.423827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.426343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.435051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.435367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.435507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.435534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.435549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.435787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.435941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.435964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.435979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.438388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.447488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.447806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.447961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.447990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.448007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.448190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.448395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.448424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.448440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.796 [2024-11-26 08:35:24.450639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.796 [2024-11-26 08:35:24.460109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.796 [2024-11-26 08:35:24.460466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.460613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.796 [2024-11-26 08:35:24.460641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.796 [2024-11-26 08:35:24.460659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.796 [2024-11-26 08:35:24.460853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.796 [2024-11-26 08:35:24.461023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.796 [2024-11-26 08:35:24.461046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.796 [2024-11-26 08:35:24.461061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.463204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.472763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.473092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.473241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.473270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.473287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.473469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.473638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.473661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.473677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.475955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.485374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.485669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.485802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.485831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.485848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.485994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.486199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.486223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.486244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.488567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.497856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.498175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.498319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.498344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.498360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.498521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.498672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.498705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.498721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.500969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.510468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.510738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.510971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.511030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.511047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.511248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.511417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.511440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.511455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.514074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.523109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.523474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.523609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.523634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.523650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.523776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.523987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.524010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.524026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.526514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.535695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.536018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.536128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.536154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.536169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.536314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.536521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.536545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.536560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.539250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.548319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.548627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.548811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.548837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.548852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.548984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.549170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.549193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.549208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.551495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.561032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.561377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.561534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.561563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.561580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.561757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.561927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.561950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.561965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.564395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.573777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.574035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.574234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.574259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.797 [2024-11-26 08:35:24.574274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.797 [2024-11-26 08:35:24.574477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.797 [2024-11-26 08:35:24.574642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.797 [2024-11-26 08:35:24.574665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.797 [2024-11-26 08:35:24.574681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.797 [2024-11-26 08:35:24.577305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.797 [2024-11-26 08:35:24.586399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.797 [2024-11-26 08:35:24.586747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.797 [2024-11-26 08:35:24.587000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.587053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.587070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.587271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.587460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.587483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.587499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.798 [2024-11-26 08:35:24.589723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.798 [2024-11-26 08:35:24.599017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.798 [2024-11-26 08:35:24.599294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.599467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.599496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.599513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.599725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.599913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.599936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.599952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.798 [2024-11-26 08:35:24.602219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.798 [2024-11-26 08:35:24.611505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.798 [2024-11-26 08:35:24.611823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.611976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.612005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.612023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.612242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.612411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.612434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.612450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.798 [2024-11-26 08:35:24.614627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.798 [2024-11-26 08:35:24.623965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.798 [2024-11-26 08:35:24.624307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.624483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.624508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.624523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.624744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.624896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.624919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.624934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.798 [2024-11-26 08:35:24.627274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.798 [2024-11-26 08:35:24.636502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.798 [2024-11-26 08:35:24.636752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.636925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.636953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.636970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.637189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.637395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.637417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.637432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.798 [2024-11-26 08:35:24.639794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.798 [2024-11-26 08:35:24.649189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.798 [2024-11-26 08:35:24.649529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.649645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.798 [2024-11-26 08:35:24.649699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:38.798 [2024-11-26 08:35:24.649718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:38.798 [2024-11-26 08:35:24.649882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:38.798 [2024-11-26 08:35:24.649993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.798 [2024-11-26 08:35:24.650016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.798 [2024-11-26 08:35:24.650031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.059 [2024-11-26 08:35:24.652270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.059 [2024-11-26 08:35:24.661787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.059 [2024-11-26 08:35:24.662084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.662247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.662273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.059 [2024-11-26 08:35:24.662288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.059 [2024-11-26 08:35:24.662431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.059 [2024-11-26 08:35:24.662582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.059 [2024-11-26 08:35:24.662605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.059 [2024-11-26 08:35:24.662620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.059 [2024-11-26 08:35:24.664969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.059 [2024-11-26 08:35:24.674438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.059 [2024-11-26 08:35:24.674751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.674908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.674937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.059 [2024-11-26 08:35:24.674954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.059 [2024-11-26 08:35:24.675100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.059 [2024-11-26 08:35:24.675269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.059 [2024-11-26 08:35:24.675292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.059 [2024-11-26 08:35:24.675307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.059 [2024-11-26 08:35:24.677691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.059 [2024-11-26 08:35:24.687150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.059 [2024-11-26 08:35:24.687443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.687613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.059 [2024-11-26 08:35:24.687642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.059 [2024-11-26 08:35:24.687669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.059 [2024-11-26 08:35:24.687827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.059 [2024-11-26 08:35:24.688015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.059 [2024-11-26 08:35:24.688038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.059 [2024-11-26 08:35:24.688053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.059 [2024-11-26 08:35:24.690537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.059 [2024-11-26 08:35:24.699639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.700371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.700509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.700539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.700557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.700784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.700974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.701008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.701022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.703281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.712236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.712534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.712692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.712737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.712754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.712951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.713086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.713109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.713124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.715245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.724794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.725199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.725341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.725387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.725404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.725556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.725766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.725802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.725816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.728245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.737482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.737848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.738110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.738163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.738180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.738362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.738532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.738555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.738571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.740759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.750109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.750391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.750537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.750565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.750583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.750742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.750930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.750954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.750969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.753343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.762717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.763073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.763273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.763302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.763319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.763501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.763677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.763709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.763725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.766174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.775270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.775620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.775772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.775799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.775815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.776046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.776199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.776222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.776237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.778505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.787903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.788316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.788522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.788550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.788567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.788760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.788948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.788972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.788995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.791370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.800471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.800896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.801081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.801110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.801127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.060 [2024-11-26 08:35:24.801273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.060 [2024-11-26 08:35:24.801425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.060 [2024-11-26 08:35:24.801453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.060 [2024-11-26 08:35:24.801469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.060 [2024-11-26 08:35:24.803731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.060 [2024-11-26 08:35:24.813058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.060 [2024-11-26 08:35:24.813425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.813547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.060 [2024-11-26 08:35:24.813576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.060 [2024-11-26 08:35:24.813593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.813749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.813883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.813906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.813921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.816352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.825557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.825828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.825998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.826026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.826044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.826227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.826378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.826402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.826417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.828765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.838066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.838402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.838563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.838588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.838604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.838810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.838981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.839004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.839025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.841364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.850650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.850993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.851129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.851154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.851170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.851345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.851514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.851537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.851553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.854030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.863270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.863595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.863740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.863769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.863785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.863931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.864118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.864142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.864157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.866511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.875840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.876216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.876353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.876394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.876411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.876539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.876718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.876742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.876757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.879144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.888524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.888862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.889027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.889083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.889100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.889247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.889434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.889458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.889472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.891750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.061 [2024-11-26 08:35:24.901126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.061 [2024-11-26 08:35:24.901439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.901559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.061 [2024-11-26 08:35:24.901587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.061 [2024-11-26 08:35:24.901605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.061 [2024-11-26 08:35:24.901782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.061 [2024-11-26 08:35:24.901970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.061 [2024-11-26 08:35:24.901993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.061 [2024-11-26 08:35:24.902008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.061 [2024-11-26 08:35:24.904277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.324 [2024-11-26 08:35:24.913548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.324 [2024-11-26 08:35:24.913868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.914010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.914038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.324 [2024-11-26 08:35:24.914056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.324 [2024-11-26 08:35:24.914185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.324 [2024-11-26 08:35:24.914318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.324 [2024-11-26 08:35:24.914341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.324 [2024-11-26 08:35:24.914357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.324 [2024-11-26 08:35:24.916871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.324 [2024-11-26 08:35:24.926164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.324 [2024-11-26 08:35:24.926579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.926814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.926844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.324 [2024-11-26 08:35:24.926862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.324 [2024-11-26 08:35:24.927008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.324 [2024-11-26 08:35:24.927195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.324 [2024-11-26 08:35:24.927218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.324 [2024-11-26 08:35:24.927233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.324 [2024-11-26 08:35:24.929573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.324 [2024-11-26 08:35:24.938764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.324 [2024-11-26 08:35:24.939086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.939240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.939292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.324 [2024-11-26 08:35:24.939309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.324 [2024-11-26 08:35:24.939492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.324 [2024-11-26 08:35:24.939642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.324 [2024-11-26 08:35:24.939665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.324 [2024-11-26 08:35:24.939680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.324 [2024-11-26 08:35:24.942068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.324 [2024-11-26 08:35:24.951428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.324 [2024-11-26 08:35:24.951754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.951895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.951924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.324 [2024-11-26 08:35:24.951941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.324 [2024-11-26 08:35:24.952105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.324 [2024-11-26 08:35:24.952220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.324 [2024-11-26 08:35:24.952243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.324 [2024-11-26 08:35:24.952258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.324 [2024-11-26 08:35:24.954638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.324 [2024-11-26 08:35:24.964203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.324 [2024-11-26 08:35:24.964680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.964941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.324 [2024-11-26 08:35:24.964992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.324 [2024-11-26 08:35:24.965009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.324 [2024-11-26 08:35:24.965155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.324 [2024-11-26 08:35:24.965324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:24.965347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:24.965363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:24.967614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:24.976732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:24.977051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:24.977273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:24.977301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:24.977318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:24.977501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:24.977670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:24.977704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:24.977722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:24.979993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:24.989237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:24.989586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:24.989742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:24.989771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:24.989787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:24.989916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:24.990067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:24.990090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:24.990106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:24.992408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.001921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.002236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.002417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.002452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.002470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.002653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.002779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.002803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.002819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.005126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.014418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.014707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.014905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.014931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.014949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.015171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.015332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.015356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.015371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.017675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.027149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.027497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.027650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.027676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.027699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.027881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.028030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.028053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.028069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.030373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.039443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.039790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.039934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.039963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.039987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.040171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.040341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.040364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.040379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.042662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.052156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.052451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.052583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.052612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.052630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.052826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.052978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.053001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.053016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.055325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.064710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.065009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.065206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.065232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.065247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.065443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.065613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.065636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.065651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.067876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.077323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.325 [2024-11-26 08:35:25.077729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.077949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.325 [2024-11-26 08:35:25.078001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.325 [2024-11-26 08:35:25.078018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.325 [2024-11-26 08:35:25.078189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.325 [2024-11-26 08:35:25.078340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.325 [2024-11-26 08:35:25.078363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.325 [2024-11-26 08:35:25.078377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.325 [2024-11-26 08:35:25.080560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.325 [2024-11-26 08:35:25.089745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.090102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.090251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.090280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.090298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.090480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.090650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.090673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.090700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.093058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.102467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.102784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.102911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.102940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.102957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.103123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.103291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.103315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.103330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.105733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.115098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.115459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.115606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.115634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.115651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.115820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.116034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.116058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.116073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.118449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.127683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.128202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.128231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.128248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.128395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.128565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.128587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.128602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.130828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.140289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.140607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.140762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.140792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.140809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.140956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.141126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.141149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.141164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.143557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.152817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.153170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.153343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.153391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.153409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.153591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.153736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.153772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.153788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.156129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.326 [2024-11-26 08:35:25.165420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.326 [2024-11-26 08:35:25.165695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.165842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.326 [2024-11-26 08:35:25.165871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.326 [2024-11-26 08:35:25.165888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.326 [2024-11-26 08:35:25.166053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.326 [2024-11-26 08:35:25.166204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.326 [2024-11-26 08:35:25.166227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.326 [2024-11-26 08:35:25.166241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.326 [2024-11-26 08:35:25.168675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.177978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.178261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.178421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.178449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.178467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.178631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.178800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.178824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.178840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.181107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.190656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.191001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.191169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.191198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.191215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.191397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.191549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.191572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.191593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.193856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.203157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.203479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.203639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.203664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.203679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.203885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.204109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.204133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.204147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.206378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.215821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.216166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.216313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.216341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.216358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.216541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.216725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.216749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.216764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.219122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.228393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.228707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.228859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.228887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.228904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.229051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.229166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.229189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.229205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.231587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.589 [2024-11-26 08:35:25.240963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.589 [2024-11-26 08:35:25.241311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.241429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.589 [2024-11-26 08:35:25.241457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.589 [2024-11-26 08:35:25.241475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.589 [2024-11-26 08:35:25.241676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.589 [2024-11-26 08:35:25.241892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.589 [2024-11-26 08:35:25.241917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.589 [2024-11-26 08:35:25.241932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.589 [2024-11-26 08:35:25.244291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.253392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.253697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.253823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.253851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.253869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.254033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.254166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.254189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.254205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.256459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.265740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.266049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.266222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.266251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.266268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.266432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.266601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.266625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.266640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.269012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.278592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.278922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.279063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.279089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.279104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.279245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.279397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.279421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.279436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.281922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.291348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.291706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.291849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.291874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.291889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.292077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.292303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.292327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.292342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.294829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.304039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.304371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.304529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.304558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.304575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.304752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.304905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.304928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.304943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.307084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.316593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.316943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.317088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.317118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.317135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.317300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.317506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.317530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.317545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.319663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.329216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.329553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.329669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.329717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.329733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.329882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.330112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.330136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.330152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.332581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.341608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.341953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.342112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.342137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.342153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.342309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.342497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.342520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.342535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.590 [2024-11-26 08:35:25.344902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.590 [2024-11-26 08:35:25.354317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.590 [2024-11-26 08:35:25.354682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.354869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.590 [2024-11-26 08:35:25.354894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.590 [2024-11-26 08:35:25.354910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.590 [2024-11-26 08:35:25.355042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.590 [2024-11-26 08:35:25.355220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.590 [2024-11-26 08:35:25.355243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.590 [2024-11-26 08:35:25.355258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.357328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.366706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.367121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.367270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.367298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.367315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.367497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.367648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.367671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.367695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.370133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.379208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.379568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.379711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.379744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.379761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.379890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.380041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.380064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.380079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.382422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.391782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.392200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.392395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.392437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.392460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.392644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.392839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.392860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.392873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.395149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.404361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.404699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.404860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.404888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.404906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.405052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.405239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.405262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.405278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.407602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.417045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.417385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.417554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.417578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.417592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.417755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.417911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.417935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.417950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.420311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.591 [2024-11-26 08:35:25.429826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.591 [2024-11-26 08:35:25.430215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.430485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.591 [2024-11-26 08:35:25.430533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.591 [2024-11-26 08:35:25.430550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.591 [2024-11-26 08:35:25.430750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.591 [2024-11-26 08:35:25.430903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.591 [2024-11-26 08:35:25.430926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.591 [2024-11-26 08:35:25.430942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.591 [2024-11-26 08:35:25.433029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.853 [2024-11-26 08:35:25.442409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.853 [2024-11-26 08:35:25.442756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.853 [2024-11-26 08:35:25.442879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.853 [2024-11-26 08:35:25.442907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.442924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.443107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.443258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.443282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.443297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.445777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.454937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.455267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.455450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.455510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.455528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.455656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.455835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.455859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.455875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.458161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.467534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.467890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.468134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.468163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.468180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.468327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.468448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.468471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.468486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.470910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.480203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.480513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.480653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.480682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.480711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.480877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.481046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.481069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.481084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.483449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.492822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.493087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.493207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.493236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.493254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.493365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.493533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.493556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.493571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.495834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.505365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.505617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.505773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.505799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.505815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.505962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.506144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.506173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.506189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.508567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.518070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.518402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.518520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.518548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.518565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.518741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.518930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.518953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.518967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.521290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.530798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.531107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.531278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.531306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.531323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.531487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.531656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.531679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.531707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.534013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.854 [2024-11-26 08:35:25.543293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.854 [2024-11-26 08:35:25.543577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.543728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.854 [2024-11-26 08:35:25.543769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.854 [2024-11-26 08:35:25.543785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.854 [2024-11-26 08:35:25.543918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.854 [2024-11-26 08:35:25.544099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.854 [2024-11-26 08:35:25.544123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.854 [2024-11-26 08:35:25.544143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.854 [2024-11-26 08:35:25.546631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.555857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.556148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.556414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.556465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.556482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.556646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.556791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.556815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.556830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.559060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.568403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.568737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.568857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.568886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.568903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.569085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.569272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.569295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.569311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.571541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.580786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.581232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.581462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.581490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.581507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.581653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.581870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.581894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.581910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.584293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.593260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.593581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.593727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.593753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.593768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.593959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.594092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.594115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.594131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.596363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.605891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.606242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.606362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.606391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.606408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.606572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.606771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.606796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.606812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.609206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.618399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.618799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.618937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.618963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.618979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.619176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.619400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.619423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.619438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.621821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.631223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.631523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.631703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.631733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.631750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.631897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.632067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.632091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.632106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.634415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.643968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.644368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.644564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.644590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.644606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.644834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.645023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.645046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.645061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.647510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.656648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.656948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.657174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.657230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-26 08:35:25.657248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.855 [2024-11-26 08:35:25.657449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.855 [2024-11-26 08:35:25.657618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-26 08:35:25.657641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-26 08:35:25.657656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-26 08:35:25.659935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-26 08:35:25.669208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-26 08:35:25.669671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.669828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-26 08:35:25.669856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-26 08:35:25.669874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.856 [2024-11-26 08:35:25.670038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.856 [2024-11-26 08:35:25.670208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-26 08:35:25.670231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-26 08:35:25.670246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-26 08:35:25.672515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-26 08:35:25.681977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-26 08:35:25.682300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-26 08:35:25.682484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-26 08:35:25.682510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-26 08:35:25.682525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.856 [2024-11-26 08:35:25.682717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.856 [2024-11-26 08:35:25.682869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-26 08:35:25.682892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-26 08:35:25.682907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-26 08:35:25.685284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-26 08:35:25.694582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-26 08:35:25.694899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-26 08:35:25.695045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-26 08:35:25.695075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-26 08:35:25.695092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:39.856 [2024-11-26 08:35:25.695275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:39.856 [2024-11-26 08:35:25.695481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-26 08:35:25.695505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-26 08:35:25.695520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-26 08:35:25.697837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.116 [2024-11-26 08:35:25.707083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.116 [2024-11-26 08:35:25.707426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.707546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.707574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.116 [2024-11-26 08:35:25.707591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.116 [2024-11-26 08:35:25.707770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.116 [2024-11-26 08:35:25.707976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.116 [2024-11-26 08:35:25.707999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.116 [2024-11-26 08:35:25.708014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.116 [2024-11-26 08:35:25.710215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.116 [2024-11-26 08:35:25.719699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.116 [2024-11-26 08:35:25.719984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.720155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.720184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.116 [2024-11-26 08:35:25.720201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.116 [2024-11-26 08:35:25.720365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.116 [2024-11-26 08:35:25.720534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.116 [2024-11-26 08:35:25.720557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.116 [2024-11-26 08:35:25.720573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.116 [2024-11-26 08:35:25.722977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.116 [2024-11-26 08:35:25.732370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.116 [2024-11-26 08:35:25.732711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.732934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.732990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.116 [2024-11-26 08:35:25.733008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.116 [2024-11-26 08:35:25.733191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.116 [2024-11-26 08:35:25.733397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.116 [2024-11-26 08:35:25.733420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.116 [2024-11-26 08:35:25.733435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.116 [2024-11-26 08:35:25.735613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.116 [2024-11-26 08:35:25.744949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.116 [2024-11-26 08:35:25.745291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.745435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.116 [2024-11-26 08:35:25.745464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.116 [2024-11-26 08:35:25.745499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.116 [2024-11-26 08:35:25.745666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.116 [2024-11-26 08:35:25.745828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.745852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.745867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.748241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.757565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.758021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.758292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.758343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.758360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.758489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.758621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.758644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.758658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.761109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.770172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.770467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.770594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.770622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.770640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.770834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.770986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.771009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.771024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.773434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.782756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.783085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.783206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.783235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.783252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.783441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.783628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.783652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.783667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.786195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.795241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.795549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.795720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.795750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.795768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.795932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.796120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.796143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.796157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.798483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.807879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.808233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.808382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.808411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.808428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.808628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.808827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.808852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.808867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.811146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.820538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.820894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.821022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.821051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.821068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.821233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.821426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.821449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.821464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.823871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.833145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.833426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.833600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.833625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.833641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.833813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.834000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.834024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.834039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.836526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.845658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.845983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.846131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.846159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.846176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.846304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.846492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.846516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.846532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.848848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-26 08:35:25.858343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-26 08:35:25.858646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.858790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-26 08:35:25.858816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-26 08:35:25.858831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.117 [2024-11-26 08:35:25.859025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.117 [2024-11-26 08:35:25.859195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-26 08:35:25.859224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-26 08:35:25.859241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-26 08:35:25.861530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.870962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.871249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.871431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.871456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.871471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.871633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.871793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.871817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.871832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.873977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.883555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.883832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.883961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.883989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.884006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.884170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.884376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.884400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.884414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.886731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.895893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.896246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.896392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.896419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.896437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.896583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.896743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.896766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.896785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.899093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.908401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.908742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.908878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.908903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.908919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.909099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.909291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.909314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.909329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.911590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.920942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.921286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.921475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.921515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.921533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.921763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.921933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.921954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.921982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.924382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.933656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.933946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.934108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.934133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.934149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.934326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.934478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.934501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.934522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.936896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.946320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.946649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.946780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.946811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.946828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.947029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.947253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.947276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.947291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.949693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-26 08:35:25.958708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-26 08:35:25.959038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.959209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-26 08:35:25.959237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-26 08:35:25.959254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.118 [2024-11-26 08:35:25.959401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.118 [2024-11-26 08:35:25.959588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-26 08:35:25.959611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-26 08:35:25.959627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-26 08:35:25.962082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:25.971375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:25.971678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.971857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.971898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.378 [2024-11-26 08:35:25.971916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.378 [2024-11-26 08:35:25.972027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.378 [2024-11-26 08:35:25.972214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.378 [2024-11-26 08:35:25.972237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.378 [2024-11-26 08:35:25.972252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.378 [2024-11-26 08:35:25.974595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:25.984040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:25.984370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.984504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.984532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.378 [2024-11-26 08:35:25.984549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.378 [2024-11-26 08:35:25.984743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.378 [2024-11-26 08:35:25.984932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.378 [2024-11-26 08:35:25.984955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.378 [2024-11-26 08:35:25.984970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.378 [2024-11-26 08:35:25.987109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:25.996657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:25.996970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.997126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:25.997152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.378 [2024-11-26 08:35:25.997167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.378 [2024-11-26 08:35:25.997391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.378 [2024-11-26 08:35:25.997506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.378 [2024-11-26 08:35:25.997529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.378 [2024-11-26 08:35:25.997543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.378 [2024-11-26 08:35:25.999949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:26.009072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:26.009444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.009586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.009629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.378 [2024-11-26 08:35:26.009646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.378 [2024-11-26 08:35:26.009820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.378 [2024-11-26 08:35:26.010008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.378 [2024-11-26 08:35:26.010032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.378 [2024-11-26 08:35:26.010047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.378 [2024-11-26 08:35:26.012437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:26.021824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:26.022145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.022319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.022348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.378 [2024-11-26 08:35:26.022365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.378 [2024-11-26 08:35:26.022530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.378 [2024-11-26 08:35:26.022727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.378 [2024-11-26 08:35:26.022751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.378 [2024-11-26 08:35:26.022767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.378 [2024-11-26 08:35:26.025112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.378 [2024-11-26 08:35:26.034396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.378 [2024-11-26 08:35:26.034765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.034924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.378 [2024-11-26 08:35:26.034950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.034965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.035096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.035299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.035323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.035337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.037528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.046802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.047167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.047313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.047341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.047359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.047560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.047754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.047777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.047790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.050299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.059265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.059637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.059826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.059856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.059873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.060020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.060154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.060177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.060192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.062279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.071944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.072219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.072350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.072383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.072417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.072564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.072781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.072805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.072821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.075158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.084485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.084814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.084954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.084980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.084996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.085193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.085381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.085404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.085420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.087699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.097001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.097339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.097488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.097516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.097539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.097697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.097866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.097889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.097904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.100153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.109668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.110002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.110163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.110188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.110204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.110320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.110446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.110470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.110485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.112886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.122249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.122583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.122725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.122754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.122771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.122971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.123104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.123127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.123143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.125570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.134837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.135184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.135352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.135377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.135393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.135604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.135803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-26 08:35:26.135826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-26 08:35:26.135841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-26 08:35:26.138070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-26 08:35:26.147467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-26 08:35:26.147816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.147943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-26 08:35:26.147984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-26 08:35:26.148000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.379 [2024-11-26 08:35:26.148160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.379 [2024-11-26 08:35:26.148375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.148399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.148415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.150794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.159884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.160268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.160414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.160442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.160458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.160605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.160786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.160811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.160826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.163274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.172316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.172657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.172810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.172839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.172856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.173044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.173196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.173220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.173235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.175648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.184905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.185232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.185371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.185400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.185417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.185599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.185800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.185824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.185840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.188231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.197516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.197823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.197998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.198027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.198044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.198190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.198341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.198365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.198380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.200767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.210300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.210658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.210804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.210847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.210863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.211088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.211219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.211242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.211257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.213562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-26 08:35:26.222665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-26 08:35:26.223071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.223253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-26 08:35:26.223279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-26 08:35:26.223295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.380 [2024-11-26 08:35:26.223441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.380 [2024-11-26 08:35:26.223594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-26 08:35:26.223618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-26 08:35:26.223632] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-26 08:35:26.225834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.640 [2024-11-26 08:35:26.235324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.640 [2024-11-26 08:35:26.235694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.235816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.235845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.640 [2024-11-26 08:35:26.235862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.640 [2024-11-26 08:35:26.236044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.640 [2024-11-26 08:35:26.236250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.640 [2024-11-26 08:35:26.236273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.640 [2024-11-26 08:35:26.236288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.640 [2024-11-26 08:35:26.238647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.640 [2024-11-26 08:35:26.248069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.640 [2024-11-26 08:35:26.248472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.248598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.248627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.640 [2024-11-26 08:35:26.248644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.640 [2024-11-26 08:35:26.248838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.640 [2024-11-26 08:35:26.249046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.640 [2024-11-26 08:35:26.249069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.640 [2024-11-26 08:35:26.249089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.640 [2024-11-26 08:35:26.251646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.640 [2024-11-26 08:35:26.260811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.640 [2024-11-26 08:35:26.261217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.261380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.261408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.640 [2024-11-26 08:35:26.261425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.640 [2024-11-26 08:35:26.261553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.640 [2024-11-26 08:35:26.261716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.640 [2024-11-26 08:35:26.261740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.640 [2024-11-26 08:35:26.261755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.640 [2024-11-26 08:35:26.263946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.640 [2024-11-26 08:35:26.273194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.640 [2024-11-26 08:35:26.273589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.273776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.273805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.640 [2024-11-26 08:35:26.273822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.640 [2024-11-26 08:35:26.273987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.640 [2024-11-26 08:35:26.274156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.640 [2024-11-26 08:35:26.274179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.640 [2024-11-26 08:35:26.274194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.640 [2024-11-26 08:35:26.276516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.640 [2024-11-26 08:35:26.285741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.640 [2024-11-26 08:35:26.286167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.286487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.640 [2024-11-26 08:35:26.286515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.640 [2024-11-26 08:35:26.286532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.640 [2024-11-26 08:35:26.286660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.286822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.286846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.286867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.289186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.298471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.298784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.298967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.298993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.299025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.299244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.299431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.299454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.299469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.301851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.311095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.311397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.311536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.311561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.311577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.311787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.311922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.311945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.311960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.314333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.323832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.324177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.324347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.324376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.324392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.324521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.324672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.324707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.324723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.327172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.336694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.337097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.337235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.337280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.337297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.337480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.337595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.337618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.337633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.340054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.349267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.349577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.349677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.349714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.349732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.349897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.350012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.350034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.350050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.352422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.361831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.362153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.362286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.362311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.362327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.362487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.362621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.362644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.362659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.365111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.374405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.374745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.374880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.374906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.374922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.375135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.375305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.375329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.375344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.377709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.386963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.387298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.387469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.387498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.387515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.387661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.387804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.387828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.387844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-26 08:35:26.390162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-26 08:35:26.399447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-26 08:35:26.399757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.399941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-26 08:35:26.399967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-26 08:35:26.399982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.641 [2024-11-26 08:35:26.400145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.641 [2024-11-26 08:35:26.400332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-26 08:35:26.400355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-26 08:35:26.400370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.402698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.412120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.412389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.412542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.412570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.412588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.412778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.412944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.412966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.412980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.415105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.424424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.424716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.424872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.424898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.424913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.425020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.425196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.425216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.425229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.427295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.437062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.437469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.437624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.437648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.437663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.437879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.438034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.438057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.438073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.440553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.449753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.450075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.450347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.450396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.450418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.450584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.450783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.450808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.450823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.453018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.462340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.462753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.462958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.462987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.463005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.463170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.463285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.463309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.463324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.465699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.474762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.475116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.475285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.475314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.475331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.475549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.475766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.475791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.475805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.478089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-26 08:35:26.487321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-26 08:35:26.487657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.487813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-26 08:35:26.487858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-26 08:35:26.487887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.642 [2024-11-26 08:35:26.488065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.642 [2024-11-26 08:35:26.488225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-26 08:35:26.488249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-26 08:35:26.488265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-26 08:35:26.490587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.905 [2024-11-26 08:35:26.499899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.905 [2024-11-26 08:35:26.500118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.500259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.500286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.905 [2024-11-26 08:35:26.500302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.905 [2024-11-26 08:35:26.500455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.905 [2024-11-26 08:35:26.500646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.905 [2024-11-26 08:35:26.500669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.905 [2024-11-26 08:35:26.500683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.905 [2024-11-26 08:35:26.502803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.905 [2024-11-26 08:35:26.512104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.905 [2024-11-26 08:35:26.512437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.512583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.512611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.905 [2024-11-26 08:35:26.512627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.905 [2024-11-26 08:35:26.512862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.905 [2024-11-26 08:35:26.513041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.905 [2024-11-26 08:35:26.513077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.905 [2024-11-26 08:35:26.513092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.905 [2024-11-26 08:35:26.515203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.905 [2024-11-26 08:35:26.524733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.905 [2024-11-26 08:35:26.525019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.525160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-26 08:35:26.525191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.905 [2024-11-26 08:35:26.525208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.905 [2024-11-26 08:35:26.525343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.905 [2024-11-26 08:35:26.525531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.905 [2024-11-26 08:35:26.525555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.905 [2024-11-26 08:35:26.525569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.527957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.537195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.537512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.537624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.537654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.537672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.537829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.538000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.538024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.538039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.540286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.549740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.550028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.550227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.550254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.550271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.550446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.550652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.550675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.550701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.552957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.562608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.562926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.563076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.563106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.563123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.563253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.563464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.563488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.563503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.565792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.575243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.575691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.575806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.575835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.575850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.575997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.576185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.576209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.576224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.578678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.587943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.588234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.588376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.588404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.588422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.588605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.588805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.588829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.588844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.591091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.600642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.600945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.601153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.601200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.601219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.601454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.601642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.601670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.601696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.603946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.613316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.613620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.613777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.613804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.613819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.613999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.614220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.614244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.614259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.616616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.626062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.626382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.626529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.626557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.626574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.626786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.626920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.626943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.626958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.629260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.638650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.639014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.639164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.639190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.906 [2024-11-26 08:35:26.639205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.906 [2024-11-26 08:35:26.639382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.906 [2024-11-26 08:35:26.639584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.906 [2024-11-26 08:35:26.639607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.906 [2024-11-26 08:35:26.639628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.906 [2024-11-26 08:35:26.642285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.906 [2024-11-26 08:35:26.651023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.906 [2024-11-26 08:35:26.651349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.906 [2024-11-26 08:35:26.651495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.651523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.651540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.651717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.651904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.651928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.651943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.654280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.663586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.663944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.664128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.664154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.664169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.664372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.664570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.664594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.664609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.667050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.676130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.676437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.676584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.676612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.676630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.676825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.677013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.677037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.677052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.679289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.688665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.689036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.689206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.689234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.689252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.689435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.689640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.689663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.689678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.691983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.701294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.701641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.701795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.701825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.701842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.701989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.702158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.702182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.702197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.704415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.714076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.714398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.714570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.714598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.714616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.714756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.714980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.715003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.715018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.717451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.726730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.727084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.727219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.727247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.727264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.727429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.727598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.727621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.727636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.729858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.739313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.739772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.739942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.739970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.739987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.740170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.740321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.740344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.740360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.742728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.907 [2024-11-26 08:35:26.751870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.907 [2024-11-26 08:35:26.752186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.752385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.907 [2024-11-26 08:35:26.752413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:40.907 [2024-11-26 08:35:26.752430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:40.907 [2024-11-26 08:35:26.752632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:40.907 [2024-11-26 08:35:26.752797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.907 [2024-11-26 08:35:26.752821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.907 [2024-11-26 08:35:26.752837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.907 [2024-11-26 08:35:26.755182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.170 [2024-11-26 08:35:26.764426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.170 [2024-11-26 08:35:26.764713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.170 [2024-11-26 08:35:26.764863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.170 [2024-11-26 08:35:26.764892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.170 [2024-11-26 08:35:26.764909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.170 [2024-11-26 08:35:26.765074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.170 [2024-11-26 08:35:26.765226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.170 [2024-11-26 08:35:26.765249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.765264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.767630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.776957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.777305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.777448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.777476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.777493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.777674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.777855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.777879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.777894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.780092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.789520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.789866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.790037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.790065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.790082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.790211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.790343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.790366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.790382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.792542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.802183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.802576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.802776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.802812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.802830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.802976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.803182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.803206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.803221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.805563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.814856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.815184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.815350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.815394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.815411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.815630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.815828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.815853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.815868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.818153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.827360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.827730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.827880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.827921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.827937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.828116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.828326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.828350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.828365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.830487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.839636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.840020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.840150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.840195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.840218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.840329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.840479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.840503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.840518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.842868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.851975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.852304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.852476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.852505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.852522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.852650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.852829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.852853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.852869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.855281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.864481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.864818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.864936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.864964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.864981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.865164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.865352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.865375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.865390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.867811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.877165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.171 [2024-11-26 08:35:26.877507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.877651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.171 [2024-11-26 08:35:26.877679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.171 [2024-11-26 08:35:26.877708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.171 [2024-11-26 08:35:26.877862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.171 [2024-11-26 08:35:26.878032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.171 [2024-11-26 08:35:26.878055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.171 [2024-11-26 08:35:26.878070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.171 [2024-11-26 08:35:26.880380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.171 [2024-11-26 08:35:26.889938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.890277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.890415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.890459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.890477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.890605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.890824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.890848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.890863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.893218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.902501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.902840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.902986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.903012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.903027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.903201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.903353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.903376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.903391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.905699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.915084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.915433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.915551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.915579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.915596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.915789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.915978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.916002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.916018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.918285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.927328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.927595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.927743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.927773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.927790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.927974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.928143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.928166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.928181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.930506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.939870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.940228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.940373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.940403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.940420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.940584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.940729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.940753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.940769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.943091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.952396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.952699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.952866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.952892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.952923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.953089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.953240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.953269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.953285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.955607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.965029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.965380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.965513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.965538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.965554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.965756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.965928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.965962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.965978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.968374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.977320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.977666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.977851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.977877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.977893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.978069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.978214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.978238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.978253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.980512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:26.989831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:26.990175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.990307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:26.990333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:26.990349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.172 [2024-11-26 08:35:26.990512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.172 [2024-11-26 08:35:26.990743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.172 [2024-11-26 08:35:26.990767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.172 [2024-11-26 08:35:26.990788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.172 [2024-11-26 08:35:26.993112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.172 [2024-11-26 08:35:27.002238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.172 [2024-11-26 08:35:27.002675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:27.002843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.172 [2024-11-26 08:35:27.002869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.172 [2024-11-26 08:35:27.002885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.173 [2024-11-26 08:35:27.003064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.173 [2024-11-26 08:35:27.003253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.173 [2024-11-26 08:35:27.003276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.173 [2024-11-26 08:35:27.003291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.173 [2024-11-26 08:35:27.005560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.173 [2024-11-26 08:35:27.014650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.173 [2024-11-26 08:35:27.015006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.173 [2024-11-26 08:35:27.015180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.173 [2024-11-26 08:35:27.015209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.173 [2024-11-26 08:35:27.015226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.173 [2024-11-26 08:35:27.015391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.173 [2024-11-26 08:35:27.015560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.173 [2024-11-26 08:35:27.015584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.173 [2024-11-26 08:35:27.015599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.173 [2024-11-26 08:35:27.017906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.435 [2024-11-26 08:35:27.027474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.435 [2024-11-26 08:35:27.027777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.027894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.027921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.435 [2024-11-26 08:35:27.027937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.435 [2024-11-26 08:35:27.028101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.435 [2024-11-26 08:35:27.028263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.435 [2024-11-26 08:35:27.028284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.435 [2024-11-26 08:35:27.028313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.435 [2024-11-26 08:35:27.030756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.435 [2024-11-26 08:35:27.040126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.435 [2024-11-26 08:35:27.040470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.040609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.040637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.435 [2024-11-26 08:35:27.040655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.435 [2024-11-26 08:35:27.040862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.435 [2024-11-26 08:35:27.041037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.435 [2024-11-26 08:35:27.041062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.435 [2024-11-26 08:35:27.041077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.435 [2024-11-26 08:35:27.043389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.435 [2024-11-26 08:35:27.052907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.435 [2024-11-26 08:35:27.053297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.053491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.435 [2024-11-26 08:35:27.053520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.435 [2024-11-26 08:35:27.053537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.435 [2024-11-26 08:35:27.053747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.053886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.053908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.053921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.056374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.065406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.065758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.065900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.065927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.065942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.066133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.066303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.066327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.066342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.068565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.077984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.078391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.078549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.078577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.078594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.078815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.078986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.079007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.079019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.081408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.090752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.091059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.091225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.091253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.091271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.091453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.091624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.091648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.091664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.094079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.103245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.103548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.103838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.103868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.103886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.104052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.104185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.104208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.104223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.106491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.115762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.116127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.116318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.116364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.116382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.116583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.116763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.116788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.116803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.119057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.128342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.128578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.128734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.128761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.128777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.128937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.129089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.129112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.129127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.131380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.140980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.141428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.141626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.141651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.141667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.141854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.142007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.142030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.142045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.144400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.153496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.153790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.153976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.154034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.154052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.154180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.154349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.154373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.154388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.436 [2024-11-26 08:35:27.156918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.436 [2024-11-26 08:35:27.165864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.436 [2024-11-26 08:35:27.166245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.166429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.436 [2024-11-26 08:35:27.166474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.436 [2024-11-26 08:35:27.166491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.436 [2024-11-26 08:35:27.166601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.436 [2024-11-26 08:35:27.166818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.436 [2024-11-26 08:35:27.166843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.436 [2024-11-26 08:35:27.166858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.169241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.178442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.178737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.178931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.178989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.179006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.179189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.179340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.179363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.179377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.181753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.191058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.191388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.191538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.191568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.191591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.191794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.192002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.192026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.192041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.194201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.203844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.204177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.204435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.204482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.204499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.204645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.204845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.204869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.204884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.207080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.216461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.216772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.216892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.216920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.216937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.217138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.217290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.217313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.217328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.219841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.229044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.229314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.229461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.229490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.229507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.229659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.229857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.229881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.229896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.232071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.241555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.241906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.242048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.242074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.242089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.242279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.242448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.242471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.242486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.244835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.254124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.254407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.254545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.254573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.254590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.254714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.254848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.254871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.254886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.257114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.266910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.267277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.267421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.267449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.267466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.267649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.267853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.267877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.267892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.270196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.437 [2024-11-26 08:35:27.279306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.437 [2024-11-26 08:35:27.279668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.279831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.437 [2024-11-26 08:35:27.279859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.437 [2024-11-26 08:35:27.279876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.437 [2024-11-26 08:35:27.279987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.437 [2024-11-26 08:35:27.280210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.437 [2024-11-26 08:35:27.280233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.437 [2024-11-26 08:35:27.280249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.437 [2024-11-26 08:35:27.282628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.699 [2024-11-26 08:35:27.291834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.699 [2024-11-26 08:35:27.292166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.292310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.292339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.699 [2024-11-26 08:35:27.292356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.699 [2024-11-26 08:35:27.292557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.699 [2024-11-26 08:35:27.292778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.699 [2024-11-26 08:35:27.292802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.699 [2024-11-26 08:35:27.292817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.699 [2024-11-26 08:35:27.295362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.699 [2024-11-26 08:35:27.304305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.699 [2024-11-26 08:35:27.304618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.304797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.304824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.699 [2024-11-26 08:35:27.304839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.699 [2024-11-26 08:35:27.304972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.699 [2024-11-26 08:35:27.305173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.699 [2024-11-26 08:35:27.305202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.699 [2024-11-26 08:35:27.305218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.699 [2024-11-26 08:35:27.307650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.699 [2024-11-26 08:35:27.316888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.699 [2024-11-26 08:35:27.317247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.317393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.699 [2024-11-26 08:35:27.317420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.699 [2024-11-26 08:35:27.317436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.699 [2024-11-26 08:35:27.317591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.699 [2024-11-26 08:35:27.317755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.317779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.317793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.320260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.329266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.329540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.329684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.329732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.329748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.329887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.330038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.330061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.330076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.332377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1078596 Killed "${NVMF_APP[@]}" "$@" 00:27:41.700 08:35:27 -- host/bdevperf.sh@36 -- # tgt_init 00:27:41.700 08:35:27 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:41.700 08:35:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:41.700 08:35:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:41.700 08:35:27 -- common/autotest_common.sh@10 -- # set +x 00:27:41.700 08:35:27 -- nvmf/common.sh@469 -- # nvmfpid=1079716 00:27:41.700 08:35:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:41.700 08:35:27 -- nvmf/common.sh@470 -- # waitforlisten 1079716 00:27:41.700 08:35:27 -- common/autotest_common.sh@829 -- # '[' -z 1079716 ']' 00:27:41.700 08:35:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:41.700 08:35:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:41.700 08:35:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:41.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:41.700 08:35:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:41.700 08:35:27 -- common/autotest_common.sh@10 -- # set +x 00:27:41.700 [2024-11-26 08:35:27.341914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.342245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.342388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.342416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.342433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.342579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.342796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.342821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.342837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.345216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.354712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.354991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.355132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.355160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.355176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.355335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.355481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.355503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.355518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.357849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.367174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.367470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.367629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.367654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.367669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.367812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.367966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.367986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.368016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.370352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.379378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.379730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.379867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.379893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.379908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.380024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.380232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.380252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.380265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.381798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:41.700 [2024-11-26 08:35:27.381871] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:41.700 [2024-11-26 08:35:27.382316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.391712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.392007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.392155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.392180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.392195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.392359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.392472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.392491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.392504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.394526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.403942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 [2024-11-26 08:35:27.404269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.404413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.404439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.404454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.700 [2024-11-26 08:35:27.404646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.700 [2024-11-26 08:35:27.404829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.700 [2024-11-26 08:35:27.404851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.700 [2024-11-26 08:35:27.404869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.700 [2024-11-26 08:35:27.406902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.700 [2024-11-26 08:35:27.416115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.700 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.700 [2024-11-26 08:35:27.416455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.416617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.700 [2024-11-26 08:35:27.416642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.700 [2024-11-26 08:35:27.416658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.416832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.416952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.416988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.417001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.419032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.429068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.429386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.429560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.429586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.429602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.429806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.429982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.430002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.430015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.432300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.441627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.442031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.442224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.442250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.442266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.442450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.442632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.442655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.442670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.444889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.450775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:41.701 [2024-11-26 08:35:27.454193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.454530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.454670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.454706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.454724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.454858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.455061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.455085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.455101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.457324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.466819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.467363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.467533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.467560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.467596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.467760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.467915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.467937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.467954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.470239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.479280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.479582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.479750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.479778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.479793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.479926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.480114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.480138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.480154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.482380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.491823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.492144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.492340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.492366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.492381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.492499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.492646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.492683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.492712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.495035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.504419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.504787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.504957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.504983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.504999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.505147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.505298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.505321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.505336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.507746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.517087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.517523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.517734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.517761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.517780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.517905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.518121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.518145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.701 [2024-11-26 08:35:27.518165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.701 [2024-11-26 08:35:27.520573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.701 [2024-11-26 08:35:27.529803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.701 [2024-11-26 08:35:27.530187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.530394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.701 [2024-11-26 08:35:27.530419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.701 [2024-11-26 08:35:27.530435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.701 [2024-11-26 08:35:27.530598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.701 [2024-11-26 08:35:27.530803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.701 [2024-11-26 08:35:27.530825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.702 [2024-11-26 08:35:27.530839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.702 [2024-11-26 08:35:27.532971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.702 [2024-11-26 08:35:27.542537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.702 [2024-11-26 08:35:27.542894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.702 [2024-11-26 08:35:27.543067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.702 [2024-11-26 08:35:27.543108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.702 [2024-11-26 08:35:27.543126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.702 [2024-11-26 08:35:27.543291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.702 [2024-11-26 08:35:27.543461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.702 [2024-11-26 08:35:27.543485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.702 [2024-11-26 08:35:27.543500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.702 [2024-11-26 08:35:27.545630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.962 [2024-11-26 08:35:27.555058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.962 [2024-11-26 08:35:27.555414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.555569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.555598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.962 [2024-11-26 08:35:27.555616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.962 [2024-11-26 08:35:27.555809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.962 [2024-11-26 08:35:27.555946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.962 [2024-11-26 08:35:27.555982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.962 [2024-11-26 08:35:27.555996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.962 [2024-11-26 08:35:27.558344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.962 [2024-11-26 08:35:27.566170] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:41.962 [2024-11-26 08:35:27.566299] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:41.962 [2024-11-26 08:35:27.566324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:41.962 [2024-11-26 08:35:27.566339] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:41.962 [2024-11-26 08:35:27.566396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:41.962 [2024-11-26 08:35:27.566455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:41.962 [2024-11-26 08:35:27.566458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:41.962 [2024-11-26 08:35:27.567433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.962 [2024-11-26 08:35:27.567755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.567890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.567917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.962 [2024-11-26 08:35:27.567933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.962 [2024-11-26 08:35:27.568033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.962 [2024-11-26 08:35:27.568232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.962 [2024-11-26 08:35:27.568254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.962 [2024-11-26 08:35:27.568267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.962 [2024-11-26 08:35:27.570415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.962 [2024-11-26 08:35:27.579741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.962 [2024-11-26 08:35:27.580209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.580387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.580414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.962 [2024-11-26 08:35:27.580434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.962 [2024-11-26 08:35:27.580627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.962 [2024-11-26 08:35:27.580817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.962 [2024-11-26 08:35:27.580840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.962 [2024-11-26 08:35:27.580857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.962 [2024-11-26 08:35:27.582844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.962 [2024-11-26 08:35:27.592173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.962 [2024-11-26 08:35:27.592669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.592829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.592856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.962 [2024-11-26 08:35:27.592877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.962 [2024-11-26 08:35:27.593035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.962 [2024-11-26 08:35:27.593158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.962 [2024-11-26 08:35:27.593190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.962 [2024-11-26 08:35:27.593208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.962 [2024-11-26 08:35:27.595294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.962 [2024-11-26 08:35:27.604390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.962 [2024-11-26 08:35:27.604914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.962 [2024-11-26 08:35:27.605033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.605060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.605079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.605286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.605503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.605524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.605542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.607796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.616659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.617067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.617246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.617273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.617292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.617500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.617642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.617663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.617698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.619956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.629195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.629646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.629820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.629847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.629866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.630048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.630236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.630258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.630287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.632556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.641586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.642079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.642260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.642286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.642306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.642466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.642654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.642701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.642731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.644543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.654030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.654298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.654416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.654441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.654457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.654590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.654739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.654761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.654776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.656955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.666251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.666600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.666714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.666740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.666756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.666921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.667102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.667123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.667137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.669181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.678511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.678827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.678990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.679021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.679036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.679201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.679365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.679386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.963 [2024-11-26 08:35:27.679399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.963 [2024-11-26 08:35:27.681256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.963 [2024-11-26 08:35:27.690897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.963 [2024-11-26 08:35:27.691147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.691281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.963 [2024-11-26 08:35:27.691307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.963 [2024-11-26 08:35:27.691328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.963 [2024-11-26 08:35:27.691494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.963 [2024-11-26 08:35:27.691628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.963 [2024-11-26 08:35:27.691702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.691726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.693817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.703262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.703500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.703608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.703634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.703649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.703923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.704074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.704095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.704109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.706206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.715526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.715827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.715967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.715993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.716009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.716190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.716387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.716409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.716422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.718439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.727955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.728262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.728393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.728419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.728435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.728567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.728695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.728716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.728729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.730879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.740106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.740422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.740557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.740583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.740598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.740739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.740908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.740928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.740941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.743110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.752376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.752644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.752747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.752773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.752788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.752920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.753101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.753122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.753135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.755229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.764872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.765139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.765303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.765329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.765344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.765476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.765644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.765680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.765705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.767623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.777109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.777408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.777512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.777538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.964 [2024-11-26 08:35:27.777554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.964 [2024-11-26 08:35:27.777745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.964 [2024-11-26 08:35:27.777909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.964 [2024-11-26 08:35:27.777930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.964 [2024-11-26 08:35:27.777943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.964 [2024-11-26 08:35:27.780125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.964 [2024-11-26 08:35:27.789557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.964 [2024-11-26 08:35:27.789889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.964 [2024-11-26 08:35:27.790001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.965 [2024-11-26 08:35:27.790032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.965 [2024-11-26 08:35:27.790049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.965 [2024-11-26 08:35:27.790197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.965 [2024-11-26 08:35:27.790363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.965 [2024-11-26 08:35:27.790383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.965 [2024-11-26 08:35:27.790396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.965 [2024-11-26 08:35:27.792516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.965 [2024-11-26 08:35:27.801928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.965 [2024-11-26 08:35:27.802183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.965 [2024-11-26 08:35:27.802318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.965 [2024-11-26 08:35:27.802344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.965 [2024-11-26 08:35:27.802359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.965 [2024-11-26 08:35:27.802507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:41.965 [2024-11-26 08:35:27.802714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.965 [2024-11-26 08:35:27.802736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.965 [2024-11-26 08:35:27.802749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.965 [2024-11-26 08:35:27.804722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.965 [2024-11-26 08:35:27.814336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.965 [2024-11-26 08:35:27.814626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.965 [2024-11-26 08:35:27.814757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.965 [2024-11-26 08:35:27.814783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:41.965 [2024-11-26 08:35:27.814798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:41.965 [2024-11-26 08:35:27.814946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.225 [2024-11-26 08:35:27.815112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.225 [2024-11-26 08:35:27.815134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.225 [2024-11-26 08:35:27.815148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.225 [2024-11-26 08:35:27.817279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.225 [2024-11-26 08:35:27.826655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.225 [2024-11-26 08:35:27.826930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.225 [2024-11-26 08:35:27.827057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.225 [2024-11-26 08:35:27.827083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.225 [2024-11-26 08:35:27.827103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.225 [2024-11-26 08:35:27.827268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.225 [2024-11-26 08:35:27.827450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.225 [2024-11-26 08:35:27.827470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.827484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.829517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.838853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.839228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.839347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.839372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.839387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.839536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.839741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.839763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.839776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.841839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.851209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.851538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.851677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.851710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.851726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.851858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.852025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.852045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.852058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.854140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.863470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.863780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.863913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.863939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.863955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.864076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.864258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.864279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.864292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.866252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.875881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.876164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.876274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.876300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.876315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.876480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.876600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.876620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.876634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.878847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.888353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.888667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.888785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.888811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.888827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.888958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.889109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.889130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.889143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.891325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.900575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.900900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.901032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.901059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.901075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.901223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.901394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.901415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.901429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.903266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.912808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.913037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.913171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.226 [2024-11-26 08:35:27.913197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.226 [2024-11-26 08:35:27.913212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.226 [2024-11-26 08:35:27.913344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.226 [2024-11-26 08:35:27.913541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.226 [2024-11-26 08:35:27.913562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.226 [2024-11-26 08:35:27.913575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.226 [2024-11-26 08:35:27.915678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.226 [2024-11-26 08:35:27.924975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.226 [2024-11-26 08:35:27.925279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.925410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.925435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.925450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.925615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.925821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.925842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.925856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.927974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.937325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.937612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.937747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.937773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.937788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.937920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.938087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.938112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.938126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.940310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.949740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.950034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.950138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.950164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.950180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.950344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.950523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.950544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.950558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.952552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.962130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.962422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.962578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.962604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.962619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.962824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.962962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.962998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.963012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.965087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.974386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.974703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.974835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.974860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.974875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.975023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.975190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.975211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.975229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.977269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.986720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.986969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.987100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.987126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.987141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.987257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.987393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.987414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.987427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:27.989400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:27.999137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:27.999431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.999540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:27.999565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:27.999581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:27.999791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.227 [2024-11-26 08:35:27.999940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.227 [2024-11-26 08:35:27.999961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.227 [2024-11-26 08:35:27.999974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.227 [2024-11-26 08:35:28.002125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.227 [2024-11-26 08:35:28.011472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.227 [2024-11-26 08:35:28.011788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:28.011896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.227 [2024-11-26 08:35:28.011922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.227 [2024-11-26 08:35:28.011938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.227 [2024-11-26 08:35:28.012086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.012221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.012242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.012255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.014467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.228 [2024-11-26 08:35:28.023810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.228 [2024-11-26 08:35:28.024099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.024202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.024229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.228 [2024-11-26 08:35:28.024244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.228 [2024-11-26 08:35:28.024409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.024605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.024626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.024640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.026810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.228 [2024-11-26 08:35:28.036076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.228 [2024-11-26 08:35:28.036329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.036459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.036485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.228 [2024-11-26 08:35:28.036500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.228 [2024-11-26 08:35:28.036665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.036806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.036827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.036840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.038953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.228 [2024-11-26 08:35:28.048446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.228 [2024-11-26 08:35:28.048812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.048918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.048944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.228 [2024-11-26 08:35:28.048960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.228 [2024-11-26 08:35:28.049124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.049339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.049361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.049374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.051651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.228 [2024-11-26 08:35:28.060660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.228 [2024-11-26 08:35:28.060961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.061092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.061118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.228 [2024-11-26 08:35:28.061133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.228 [2024-11-26 08:35:28.061298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.061479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.061500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.061513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.063561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.228 [2024-11-26 08:35:28.073106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.228 [2024-11-26 08:35:28.073399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.073561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.228 [2024-11-26 08:35:28.073587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.228 [2024-11-26 08:35:28.073603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.228 [2024-11-26 08:35:28.073751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.228 [2024-11-26 08:35:28.073904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.228 [2024-11-26 08:35:28.073925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.228 [2024-11-26 08:35:28.073938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.228 [2024-11-26 08:35:28.076184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.085310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.085614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.085719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.085745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.085761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.085877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.086011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.086031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.086044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.088061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.097604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.097939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.098053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.098080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.098099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.098264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.098477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.098497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.098511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.100464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.109891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.110174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.110308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.110334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.110351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.110483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.110603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.110624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.110638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.112877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.122344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.122682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.122794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.122821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.122836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.122984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.123165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.123186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.123199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.125232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.134505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.134841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.134954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.134980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.134995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.135144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.135281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.135302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.135316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.137382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.146914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.147211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.147341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.147367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.147382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.147530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.147706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.147729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.147743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.149925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.159443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.489 [2024-11-26 08:35:28.159736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.159837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.489 [2024-11-26 08:35:28.159862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.489 [2024-11-26 08:35:28.159878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.489 [2024-11-26 08:35:28.160010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.489 [2024-11-26 08:35:28.160151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.489 [2024-11-26 08:35:28.160172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.489 [2024-11-26 08:35:28.160185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.489 [2024-11-26 08:35:28.162434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.489 [2024-11-26 08:35:28.171922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.172210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.172344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.172370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.172391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.172508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.172719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.172741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.172754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.174793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.184285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.184564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.184724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.184752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.184768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.184917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.185098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.185120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.185133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.187178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.196699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.197041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.197167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.197193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.197209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.197341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.197491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.197512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.197525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.199469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.209080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.209341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.209439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.209465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.209480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.209666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.209872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.209894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.209908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.211912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.221420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.221698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.221856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.221882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.221897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.222078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.222261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.222282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.222295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.224422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.233844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.234110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.234245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.234271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.234286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.234434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.234600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.234621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.234635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.236784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.246159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.246443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.246580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.246605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.490 [2024-11-26 08:35:28.246621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.490 [2024-11-26 08:35:28.246796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.490 [2024-11-26 08:35:28.246945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.490 [2024-11-26 08:35:28.246966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.490 [2024-11-26 08:35:28.246979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.490 [2024-11-26 08:35:28.249048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.490 [2024-11-26 08:35:28.258292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.490 [2024-11-26 08:35:28.258554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.490 [2024-11-26 08:35:28.258657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.258683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.258709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.258874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.259071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.259092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.259105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.260994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.270458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.270771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.270881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.270908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.270923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.271055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.271204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.271225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.271239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.273451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.282691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.283003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.283139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.283165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.283180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.283344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.283525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.283552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.283566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.285544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.294997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.295255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.295376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.295401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.295417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.295581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.295772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.295793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.295806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.297667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.307161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.307509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.307611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.307636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.307652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.307825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.307976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.307997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.308010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.310235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.319642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.319965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.320061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.320086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.320102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.320250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.320447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.320468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.320486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.322577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.491 [2024-11-26 08:35:28.331898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.491 [2024-11-26 08:35:28.332151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.332308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.491 [2024-11-26 08:35:28.332335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.491 [2024-11-26 08:35:28.332350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.491 [2024-11-26 08:35:28.332515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.491 [2024-11-26 08:35:28.332738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.491 [2024-11-26 08:35:28.332760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.491 [2024-11-26 08:35:28.332774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.491 [2024-11-26 08:35:28.334910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 [2024-11-26 08:35:28.344408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.753 [2024-11-26 08:35:28.344734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.344894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.344920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.753 [2024-11-26 08:35:28.344935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.753 [2024-11-26 08:35:28.345100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.753 [2024-11-26 08:35:28.345266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.753 [2024-11-26 08:35:28.345288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.753 [2024-11-26 08:35:28.345301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.753 [2024-11-26 08:35:28.347472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 [2024-11-26 08:35:28.356573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.753 [2024-11-26 08:35:28.356891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.357026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.357051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.753 [2024-11-26 08:35:28.357066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.753 [2024-11-26 08:35:28.357215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.753 [2024-11-26 08:35:28.357365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.753 [2024-11-26 08:35:28.357386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.753 [2024-11-26 08:35:28.357399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.753 [2024-11-26 08:35:28.359402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 [2024-11-26 08:35:28.368790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.753 [2024-11-26 08:35:28.369111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.369241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.369267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.753 [2024-11-26 08:35:28.369282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.753 [2024-11-26 08:35:28.369447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.753 [2024-11-26 08:35:28.369584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.753 [2024-11-26 08:35:28.369605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.753 [2024-11-26 08:35:28.369618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.753 [2024-11-26 08:35:28.371818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 [2024-11-26 08:35:28.381300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.753 [2024-11-26 08:35:28.381666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.381780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.381806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.753 [2024-11-26 08:35:28.381821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.753 [2024-11-26 08:35:28.381970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.753 [2024-11-26 08:35:28.382139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.753 [2024-11-26 08:35:28.382159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.753 [2024-11-26 08:35:28.382173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.753 [2024-11-26 08:35:28.384480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 08:35:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:42.753 08:35:28 -- common/autotest_common.sh@862 -- # return 0 00:27:42.753 08:35:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:42.753 08:35:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:42.753 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.753 [2024-11-26 08:35:28.393632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.753 [2024-11-26 08:35:28.393960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.394069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.753 [2024-11-26 08:35:28.394094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.753 [2024-11-26 08:35:28.394109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.753 [2024-11-26 08:35:28.394241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.753 [2024-11-26 08:35:28.394394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.753 [2024-11-26 08:35:28.394415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.753 [2024-11-26 08:35:28.394435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.753 [2024-11-26 08:35:28.396697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.753 08:35:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:42.753 08:35:28 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:42.753 08:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.753 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.753 [2024-11-26 08:35:28.406084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 [2024-11-26 08:35:28.406417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.406551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.406576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.406592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.406749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.406903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.406924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.406938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.409072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 [2024-11-26 08:35:28.409395] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:42.754 08:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.754 08:35:28 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:42.754 08:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.754 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.754 [2024-11-26 08:35:28.418381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 [2024-11-26 08:35:28.418706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.418861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.418886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.418902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.419035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.419213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.419233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.419246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.421302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 [2024-11-26 08:35:28.430720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 [2024-11-26 08:35:28.430967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.431080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.431105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.431126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.431272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.431433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.431454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.431466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.433448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 [2024-11-26 08:35:28.442964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 [2024-11-26 08:35:28.443409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.443560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.443586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.443605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.443802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.443987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.444008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.444024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.446190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 Malloc0 00:27:42.754 08:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.754 08:35:28 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:42.754 [2024-11-26 08:35:28.455428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 08:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.754 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.754 [2024-11-26 08:35:28.455822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.455935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.455962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.455981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.456120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.456273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.456295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.456311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.458674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 08:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.754 08:35:28 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:42.754 08:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.754 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.754 [2024-11-26 08:35:28.467629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.754 [2024-11-26 08:35:28.467977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.468109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.754 [2024-11-26 08:35:28.468135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bd160 with addr=10.0.0.2, port=4420 00:27:42.754 [2024-11-26 08:35:28.468150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bd160 is same with the state(5) to be set 00:27:42.754 [2024-11-26 08:35:28.468250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bd160 (9): Bad file descriptor 00:27:42.754 [2024-11-26 08:35:28.468385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.754 [2024-11-26 08:35:28.468405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.754 [2024-11-26 08:35:28.468419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.754 [2024-11-26 08:35:28.470463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.754 08:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.754 08:35:28 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:42.754 08:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.754 08:35:28 -- common/autotest_common.sh@10 -- # set +x 00:27:42.754 [2024-11-26 08:35:28.474738] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:42.754 08:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:42.754 08:35:28 -- host/bdevperf.sh@38 -- # wait 1078923 00:27:42.755 [2024-11-26 08:35:28.479987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.755 [2024-11-26 08:35:28.551020] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:52.735 00:27:52.735 Latency(us) 00:27:52.735 [2024-11-26T07:35:38.595Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:52.735 [2024-11-26T07:35:38.595Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:52.735 Verification LBA range: start 0x0 length 0x4000 00:27:52.735 Nvme1n1 : 15.01 9335.05 36.47 16085.70 0.00 5020.48 646.26 20971.52 00:27:52.735 [2024-11-26T07:35:38.595Z] =================================================================================================================== 00:27:52.735 [2024-11-26T07:35:38.595Z] Total : 9335.05 36.47 16085.70 0.00 5020.48 646.26 20971.52 00:27:52.735 08:35:37 -- host/bdevperf.sh@39 -- # sync 00:27:52.735 08:35:37 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:52.735 08:35:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.735 08:35:37 -- common/autotest_common.sh@10 -- # set +x 00:27:52.735 08:35:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.735 08:35:37 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:52.735 08:35:37 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:52.735 08:35:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:52.735 08:35:37 -- nvmf/common.sh@116 -- # sync 00:27:52.735 08:35:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:52.735 08:35:37 -- nvmf/common.sh@119 -- # set +e 00:27:52.735 08:35:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:52.735 08:35:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:52.735 rmmod nvme_tcp 00:27:52.735 rmmod nvme_fabrics 00:27:52.735 rmmod nvme_keyring 00:27:52.735 08:35:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:52.735 08:35:37 -- nvmf/common.sh@123 -- # set -e 00:27:52.735 08:35:37 -- nvmf/common.sh@124 -- # return 0 00:27:52.735 08:35:37 -- nvmf/common.sh@477 -- # '[' -n 1079716 ']' 00:27:52.735 08:35:37 -- nvmf/common.sh@478 -- # killprocess 1079716 00:27:52.735 08:35:37 -- common/autotest_common.sh@936 -- # '[' -z 1079716 ']' 00:27:52.735 08:35:37 -- common/autotest_common.sh@940 -- # kill -0 1079716 00:27:52.735 08:35:37 -- common/autotest_common.sh@941 -- # uname 00:27:52.735 08:35:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:52.735 08:35:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1079716 00:27:52.735 08:35:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:52.735 08:35:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:52.735 08:35:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1079716' 00:27:52.735 killing process with pid 1079716 00:27:52.735 08:35:37 -- common/autotest_common.sh@955 -- # kill 1079716 00:27:52.735 08:35:37 -- common/autotest_common.sh@960 -- # wait 1079716 00:27:52.735 08:35:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:52.735 08:35:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:52.735 08:35:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:52.735 08:35:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:52.735 08:35:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:52.735 08:35:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:52.735 08:35:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:52.735 08:35:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.669 08:35:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:53.669 00:27:53.669 real 0m23.428s 00:27:53.669 user 1m3.304s 00:27:53.669 sys 0m4.202s 00:27:53.669 08:35:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:53.669 08:35:39 -- common/autotest_common.sh@10 -- # set +x 00:27:53.669 ************************************ 00:27:53.669 END TEST nvmf_bdevperf 00:27:53.669 ************************************ 00:27:53.669 08:35:39 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:53.669 08:35:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:53.669 08:35:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:53.669 08:35:39 -- common/autotest_common.sh@10 -- # set +x 00:27:53.669 ************************************ 00:27:53.669 START TEST nvmf_target_disconnect 00:27:53.669 ************************************ 00:27:53.669 08:35:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:53.928 * Looking for test storage... 00:27:53.928 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:53.928 08:35:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:53.928 08:35:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:53.928 08:35:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:53.928 08:35:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:53.928 08:35:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:53.928 08:35:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:53.928 08:35:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:53.928 08:35:39 -- scripts/common.sh@335 -- # IFS=.-: 00:27:53.928 08:35:39 -- scripts/common.sh@335 -- # read -ra ver1 00:27:53.928 08:35:39 -- scripts/common.sh@336 -- # IFS=.-: 00:27:53.928 08:35:39 -- scripts/common.sh@336 -- # read -ra ver2 00:27:53.928 08:35:39 -- scripts/common.sh@337 -- # local 'op=<' 00:27:53.928 08:35:39 -- scripts/common.sh@339 -- # ver1_l=2 00:27:53.928 08:35:39 -- scripts/common.sh@340 -- # ver2_l=1 00:27:53.928 08:35:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:53.928 08:35:39 -- scripts/common.sh@343 -- # case "$op" in 00:27:53.928 08:35:39 -- scripts/common.sh@344 -- # : 1 00:27:53.928 08:35:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:53.928 08:35:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:53.928 08:35:39 -- scripts/common.sh@364 -- # decimal 1 00:27:53.928 08:35:39 -- scripts/common.sh@352 -- # local d=1 00:27:53.928 08:35:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:53.928 08:35:39 -- scripts/common.sh@354 -- # echo 1 00:27:53.928 08:35:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:53.928 08:35:39 -- scripts/common.sh@365 -- # decimal 2 00:27:53.928 08:35:39 -- scripts/common.sh@352 -- # local d=2 00:27:53.928 08:35:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:53.928 08:35:39 -- scripts/common.sh@354 -- # echo 2 00:27:53.928 08:35:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:53.928 08:35:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:53.928 08:35:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:53.928 08:35:39 -- scripts/common.sh@367 -- # return 0 00:27:53.928 08:35:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:53.928 08:35:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:53.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.928 --rc genhtml_branch_coverage=1 00:27:53.928 --rc genhtml_function_coverage=1 00:27:53.928 --rc genhtml_legend=1 00:27:53.928 --rc geninfo_all_blocks=1 00:27:53.928 --rc geninfo_unexecuted_blocks=1 00:27:53.928 00:27:53.928 ' 00:27:53.928 08:35:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:53.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.928 --rc genhtml_branch_coverage=1 00:27:53.928 --rc genhtml_function_coverage=1 00:27:53.928 --rc genhtml_legend=1 00:27:53.928 --rc geninfo_all_blocks=1 00:27:53.928 --rc geninfo_unexecuted_blocks=1 00:27:53.928 00:27:53.928 ' 00:27:53.928 08:35:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:53.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.928 --rc genhtml_branch_coverage=1 00:27:53.928 --rc genhtml_function_coverage=1 00:27:53.928 --rc genhtml_legend=1 00:27:53.928 --rc geninfo_all_blocks=1 00:27:53.928 --rc geninfo_unexecuted_blocks=1 00:27:53.928 00:27:53.928 ' 00:27:53.928 08:35:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:53.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:53.928 --rc genhtml_branch_coverage=1 00:27:53.928 --rc genhtml_function_coverage=1 00:27:53.928 --rc genhtml_legend=1 00:27:53.928 --rc geninfo_all_blocks=1 00:27:53.928 --rc geninfo_unexecuted_blocks=1 00:27:53.928 00:27:53.928 ' 00:27:53.928 08:35:39 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:53.928 08:35:39 -- nvmf/common.sh@7 -- # uname -s 00:27:53.929 08:35:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:53.929 08:35:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:53.929 08:35:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:53.929 08:35:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:53.929 08:35:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:53.929 08:35:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:53.929 08:35:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:53.929 08:35:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:53.929 08:35:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:53.929 08:35:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:53.929 08:35:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:53.929 08:35:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:53.929 08:35:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:53.929 08:35:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:53.929 08:35:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:53.929 08:35:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:53.929 08:35:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:53.929 08:35:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:53.929 08:35:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:53.929 08:35:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.929 08:35:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.929 08:35:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.929 08:35:39 -- paths/export.sh@5 -- # export PATH 00:27:53.929 08:35:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.929 08:35:39 -- nvmf/common.sh@46 -- # : 0 00:27:53.929 08:35:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:53.929 08:35:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:53.929 08:35:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:53.929 08:35:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:53.929 08:35:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:53.929 08:35:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:53.929 08:35:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:53.929 08:35:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:53.929 08:35:39 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:53.929 08:35:39 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:53.929 08:35:39 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:53.929 08:35:39 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:53.929 08:35:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:53.929 08:35:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:53.929 08:35:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:53.929 08:35:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:53.929 08:35:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:53.929 08:35:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.929 08:35:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.929 08:35:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.929 08:35:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:53.929 08:35:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:53.929 08:35:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:53.929 08:35:39 -- common/autotest_common.sh@10 -- # set +x 00:27:56.467 08:35:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:56.467 08:35:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:56.467 08:35:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:56.467 08:35:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:56.467 08:35:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:56.467 08:35:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:56.467 08:35:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:56.467 08:35:41 -- nvmf/common.sh@294 -- # net_devs=() 00:27:56.467 08:35:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:56.467 08:35:41 -- nvmf/common.sh@295 -- # e810=() 00:27:56.467 08:35:41 -- nvmf/common.sh@295 -- # local -ga e810 00:27:56.467 08:35:41 -- nvmf/common.sh@296 -- # x722=() 00:27:56.467 08:35:41 -- nvmf/common.sh@296 -- # local -ga x722 00:27:56.467 08:35:41 -- nvmf/common.sh@297 -- # mlx=() 00:27:56.467 08:35:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:56.467 08:35:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:56.467 08:35:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:56.467 08:35:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:56.467 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:56.467 08:35:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:56.467 08:35:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:56.467 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:56.467 08:35:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:56.467 08:35:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:56.467 08:35:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:56.467 08:35:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:56.467 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:56.467 08:35:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:56.467 08:35:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:56.467 08:35:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:56.467 08:35:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:56.467 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:56.467 08:35:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:56.467 08:35:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:56.467 08:35:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:56.467 08:35:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:56.467 08:35:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:56.467 08:35:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:56.467 08:35:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:56.467 08:35:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:56.467 08:35:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:56.467 08:35:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:56.467 08:35:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:56.467 08:35:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:56.467 08:35:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:56.467 08:35:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:56.467 08:35:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:56.467 08:35:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:56.467 08:35:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:56.467 08:35:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:56.467 08:35:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:56.467 08:35:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:56.467 08:35:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:56.467 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:56.467 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:27:56.467 00:27:56.467 --- 10.0.0.2 ping statistics --- 00:27:56.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:56.467 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:27:56.467 08:35:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:56.467 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:56.467 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:27:56.467 00:27:56.467 --- 10.0.0.1 ping statistics --- 00:27:56.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:56.467 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:27:56.467 08:35:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:56.467 08:35:41 -- nvmf/common.sh@410 -- # return 0 00:27:56.467 08:35:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:56.467 08:35:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:56.467 08:35:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:56.467 08:35:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:56.467 08:35:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:56.467 08:35:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:56.467 08:35:41 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:56.467 08:35:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:56.467 08:35:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:56.467 08:35:41 -- common/autotest_common.sh@10 -- # set +x 00:27:56.467 ************************************ 00:27:56.467 START TEST nvmf_target_disconnect_tc1 00:27:56.467 ************************************ 00:27:56.467 08:35:41 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:56.467 08:35:41 -- host/target_disconnect.sh@32 -- # set +e 00:27:56.467 08:35:41 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:56.467 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.467 [2024-11-26 08:35:41.988938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.467 [2024-11-26 08:35:41.989104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.467 [2024-11-26 08:35:41.989135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc67b40 with addr=10.0.0.2, port=4420 00:27:56.467 [2024-11-26 08:35:41.989170] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:56.467 [2024-11-26 08:35:41.989198] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:56.467 [2024-11-26 08:35:41.989213] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:56.467 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:56.467 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:56.467 Initializing NVMe Controllers 00:27:56.467 08:35:41 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:56.467 08:35:41 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:56.467 08:35:41 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:56.467 08:35:41 -- common/autotest_common.sh@1142 -- # return 0 00:27:56.467 08:35:41 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:56.467 08:35:41 -- host/target_disconnect.sh@41 -- # set -e 00:27:56.467 00:27:56.467 real 0m0.094s 00:27:56.467 user 0m0.037s 00:27:56.467 sys 0m0.057s 00:27:56.467 08:35:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:56.467 08:35:41 -- common/autotest_common.sh@10 -- # set +x 00:27:56.467 ************************************ 00:27:56.467 END TEST nvmf_target_disconnect_tc1 00:27:56.467 ************************************ 00:27:56.468 08:35:42 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:56.468 08:35:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:56.468 08:35:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:56.468 08:35:42 -- common/autotest_common.sh@10 -- # set +x 00:27:56.468 ************************************ 00:27:56.468 START TEST nvmf_target_disconnect_tc2 00:27:56.468 ************************************ 00:27:56.468 08:35:42 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:56.468 08:35:42 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:56.468 08:35:42 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:56.468 08:35:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:56.468 08:35:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:56.468 08:35:42 -- common/autotest_common.sh@10 -- # set +x 00:27:56.468 08:35:42 -- nvmf/common.sh@469 -- # nvmfpid=1082913 00:27:56.468 08:35:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:56.468 08:35:42 -- nvmf/common.sh@470 -- # waitforlisten 1082913 00:27:56.468 08:35:42 -- common/autotest_common.sh@829 -- # '[' -z 1082913 ']' 00:27:56.468 08:35:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:56.468 08:35:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:56.468 08:35:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:56.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:56.468 08:35:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:56.468 08:35:42 -- common/autotest_common.sh@10 -- # set +x 00:27:56.468 [2024-11-26 08:35:42.069867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:56.468 [2024-11-26 08:35:42.069969] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:56.468 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.468 [2024-11-26 08:35:42.134284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:56.468 [2024-11-26 08:35:42.245898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:56.468 [2024-11-26 08:35:42.246066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:56.468 [2024-11-26 08:35:42.246092] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:56.468 [2024-11-26 08:35:42.246111] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:56.468 [2024-11-26 08:35:42.246274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:56.468 [2024-11-26 08:35:42.246345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:56.468 [2024-11-26 08:35:42.246410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:56.468 [2024-11-26 08:35:42.246415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:57.404 08:35:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:57.404 08:35:43 -- common/autotest_common.sh@862 -- # return 0 00:27:57.404 08:35:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:57.404 08:35:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 08:35:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:57.404 08:35:43 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 Malloc0 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 [2024-11-26 08:35:43.101410] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 [2024-11-26 08:35:43.129710] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:57.404 08:35:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.404 08:35:43 -- common/autotest_common.sh@10 -- # set +x 00:27:57.404 08:35:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.404 08:35:43 -- host/target_disconnect.sh@50 -- # reconnectpid=1083070 00:27:57.404 08:35:43 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:57.404 08:35:43 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:57.404 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.308 08:35:45 -- host/target_disconnect.sh@53 -- # kill -9 1082913 00:27:59.308 08:35:45 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 [2024-11-26 08:35:45.153233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Read completed with error (sct=0, sc=8) 00:27:59.308 starting I/O failed 00:27:59.308 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 [2024-11-26 08:35:45.153575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Write completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 Read completed with error (sct=0, sc=8) 00:27:59.309 starting I/O failed 00:27:59.309 [2024-11-26 08:35:45.153894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 [2024-11-26 08:35:45.154112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.154406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.154720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.154884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.155035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.155332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.155588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.155757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.155878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.156001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.156027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.156147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.156309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.309 [2024-11-26 08:35:45.156334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-26 08:35:45.156466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.156595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.156620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.156735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.156864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.156890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.156999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.157318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.157591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.157862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.157981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.158077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.158347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.158635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.158792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.158896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.159214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.159500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.159762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.159892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.160000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.160345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.160609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.160767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.160893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.161249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.161546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.161852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.161970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.310 [2024-11-26 08:35:45.162017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-26 08:35:45.162180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.162488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.162754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.162881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.162984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.163232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.163529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.163775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.163894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.164021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.164306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.164587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.164820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.164942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.165080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.165354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.165699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.165827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.165955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.166208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.166468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.166740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.166877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.167007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.167239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.167475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-26 08:35:45.167722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-26 08:35:45.167825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.167849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.167958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.168212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.168475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.168730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.168880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.168987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.169247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.169535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.169787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.169910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.170075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.170339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.170677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.170850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.170951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.171872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.171899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.172037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.172337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.172600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.172862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.172995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.173137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.173487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.173789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.173969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.174069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.174167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.174191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-26 08:35:45.174315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-26 08:35:45.174418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.174442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.174547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.174656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.174705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.174838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.174940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.174970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.175076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.175384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.175693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.175849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.175983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.176268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.176559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.176826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.176986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.177115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.177377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.177691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.177849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.177980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.178273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.178530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.178860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.178996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.179162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.179420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.179733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.179855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.179980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.180242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.180527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.180816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.180932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.181101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.181229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-26 08:35:45.181253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-26 08:35:45.181347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.181447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.181474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.181610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.181704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.181729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.181887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.181989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.182153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.182435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.182708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.182858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.182962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.183231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.183558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.183742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.183874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.184171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.184440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.184738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.184858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.184989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.185327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.185610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.185743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.185874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.186199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.186482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.186804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.186955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.187066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.187400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.187654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.187818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.187923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.188262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.188570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.188831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.188991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.189016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-26 08:35:45.189151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-26 08:35:45.189320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.189346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.189457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.189587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.189613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.189770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.189868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.189893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.189996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.190256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.190543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.190847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.190984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.191104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.191420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.191720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.191875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.191986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.192297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.192572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.192886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.192993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.193116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.193360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.193648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.193777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.193908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.194208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.194467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.194775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.194894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.195027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.195283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.195544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.195802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.195932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.196095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.196352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.196642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.196811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-26 08:35:45.196916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.197053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-26 08:35:45.197078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.197211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.197498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.197761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.197889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.197989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.198288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.198590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.198870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.198996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.199135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.199363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.199692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.199824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.199928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.200244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.200497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.200762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.200893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.201055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.201360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.201647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.201820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.201946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.202245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.202540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.202840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.202996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.203149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.203255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.203282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-26 08:35:45.203394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-26 08:35:45.203497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.203521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.203629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.203730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.203755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.203862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.204184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.204445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.204764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.204944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.205051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.205369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.205621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.205813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.205947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.206224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.206522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.206796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.206928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.207036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.207296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.207601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.207751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.207907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.208194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.208473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.208773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.208907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.209062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.209351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.209606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.209752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.209884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.210135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.210457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.210729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.210859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.210966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.211098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.211123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.211257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.211411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-26 08:35:45.211436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-26 08:35:45.211541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.211674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.211709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.211821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.211993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.212152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.212442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.212775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.212957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.213105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.213327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.213640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.213805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.213937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.214234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.214542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.214857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.214995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.215174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.215440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.215827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.215959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.216237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.216466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.216710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.216838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.216966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.217289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.217541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.217724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.217877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.218195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.218486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.218784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.218939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.219047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.219346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-26 08:35:45.219680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-26 08:35:45.219811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.219944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.220188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.220421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.220713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.220893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.221050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.221377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.221667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.221790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.221953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.222283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.222528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.222795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.222951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.223123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.223377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.223661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.223820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.223954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.224258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.224513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.224835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.224965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.225120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.225454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.225775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.225936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.226085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.226438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.226714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.226848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.226982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.227284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.227581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.227863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.227967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-26 08:35:45.228001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-26 08:35:45.228131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.228369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.228679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.228850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.228981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.229264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.229577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.229742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.229883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.230208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.230505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.230765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.230896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.231028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.231349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.231632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.231805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.231905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.232225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.232529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.232837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.232989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.233123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.233447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.233702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.233865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.233962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.234249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.234534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.234785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.234964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.235075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.235210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.235235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-26 08:35:45.235396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-26 08:35:45.235520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.235544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.235713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.235811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.235837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.235991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.236267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.236520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.236773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.236951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.237062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.237379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.237665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.237814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.237924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.238214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.238501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.238739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.238921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.239047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.239314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.239615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.239757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.239917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.240205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.240477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.240741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.240919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.241056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.241312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.241596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.241866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.241993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.242123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.242405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.242663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.242823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.242975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.243080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.243104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-26 08:35:45.243200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.243331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-26 08:35:45.243355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.243485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.243649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.243674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.243820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.243955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.243982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.244112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.244374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.244658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.244794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.244922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.245213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.245492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.245804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.245989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.246102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.246357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.246612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.246803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.246901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.247147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.247406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.247713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.247869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.247993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.248277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.248555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.248870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.248974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.249159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.249392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.249671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.249832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.249959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.250207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.250512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.250824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.250950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.251081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.251211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.599 [2024-11-26 08:35:45.251236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.599 qpair failed and we were unable to recover it. 00:27:59.599 [2024-11-26 08:35:45.251337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.251468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.251492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.251592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.251712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.251738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.251867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.251998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.252130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.252376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.252678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.252837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.252964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.253243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.253522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.253835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.253991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.254114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.254360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.254651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.254811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.254938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.255231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.255493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.255789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.255946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.256106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.256363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.256614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.256866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.256996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.257125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.257427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.257718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.257876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.257975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.258266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.258522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.258826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.258982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.600 [2024-11-26 08:35:45.259116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.259245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.600 [2024-11-26 08:35:45.259270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.600 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.259428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.259581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.259606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.259744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.259852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.259877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.260001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.260216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.260463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.260723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.260877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.261014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.261278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.261577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.261741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.261872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.262157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.262418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.262683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.262841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.262975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.263260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.263511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.263753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.263906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.264020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.264280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.264530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.264809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.264933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.265065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.265376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.265665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.265847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.265986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.266309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.266552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.266839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.266991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.267016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.601 qpair failed and we were unable to recover it. 00:27:59.601 [2024-11-26 08:35:45.267151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.601 [2024-11-26 08:35:45.267288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.267315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.267449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.267553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.267578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.267717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.267848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.267872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.267979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.268220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.268458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.268711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.268870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.269025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.269291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.269574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.269874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.269995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.270123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.270362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.270617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.270784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.270897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.271143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.271478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.271747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.271870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.272001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.272287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.272595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.272851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.272978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.273112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.273437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.273773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.273906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.602 qpair failed and we were unable to recover it. 00:27:59.602 [2024-11-26 08:35:45.274047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.602 [2024-11-26 08:35:45.274175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.274329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.274628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.274854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.274985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.275173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.275475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.275717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.275868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.275971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.276255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.276566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.276853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.276978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.277106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.277382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.277607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.277848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.277980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.278116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.278426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.278739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.278863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.278971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.279220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.279498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.279841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.279971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.280079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.280327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.280605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.280742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.280879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.281190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.281478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.603 [2024-11-26 08:35:45.281742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.603 [2024-11-26 08:35:45.281874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.603 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.281981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.282242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.282543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.282777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.282935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.283042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.283326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.283567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.283827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.283953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.284083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.284338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.284568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.284859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.284983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.285106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.285422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.285714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.285870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.285978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.286229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.286518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.286835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.286984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.287121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.287403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.287729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.287887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.288039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.288334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.288571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.288726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.288884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.289176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.289480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.604 qpair failed and we were unable to recover it. 00:27:59.604 [2024-11-26 08:35:45.289794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.604 [2024-11-26 08:35:45.289922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.289947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.290045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.290308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.290614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.290886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.290993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.291117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.291457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.291706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.291886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.291985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.292279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.292550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.292734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.292870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.293125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.293407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.293667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.293807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.293917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.294231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.294481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.294731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.294892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.294999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.295284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.295538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.295830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.295959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.296074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.296320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.296600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.296881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.296984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.297011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.297143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.297270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.297295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.605 [2024-11-26 08:35:45.297424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.297579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.605 [2024-11-26 08:35:45.297604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.605 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.297712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.297820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.297845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.297951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.298239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.298537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.298856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.298986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.299144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.299455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.299740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.299870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.300011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.300288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.300581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.300733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.300888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.301157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.301441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.301669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.301834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.301939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.302258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.302573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.302844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.302998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.303119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.303427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.303682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.303848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.303951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.304230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.304564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.304829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.304982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.305007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.305135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.305241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.305265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.606 qpair failed and we were unable to recover it. 00:27:59.606 [2024-11-26 08:35:45.305429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.305533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.606 [2024-11-26 08:35:45.305558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.305663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.305791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.305815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.305927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.306196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.306414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.306679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.306875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.307031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.307342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.307621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.307799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.307929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.308218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.308553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.308873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.308977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.309163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.309435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.309706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.309894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.310004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.310226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.310488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.310782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.310914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.311053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.311362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.311589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.311874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.311975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.312135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.312443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.607 qpair failed and we were unable to recover it. 00:27:59.607 [2024-11-26 08:35:45.312704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.607 [2024-11-26 08:35:45.312888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.313047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.313340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.313621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.313884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.313977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.314130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.314441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.314653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.314820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.314951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.315208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.315498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.315733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.315885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.316014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.316282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.316594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.316851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.316975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.317108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.317333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.317550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.317861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.317997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.318132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.318393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.318676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.318889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.319016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.319271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.319556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.319848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.319978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.320072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.320198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.320223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.320351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.320457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.320482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.608 qpair failed and we were unable to recover it. 00:27:59.608 [2024-11-26 08:35:45.320608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.608 [2024-11-26 08:35:45.320730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.320756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.320887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.321172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.321427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.321663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.321799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.321931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.322160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.322418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.322674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.322864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.323072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.323358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.323610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.323762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.323914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.324172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.324417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.324666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.324831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.324953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.325240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.325473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.325656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.325871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.326158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.326409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.326638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.326797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.326903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.327058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.327083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 [2024-11-26 08:35:45.327212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.327340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.609 [2024-11-26 08:35:45.327367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:27:59.609 qpair failed and we were unable to recover it. 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Read completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.609 starting I/O failed 00:27:59.609 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Read completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Read completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Read completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Read completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Read completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 Write completed with error (sct=0, sc=8) 00:27:59.610 starting I/O failed 00:27:59.610 [2024-11-26 08:35:45.327681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:59.610 [2024-11-26 08:35:45.327841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.327986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.328153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.328418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.328733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.328898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.329061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.329348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.329637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.329781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.329911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.330137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.330394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.330695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.330849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.330981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.331294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.331581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.331843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.331993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.332130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.332420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.332732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.332853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.333013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.333245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.333523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.333741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.333893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.334029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.334128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.334154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.610 [2024-11-26 08:35:45.334284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.334406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.610 [2024-11-26 08:35:45.334432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.610 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.334564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.334664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.334698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.334837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.334998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.335126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.335394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.335667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.335809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.335912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.336166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.336438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.336694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.336843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.336942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.337177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.337499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.337785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.337949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.338087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.338340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.338646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.338788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.338918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.339201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.339481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.339742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.339895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.340026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.340280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.340624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.340781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.340916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.341052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.341078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.611 [2024-11-26 08:35:45.341186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.341296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.611 [2024-11-26 08:35:45.341324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.611 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.341423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.341530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.341557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.341661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.341797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.341823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.341931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.342221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.342536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.342821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.342979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.343088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.343373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.343635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.343812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.343913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.344176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.344425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.344759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.344913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.345074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.345339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.345623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.345776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.345877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.346169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.346484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.346738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.346893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.347020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.347305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.347511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.347793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.347950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.348079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.348387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.348611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.348799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.348926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.349054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.349080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.612 qpair failed and we were unable to recover it. 00:27:59.612 [2024-11-26 08:35:45.349190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.612 [2024-11-26 08:35:45.349287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.349312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.349444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.349600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.349624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.349741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.349895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.349920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.350052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.350335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.350614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.350796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.350892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.351142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.351422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.351738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.351867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.352023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.352252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.352496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.352804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.352959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.353079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.353359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.353636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.353816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.353950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.354233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.354471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.354747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.354873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.354978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.355230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.355486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.355732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.355889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.355992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.356249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.356520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.356814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.613 [2024-11-26 08:35:45.356992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.613 qpair failed and we were unable to recover it. 00:27:59.613 [2024-11-26 08:35:45.357123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.357398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.357674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.357840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.357943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.358250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.358476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.358749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.358913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.359067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.359317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.359576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.359855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.359979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.360085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.360376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.360631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.360761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.360883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.361209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.361498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.361854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.361985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.362192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.362506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.362824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.362997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.363176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.363333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.363358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.363496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.363621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.363645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.363818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.363992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.364173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.364475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.364746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.364899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.365022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.365164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.365191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.614 qpair failed and we were unable to recover it. 00:27:59.614 [2024-11-26 08:35:45.365337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.365491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.614 [2024-11-26 08:35:45.365515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.365644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.365849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.366027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.366336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.366632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.366795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.366895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.367186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.367501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.367771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.367908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.368064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.368388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.368684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.368863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.368998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.369292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.369569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.369851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.369976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.370099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.370422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.370709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.370850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.370957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.371269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.371547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.371798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.371926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.372055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.372365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.372614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.372826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.372935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.373222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.373496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.615 qpair failed and we were unable to recover it. 00:27:59.615 [2024-11-26 08:35:45.373778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.615 [2024-11-26 08:35:45.373934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.373959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.374091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.374449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.374757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.374879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.374975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.375279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.375607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.375788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.375940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.376221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.376493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.376754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.376908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.377059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.377452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.377740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.377859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.378030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.378346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.378693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.378866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.378994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.379253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.379513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.379734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.379887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.380174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.380461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.380772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.380934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.381077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.381181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.381208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.616 qpair failed and we were unable to recover it. 00:27:59.616 [2024-11-26 08:35:45.381362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.616 [2024-11-26 08:35:45.381532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.381556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.381679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.381836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.381861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.381990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.382325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.382584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.382737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.382867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.383133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.383430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.383762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.383883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.383991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.384365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.384678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.384858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.385038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.385340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.385681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.385858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.385981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.386259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.386550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.386730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.386862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.387198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.387470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.387718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.387849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.387950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.388255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.388560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.388762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.388898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.389133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.389437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.389734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.617 [2024-11-26 08:35:45.389888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.617 qpair failed and we were unable to recover it. 00:27:59.617 [2024-11-26 08:35:45.390040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.390354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.390644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.390831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.391012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.391350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.391599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.391783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.391926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.392187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.392471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.392748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.392893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.393020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.393347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.393680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.393869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.394003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.394292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.394542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.394848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.394980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.395125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.395420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.395717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.395847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.395976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.396283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.396653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.396827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.396935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.397269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.397525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.397786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.397987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.618 qpair failed and we were unable to recover it. 00:27:59.618 [2024-11-26 08:35:45.398120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.618 [2024-11-26 08:35:45.398298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.398323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.398453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.398579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.398604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.398746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.398891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.398919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.399088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.399398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.399715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.399835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.399961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.400291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.400630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.400772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.400911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.401225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.401486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.401789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.401927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.402050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.402375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.402696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.402849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.402975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.403248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.403543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.403816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.403976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.404082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.404366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.404653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.404808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.404909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.405174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.405481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.405718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.405851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.405956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.406062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.406086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.619 [2024-11-26 08:35:45.406211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.406340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.619 [2024-11-26 08:35:45.406364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.619 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.406494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.406628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.406653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.406811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.406913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.406937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.407031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.407264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.407556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.407830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.407986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.408141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.408374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.408661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.408790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.408924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.409155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.409392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.409648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.409816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.409945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.410182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.410451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.410675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.410813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.410915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.411190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.411435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.411722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.411876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.412000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.412251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.412535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.620 qpair failed and we were unable to recover it. 00:27:59.620 [2024-11-26 08:35:45.412771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.620 [2024-11-26 08:35:45.412877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.412901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.413002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.413286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.413575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.413843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.413995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.414100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.414430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.414712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.414838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.414968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.415215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.415473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.415758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.415887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.416010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.416263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.416499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.416753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.416881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.417005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.417237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.417529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.417834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.417988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.418119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.418377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.418635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.418791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.418889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.419130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.419366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.419644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.419887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.419994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.420019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.621 qpair failed and we were unable to recover it. 00:27:59.621 [2024-11-26 08:35:45.420176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.420269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.621 [2024-11-26 08:35:45.420294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.420399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.420527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.420552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.420666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.420784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.420809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.420933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.421149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.421412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.421718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.421845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.421974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.422201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.422485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.422739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.422868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.422974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.423224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.423490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.423731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.423888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.622 qpair failed and we were unable to recover it. 00:27:59.622 [2024-11-26 08:35:45.423984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.622 [2024-11-26 08:35:45.424084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.424203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.424430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.424653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.424890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.424989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.425117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.425366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.425617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.425874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.425976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.426145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.426485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.426781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.426907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.427045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.427269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.427521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.427746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.427877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.428010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.428277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.428528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.428756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.428915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-26 08:35:45.429021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.429123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-26 08:35:45.429148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.429276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.429532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.429803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.429927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.430035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.430273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.430535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.430843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.430976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.431101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.431367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.431617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.431783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.431914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.432150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.432372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.432653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.432784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.432899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.433154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.433377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.433672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.433835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.433936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.434195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.434456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.434710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.434842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.434975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.435231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.435476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.435743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.435861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.435966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.436073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.436097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.436210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.436341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.436366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-26 08:35:45.436470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-26 08:35:45.436597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.436621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.436759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.436865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.436889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.437021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.437310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.437601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.437853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.437979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.438138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.438392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.438655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.438789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.438901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.439188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.439415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.439637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.439761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.439896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.440148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.440463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.440713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.440842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.440951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.441228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.441473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.441708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.441854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.441977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.442245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.442502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.442738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.442866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.442964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.443275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.443497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-26 08:35:45.443786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-26 08:35:45.443913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.444048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.444329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.444601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.444887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.444978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.445103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.445414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.445662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.445795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.445903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.446129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.446381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.446643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.446781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.446919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.447191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.447442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.447701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.447828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.447923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.448171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.448402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.448644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.448879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.448987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.449148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.449396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.449718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.449846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.449943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.450229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.450485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.450779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.450905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.451014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.451111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.451135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-26 08:35:45.451269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.451378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-26 08:35:45.451402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.451532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.451666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.451695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.451807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.451912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.451936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.452062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.452312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.452571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.452820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.452940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.453081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.453310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.453621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.453858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.453983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.454105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.454343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.454601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.454842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.454989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.455121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.455369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.455699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.455830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.455964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.456215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.456537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.456777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.456903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.457005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.457307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.457566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-26 08:35:45.457741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-26 08:35:45.457877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.457985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.458112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.458346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.458573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.458835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.458983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.459136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.459388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.459674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.459838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.459932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.460196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.460430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.460670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.460827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.460954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.461256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.461512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.461740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.461895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.462035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.462310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.462562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.462843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.462996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.463119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.463375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.463616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.463787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.463899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.464162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.464436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.464735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.464860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.464988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.465084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.465109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-26 08:35:45.465206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.465307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-26 08:35:45.465332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.465443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.465597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.465621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.465716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.465809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.465834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.465964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.466195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.466489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.466733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.466886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.466986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.467239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.467473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.467705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.467865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.467970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.468258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.468566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.468831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.468968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.469103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.469379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.469639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.469792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.469895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.470157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.470439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.470662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.470848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.470979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.471219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.471461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.471740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.471891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.471991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.472215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.472489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-26 08:35:45.472778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-26 08:35:45.472886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.472911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.473042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.473350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.473585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.473829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.473984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.474088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.474325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.474587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.474822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.474969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.475066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.475355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.475607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.475891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.475990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.476121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.476409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.476641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.476798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.476926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.477193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.477438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.477690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.477849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.477950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.478186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.478421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.478672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.478805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.478934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.479200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.479474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.479722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.479851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.479980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.480132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.480156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-26 08:35:45.480263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-26 08:35:45.480365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.480391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.480519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.480624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.480647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.480752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.480885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.480909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.481012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.481288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.481553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.481803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.481926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.482055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.482313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.482535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.482791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.482939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.483044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.483326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.483605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.483798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.483931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.484172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.484426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.484690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.484852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.484953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.485285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.485532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.485778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.485913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.486023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.486324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.486542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.486810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.486939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.487049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.487274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.487518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-26 08:35:45.487710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-26 08:35:45.487809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.487936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.487960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.488083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.488351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.488604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.488851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.488970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.489068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.489334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.489593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.489824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.489976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.490109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.490363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.490637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.490870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.490986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.491140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.491371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.491597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.491871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.491982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.492111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.492382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.492611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.492765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.492876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.493117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.493371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.493626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.493782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.493878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.494012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.494037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-26 08:35:45.494146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-26 08:35:45.494269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.494293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.494394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.494527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.494556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.494647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.494785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.494811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.494913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.495151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.495370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.495596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.495850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.495976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.496114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.496381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.496652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.496788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.496898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.497150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.497418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.497663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.497824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.497978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.498238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.498482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.498752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.498886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.498985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.499236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.499518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.499795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.499914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.500019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.500278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.500528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.500792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.500922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.501049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.501150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.501177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.501305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.501401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.501426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-26 08:35:45.501533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-26 08:35:45.501638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.501663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.501812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.501905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.501930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.502060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.502367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.502617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.502878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.502984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.503107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.503347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.503598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.503819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.503968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.504063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.504327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.504554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.504817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.504941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.505049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.505328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.505576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.505817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.505987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.506141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.506359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.506597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.506888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.506998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.507122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.507371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.507630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.507861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.507983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.508084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.508214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.508238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.508350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.508473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.508498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-26 08:35:45.508607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-26 08:35:45.508743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.508769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.508880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.508983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.509135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.509389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.509645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.509858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.509987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.510260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.510546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.510809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.510929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.511036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.511292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.511525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.511767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.511917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.512056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.512292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.512543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.512779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.512936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.513068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.513299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.513547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.513806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.513934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.514065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.514276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.514514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.514831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.514986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.515109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.515358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.515639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-26 08:35:45.515900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.515994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-26 08:35:45.516020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.516111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.516421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.516654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.516801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.516933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.517218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.517509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.517770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.517892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.517996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.518272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.518522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.518780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.518931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.519065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.519311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.519592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.519771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.519897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.520183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.520466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.520726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.520881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.520975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.521224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.521450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.521700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.521819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.521948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.522204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.522439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.522703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.522837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.522947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.523072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.523097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.523218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.523348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.523373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-26 08:35:45.523514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-26 08:35:45.523638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.523662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.523782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.523882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.523906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.524008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.524288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.524544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.524775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.524897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.525013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.525282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.525542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.525859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.525979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.526104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.526352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.526622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.526775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.526883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.527136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.527401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.527678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.527859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.527949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.528177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.528424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.528716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.528873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.528972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.529235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.529476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.529751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.529886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-26 08:35:45.530013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.530124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-26 08:35:45.530148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.530255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.530543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.530788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.530932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.531036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.531296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.531578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.531812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.531960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.532062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.532320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.532600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.532856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.532977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.533113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.533433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.533698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.533829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.533966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.534445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.534733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.534889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.534995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.535262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.535530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.535760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.535915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.536041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.536291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.536555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.536739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.536870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.537130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.537364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-26 08:35:45.537597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-26 08:35:45.537747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.537883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.537983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.538114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.538409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.538678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.538830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.538933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.539236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.539515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.539783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.539913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.540044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.540302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.540624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.540786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.540940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.541294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.541613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.541758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.541902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.542154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.542473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.542746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.542919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.543039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.543324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.543640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.543764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.543917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.544242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.544512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.544818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.544937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.545067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.545377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.545670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.545892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-26 08:35:45.546035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-26 08:35:45.546162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.546186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.546317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.546451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.546475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.546575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.546699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.546729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.546895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.547195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.547496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.547774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.547902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.548036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.548274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.548518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.548807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.548935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.549125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.549387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.549651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.549799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.549905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.550157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.550432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.550663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.550821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.550936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.551258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.551559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.551854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.551987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.552131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.552379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.552666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.552835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.552983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.553310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.553567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.553726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-26 08:35:45.553885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.554024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-26 08:35:45.554049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.554213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.554492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.554755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.554907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.555056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.555390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.555628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.555780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.555906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.556188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.556489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.556803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.556929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.557060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.557284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.557574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.557738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.557892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.558179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.558481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.558773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.558908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.559036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.559291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.559549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.559831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.559972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.560087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.560373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.560655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.560785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-26 08:35:45.560925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.561075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-26 08:35:45.561100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.561218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.561526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.561842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.561998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.562153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.562465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.562736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.562863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.562977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.563250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.563559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.563871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.563991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.564177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.564407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.564696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.564853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.564955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.565302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.565589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.565767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.565884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.566036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.566064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.566198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.566309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.566336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-26 08:35:45.566509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-26 08:35:45.566615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.566639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.566769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.566912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.566939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.567073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.567362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.567639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.567885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.567994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.568135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.568440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.568762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.568927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.569020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.569260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.569541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.569847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.569976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.570000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-26 08:35:45.570154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-26 08:35:45.570263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.570289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.570399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.570513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.570541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.570648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.570782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.570808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.570915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.571229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.571547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.571835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.571975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.572135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.572510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.572774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.572902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.573041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.573157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.573184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.573311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.573417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.573441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-26 08:35:45.573566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-26 08:35:45.573671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.573719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.573851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.573963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.573990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.574132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.574406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.574717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.574887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.574993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.575262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.575580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.575820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-26 08:35:45.575975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-26 08:35:45.576122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.576396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.576670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.576822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.576951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.577230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.577524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.577801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.577960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-26 08:35:45.578085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-26 08:35:45.578202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.578229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.578365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.578477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.578505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.578632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.578745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.578773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.578946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.579242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.579491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-26 08:35:45.579754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-26 08:35:45.579888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.579993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.580299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.580565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.580851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.580992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.581179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.581515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-26 08:35:45.581824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-26 08:35:45.581971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.582093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.582355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.582658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.582809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.582947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.583236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-26 08:35:45.583578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-26 08:35:45.583745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.583871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.583985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.584122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.584456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.584764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.584920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.585068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.585177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.585204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.585347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.585500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.585528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-26 08:35:45.585643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-26 08:35:45.585810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.585835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.585945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.586243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.586560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.586849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.586982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.587166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.587408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.935 qpair failed and we were unable to recover it. 00:27:59.935 [2024-11-26 08:35:45.587720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.935 [2024-11-26 08:35:45.587851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.587879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.587989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.588242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.588540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.588835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.588998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.589121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.589239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.589267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.936 [2024-11-26 08:35:45.589429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.589526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.936 [2024-11-26 08:35:45.589551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.936 qpair failed and we were unable to recover it. 00:27:59.937 [2024-11-26 08:35:45.589730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.589854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.589879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.937 qpair failed and we were unable to recover it. 00:27:59.937 [2024-11-26 08:35:45.589980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.937 qpair failed and we were unable to recover it. 00:27:59.937 [2024-11-26 08:35:45.590198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.937 qpair failed and we were unable to recover it. 00:27:59.937 [2024-11-26 08:35:45.590468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.937 [2024-11-26 08:35:45.590616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.938 qpair failed and we were unable to recover it. 00:27:59.938 [2024-11-26 08:35:45.590736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.590835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.590860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.938 qpair failed and we were unable to recover it. 00:27:59.938 [2024-11-26 08:35:45.590973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.591104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.591128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.938 qpair failed and we were unable to recover it. 00:27:59.938 [2024-11-26 08:35:45.591280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.591373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.938 [2024-11-26 08:35:45.591398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.938 qpair failed and we were unable to recover it. 00:27:59.938 [2024-11-26 08:35:45.591531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.591665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.591699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.939 qpair failed and we were unable to recover it. 00:27:59.939 [2024-11-26 08:35:45.591801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.591974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.591999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.939 qpair failed and we were unable to recover it. 00:27:59.939 [2024-11-26 08:35:45.592140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.939 qpair failed and we were unable to recover it. 00:27:59.939 [2024-11-26 08:35:45.592428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.939 qpair failed and we were unable to recover it. 00:27:59.939 [2024-11-26 08:35:45.592749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.592881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.939 qpair failed and we were unable to recover it. 00:27:59.939 [2024-11-26 08:35:45.593002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.939 [2024-11-26 08:35:45.593114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.593286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.593539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.593795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.593925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.594085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.594372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.940 qpair failed and we were unable to recover it. 00:27:59.940 [2024-11-26 08:35:45.594651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.940 [2024-11-26 08:35:45.594792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.941 qpair failed and we were unable to recover it. 00:27:59.941 [2024-11-26 08:35:45.594920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.941 qpair failed and we were unable to recover it. 00:27:59.941 [2024-11-26 08:35:45.595193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.941 qpair failed and we were unable to recover it. 00:27:59.941 [2024-11-26 08:35:45.595479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.941 qpair failed and we were unable to recover it. 00:27:59.941 [2024-11-26 08:35:45.595731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.941 [2024-11-26 08:35:45.595908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.596013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.596325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.596623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.596789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.596911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.597221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.597499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.597761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.597933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.598064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.598389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.598639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.598785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.598926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.599204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.599454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.599758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.599909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.600015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.600272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.600562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.600694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.600854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.601137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.601459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.601735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.601860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.602011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.602299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.602620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.602881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.602982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.603103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.603401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.603683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.603834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.603972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.604202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.604530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.604756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.604889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.604989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.605288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.605535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.605797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.605925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.606082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.606378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.606679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.606833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.994 qpair failed and we were unable to recover it. 00:27:59.994 [2024-11-26 08:35:45.606940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.607068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.994 [2024-11-26 08:35:45.607095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.607215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.607452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.607755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.607899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.608054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.608289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.608519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.608822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.608966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.609076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.609386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.609667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.609809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.609908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.610241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.610517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.610778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.610943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.611057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.611296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.611600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.611826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.611968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.612119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.612418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.612721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.612856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.612961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.613203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.613486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.613755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.613881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.614010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.614287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.614544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.614826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.614950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.615059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.615282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.615559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.615760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.615924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.616178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.616437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.616711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.616879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.616980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.617255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.617523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.617797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.617933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.618079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.618331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.618597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.618859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.618998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.619136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.619368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.619645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.619830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.619941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.620197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.620496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.620763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.620892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.621026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.621295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.621516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.995 qpair failed and we were unable to recover it. 00:27:59.995 [2024-11-26 08:35:45.621788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.995 [2024-11-26 08:35:45.621917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.621942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.622116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.622445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.622716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.622860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.622995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.623321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.623578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.623809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.623951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.624096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.624388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.624674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.624856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.624978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.625260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.625553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.625813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.625947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.626068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.626367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.626646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.626790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.626944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.627171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.627396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.627696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.627816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.627923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.628235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.628506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.628819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.628964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.629121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.629348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.629621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.629823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.629921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.630178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.630459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.630737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.630903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.631058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.631439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.631717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.631863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.632021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.632347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.632648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.632785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.632928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.633180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.633467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.633764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.633885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.634038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.634320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.634609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.634768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.634895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.635198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.635468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.635787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.635923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.996 [2024-11-26 08:35:45.636094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.636223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.996 [2024-11-26 08:35:45.636247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.996 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.636381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.636526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.636554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.636671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.636862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.636887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.636991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.637260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.637540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.637846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.637979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.638125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.638433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.638669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.638830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.638960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.639278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.639639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.639850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.639960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.640266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.640545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.640867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.640990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.641100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.641385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.641641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.641814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.641963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.642202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.642483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.642730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.642868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.643003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.643340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.643652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.643906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.643999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.644198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.644482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.644750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.644931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.645072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.645385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.645662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.645836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.645951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.646258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.646531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.646832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.646972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.647088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.647364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.647659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.647802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.647948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.648202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.648452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.648720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.648847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.649026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.649317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.649658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.649800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.649937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.650267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.650535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.650842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.650996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.651125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.651376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.651632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.651808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.651914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.652084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.997 [2024-11-26 08:35:45.652113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.997 qpair failed and we were unable to recover it. 00:27:59.997 [2024-11-26 08:35:45.652251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.652534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.652796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.652949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.653095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.653455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.653733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.653868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.653978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.654302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.654598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.654849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.654975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.655070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.655354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.655615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.655899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.655998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.656144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.656488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.656770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.656933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.657052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.657320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.657583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.657848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.657999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.658166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.658478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.658713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.658890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.659079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.659358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.659659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.659860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.659996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.660315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.660622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.660748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.660856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.661201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.661458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.661706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.661864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.662000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.662258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.662566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.662826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.662990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.663131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.663386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.663678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.663822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.663932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.664281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.664551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.664847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.664971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.665136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.665427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.665789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.665911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.666017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.666512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.666826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.666998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.667149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.667276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.667300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.667462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.667580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.998 [2024-11-26 08:35:45.667604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.998 qpair failed and we were unable to recover it. 00:27:59.998 [2024-11-26 08:35:45.667751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.667901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.667925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.668056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.668359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.668617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.668753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.668866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.669191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.669505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.669733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.669886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.670056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.670304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.670609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.670757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.670883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.671210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.671469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.671719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.671858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.671970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.672262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.672583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.672762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.672905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.673192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.673540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.673802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.673952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.674111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.674369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.674651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.674801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.674963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.675240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.675546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.675828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.675959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.676065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.676369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.676679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.676879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.676996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.677275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.677540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.677834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.677965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.678137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.678385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.678707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.678843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.678964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.679270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.679505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.679835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.679976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.680155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.680425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.680733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.680869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.681008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.681260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.681559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.681846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.681986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.682014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.682132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.682255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.682280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:27:59.999 [2024-11-26 08:35:45.682389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.682510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.999 [2024-11-26 08:35:45.682535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:27:59.999 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.682697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.682808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.682833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.682971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.683251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.683517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.683835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.683977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.684113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.684408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.684669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.684869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.685036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.685341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.685643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.685895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.685998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.686130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.686398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.686676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.686813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.686906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.687162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.687451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.687715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.687864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.687989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.688289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.688564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.688841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.688973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.689126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.689461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.689737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.689884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.689979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.690263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.690569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.690852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.690988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.691130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.691371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.691665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.691833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.691936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.692202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.692430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.692739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.692880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.693006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.693361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.693644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.693802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.693910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.694158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.694762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.694965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.695095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.695356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.695659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.695787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.695885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.696172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.696448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.696764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.696895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.697005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.697327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.697588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.697733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.697917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.698042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.698083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.000 qpair failed and we were unable to recover it. 00:28:00.000 [2024-11-26 08:35:45.698200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.000 [2024-11-26 08:35:45.698338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.698365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.698477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.698621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.698648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.698833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.698934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.698959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.699069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.699326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.699619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.699835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.699979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.700100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.700346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.700626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.700791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.700934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.701297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.701578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.701724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.701897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.702212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.702463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.702740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.702890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.703025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.703326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.703657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.703796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.703924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.704268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.704604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.704859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.704980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.705129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.705410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.705691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.705828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.705956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.706212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.706473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.706824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.706952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.707053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.707300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.707584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.707733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.707912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.708176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.708412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.708704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.708881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.709019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.709339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.709574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.709758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.709927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.710171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.710489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.710722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.710873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.711015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.711301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.711595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.711851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.711977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.712156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.712434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.001 qpair failed and we were unable to recover it. 00:28:00.001 [2024-11-26 08:35:45.712756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.001 [2024-11-26 08:35:45.712863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.712887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.713008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.713306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.713601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.713776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.713906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.714145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.714463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.714680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.714844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.714959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.715251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.715561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.715872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.715965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.716131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.716367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.716672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.716819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.716930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.717206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.717486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.717803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.717963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.718079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.718364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.718645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.718819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.718929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.719233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.719509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.719768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.719913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.720056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.720338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.720689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.720858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.720997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.721259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.721569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.721742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.721888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.722208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.722486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.722810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.722941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.723070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.723354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.723625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.723758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.723937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.724208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.724460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.724791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.724923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.725018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.725629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.725784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.725911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.726196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.726430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.726757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.726932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.727046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.727320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.727622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.727778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.727909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.728173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.002 [2024-11-26 08:35:45.728483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.002 [2024-11-26 08:35:45.728615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.002 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.728734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.728872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.728897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.729041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.729402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.729724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.729901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.730056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.730368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.730695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.730874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.730968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.731234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.731512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.731710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.731860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.732287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.732659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.732802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.732934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.733257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.733505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.733783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.733908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.734032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.734377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.734745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.734876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.735007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.735240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.735486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.735730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.735885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.735989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.736207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.736522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.736855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.736989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.737173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.737457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.737815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.737968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.003 [2024-11-26 08:35:45.738128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.738238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.003 [2024-11-26 08:35:45.738264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.003 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.738421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.738556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.738580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.738716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.738829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.738860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.739001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.739331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.739643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.739781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.739923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.740209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.740523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.740807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.740958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.741055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.741340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.741655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.741886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.741988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.742123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.742403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.742653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.742837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.742966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.743268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.743549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.743885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.743987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.744010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.744120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.744225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.744248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.290 qpair failed and we were unable to recover it. 00:28:00.290 [2024-11-26 08:35:45.744387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.290 [2024-11-26 08:35:45.744523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.744550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.744656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.744795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.744824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.744941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.745261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.745550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.745844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.745986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.746102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.746436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.746697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.746865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.746982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.747318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.747674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.747811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.747941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.748219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.748492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.748823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.748955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.749109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.749446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.749781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.749908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.750050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.750314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.750626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.750775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.750923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.751373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.751710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.751885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.752039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.752332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.752666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.752840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.752976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.753257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.753541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.753852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.753981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.754121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.754296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.754324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.754461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.754605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.291 [2024-11-26 08:35:45.754632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.291 qpair failed and we were unable to recover it. 00:28:00.291 [2024-11-26 08:35:45.754744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.754907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.754935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.755060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.755398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.755728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.755873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.755983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.756277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.756570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.756742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.756888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.757211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.757495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.757751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.757934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.758075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.758356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.758644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.758783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.758936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.759219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.759581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.759801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.759931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.760272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.760553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.760855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.760997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.761174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.761476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.761793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.761971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.762088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.762348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.762628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.762766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.762912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.763221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.763599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.763781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.763883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.764165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.764483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.764778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.292 [2024-11-26 08:35:45.764954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.292 qpair failed and we were unable to recover it. 00:28:00.292 [2024-11-26 08:35:45.765104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.765374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.765647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.765855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.765980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.766289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.766609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.766866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.766999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.767152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.767408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.767732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.767883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.768040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.768328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.768632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.768841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.768972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.769318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.769578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.769834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.769997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.770136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.770451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.770728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.770838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.770961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.771243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.771551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.771726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.771875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.772136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.772449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.772735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.772860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.773015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.773330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.773640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.773834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.773954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.774244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.774530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.293 [2024-11-26 08:35:45.774848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.774996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.293 [2024-11-26 08:35:45.775022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.293 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.775128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.775479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.775842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.775977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.776111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.776440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.776800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.776955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.777078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.777387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.777725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.777861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.777990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.778321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.778596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.778759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.778946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.779314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.779565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.779761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.779867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.780152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.780511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.780727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.780871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.781205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.781509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.781826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.781981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.782133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.782419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.782699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.782848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.782985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.783301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.783612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.783811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.783944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.784108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.784136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.294 qpair failed and we were unable to recover it. 00:28:00.294 [2024-11-26 08:35:45.784313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.294 [2024-11-26 08:35:45.784439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.784464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.784591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.784731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.784759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.784894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.785213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.785434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.785729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.785870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.785991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.786248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.786542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.786861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.786990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.787158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.787470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.787797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.787952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.788108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.788409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.788752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.788880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.789037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.789383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.789717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.789855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.790087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.790435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.790720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.790885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.791028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.791327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.791693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.791852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.792040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.792296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.792635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.792848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.792956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.793232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.793532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.793828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.793991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.794168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.794293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.794333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.794509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.794634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.295 [2024-11-26 08:35:45.794658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.295 qpair failed and we were unable to recover it. 00:28:00.295 [2024-11-26 08:35:45.794768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.794894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.794919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.795049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.795372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.795645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.795827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.795920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.796225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.796479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.796778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.796971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.797070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.797376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.797637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.797892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.797993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.798149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.798486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.798764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.798917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.799049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.799366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.799677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.799833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.799963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.800211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.800561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.800740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.800952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.801359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.801598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.801769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.801911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.802209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.802464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.802774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.802900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.803035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.803321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.803711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.803863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.803959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.804286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.804577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.296 [2024-11-26 08:35:45.804745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.296 qpair failed and we were unable to recover it. 00:28:00.296 [2024-11-26 08:35:45.804876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.805156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.805494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.805785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.805956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.806130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.806453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.806754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.806892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.807107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.807449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.807749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.807925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.808096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.808408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.808706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.808855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.809001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.809358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.809577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.809843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.809967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.810076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.810411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.810698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.810825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.810980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.811273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.811590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.811765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.811907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.812197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.812481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.812817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.812951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.813113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.813486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.813772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.813970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.814085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.814420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.814692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.814876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.297 [2024-11-26 08:35:45.815001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.815180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.297 [2024-11-26 08:35:45.815209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.297 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.815342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.815442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.815469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.815574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.815720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.815749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.815899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.816241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.816573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.816772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.816971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.817276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.817589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.817788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.817919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.818208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.818544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.818737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.818908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.819212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.819492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.819807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.819956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.820135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.820467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.820719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.820935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.821063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.821391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.821706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.821875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.822060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.822430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.822727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.822902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.823285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.823621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.823798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.823908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.824254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.824597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.298 [2024-11-26 08:35:45.824860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.824988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.298 [2024-11-26 08:35:45.825014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.298 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.825163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.825485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.825812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.825951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.826142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.826420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.826733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.826913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.827047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.827396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.827679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.827820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.827969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.828271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.828586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.828764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.828923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.829180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.829488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.829853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.829984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.830025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.830196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.830320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.830345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.830491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.830655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.830681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.830873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.831154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.831384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.831645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.831862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.831965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.832270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.832579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.832824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.832933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.833163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.833481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.833821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.833996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.834191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.834495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.834874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.834978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.835004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.299 [2024-11-26 08:35:45.835160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.835327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.299 [2024-11-26 08:35:45.835354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.299 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.835506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.835655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.835679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.835878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.836165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.836463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.836780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.836986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.837108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.837404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.837679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.837852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.837964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.838236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.838550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.838708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.838853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.839191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.839523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.839852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.839984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.840157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.840438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.840712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.840902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.841020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.841304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.841633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.841777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.841914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.842165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.842501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.842815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.842986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.843145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.843457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.843714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.843856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.844021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.844351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.844628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.844757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.844911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.845167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.300 qpair failed and we were unable to recover it. 00:28:00.300 [2024-11-26 08:35:45.845495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.300 [2024-11-26 08:35:45.845654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.845814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.845948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.845972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.846124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.846413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.846749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.846870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.846969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.847265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.847563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.847836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.847997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.848169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.848493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.848785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.848967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.849097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.849383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.849665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.849841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.849981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.850294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.850635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.850778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.850904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.851191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.851441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.851674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.851836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.851993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.852285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.852607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.852761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.852867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.853473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.853772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.853947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.854070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.854334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.854648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.854819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.854970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.855123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.855148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.855302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.855402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.855427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.301 qpair failed and we were unable to recover it. 00:28:00.301 [2024-11-26 08:35:45.855530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.301 [2024-11-26 08:35:45.855691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.855720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.855834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.855937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.855977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.856147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.856454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.856787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.856966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.857142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.857452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.857763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.857921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.858040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.858375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.858672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.858830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.858924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.859177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.859426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.859651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.859784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.859907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.860204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.860542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.860720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.860870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.861191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.861434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.861748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.861897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.862045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.862393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.862666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.862842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.862953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.863267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.863558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.863824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.863982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.864130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.864426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.302 qpair failed and we were unable to recover it. 00:28:00.302 [2024-11-26 08:35:45.864777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.302 [2024-11-26 08:35:45.864883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.864908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.865029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.865330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.865615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.865781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.865936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.866268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.866577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.866783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.866907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.867247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.867549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.867838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.867981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.868147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.868463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.868760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.868889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.869028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.869354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.869677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.869887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.869999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.870274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.870549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.870728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.870906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.871246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.871577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.871849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.871988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.872169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.872482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.872823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.872992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.873107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.873446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.873763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.873918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.874074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.874379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.874695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.874821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.874960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.875101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.875129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.303 qpair failed and we were unable to recover it. 00:28:00.303 [2024-11-26 08:35:45.875266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.303 [2024-11-26 08:35:45.875411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.875436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.875560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.875661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.875860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.875955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.875979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.876097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.876376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.876679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.876851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.876975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.877265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.877602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.877881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.877984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.878137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.878444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.878794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.878988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.879199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.879390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.879416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.879582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.879695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.879750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.879908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.880231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.880592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.880793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.880947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.881203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.881449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.881777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.881931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.882033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.882340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.882618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.882761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.882912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.883204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.883489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.883819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.883987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.884108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.884255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.884279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.884409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.884564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.884604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.884789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.884961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.885001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.885157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.885262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.885286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.885438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.885600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.304 [2024-11-26 08:35:45.885627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.304 qpair failed and we were unable to recover it. 00:28:00.304 [2024-11-26 08:35:45.885808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.885910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.885935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.886088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.886424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.886656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.886852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.886982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.887297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.887633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.887803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.887955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.888285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.888541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.888831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.888954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.889082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.889418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.889705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.889916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.890023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.890328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.890592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.890752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.890902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.891173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.891491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.891784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.891912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.892073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.892420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.892713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.892889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.893018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.893333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.893623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.893790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.893935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.894321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.894596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.894731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.894910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.895120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.305 [2024-11-26 08:35:45.895173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.305 qpair failed and we were unable to recover it. 00:28:00.305 [2024-11-26 08:35:45.895283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.895422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.895451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.895608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.895739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.895764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.895890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.896151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.896460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.896806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.896932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.897082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.897360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.897668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.897843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.898007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.898269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.898600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.898729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.898878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.899162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.899457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.899777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.899905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.899993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.900265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.900553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.900716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.900864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.901180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.901440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.901739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.901879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.902011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.902293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.902546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.902834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.902967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.903113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.903369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.903654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.903821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.903974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.904277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.904592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.904762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.306 [2024-11-26 08:35:45.904879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.905014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.306 [2024-11-26 08:35:45.905040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.306 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.905149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.905431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.905743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.905888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.906034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.906333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.906649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.906816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.906966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.907233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.907510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.907791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.907942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.908060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.908350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.908594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.908727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.908855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.909167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.909443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.909698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.909818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.909950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.910243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.910504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.910753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.910901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.911064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.911362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.911684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.911896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.912078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.912391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.912664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.912815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.912991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.913242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.913543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.913833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.913994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.914165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.914409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.307 qpair failed and we were unable to recover it. 00:28:00.307 [2024-11-26 08:35:45.914708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.307 [2024-11-26 08:35:45.914889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.915031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.915286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.915623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.915859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.915983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.916152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.916479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.916812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.916980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.917105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.917369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.917634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.917763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.917917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.918167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.918427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.918715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.918842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.918963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.919221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.919561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.919814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.919941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.920060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.920335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.920581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.920853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.920979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.921079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.921306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.921617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.921824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.921947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.922235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.922534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.922779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.922935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.923064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.923357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.923601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.923772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.923881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.924003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.924031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.308 qpair failed and we were unable to recover it. 00:28:00.308 [2024-11-26 08:35:45.924211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.308 [2024-11-26 08:35:45.924343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.924383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.924501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.924624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.924651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.924810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.924908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.924932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.925038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.925294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.925545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.925785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.925910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.926058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.926380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.926615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.926821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.926951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.927223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.927509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.927802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.927971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.928096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.928370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.928667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.928831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.928960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.929259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.929582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.929856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.929985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.930139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.930441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.930741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.930908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.931035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.931296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.931520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.931727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.931868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.932159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.932382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.309 [2024-11-26 08:35:45.932671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.309 [2024-11-26 08:35:45.932871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.309 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.932976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.933225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.933570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.933815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.933997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.934105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.934400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.934662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.934841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.934945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.935251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.935559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.935831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.935977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.936118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.936400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.936673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.936843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.936972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.937255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.937543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.937862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.937984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.938084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.938375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.938661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.938809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.938929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.939233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.939522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.939840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.939974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.940125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.940393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.940674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.940865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.941008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.941295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.941569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.941715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.941860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.942136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.310 qpair failed and we were unable to recover it. 00:28:00.310 [2024-11-26 08:35:45.942451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.310 [2024-11-26 08:35:45.942650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.942792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.942920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.942946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.943081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.943362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.943633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.943763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.943877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.944151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.944448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.944769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.944907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.945022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.945353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.945610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.945779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.945931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.946184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.946496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.946824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.946965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.947138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.947473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.947757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.947948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.948078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.948461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.948742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.948886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.949030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.949273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.949525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.949795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.949938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.950051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.950320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.950617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.950742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.950912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.951158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.951461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.951776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.951904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.952037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.952147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.952174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.311 qpair failed and we were unable to recover it. 00:28:00.311 [2024-11-26 08:35:45.952339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.311 [2024-11-26 08:35:45.952450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.952478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.952629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.952777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.952805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.952927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.953185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.953429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.953668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.953839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.953989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.954263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.954524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.954816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.954979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.955112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.955401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.955712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.955874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.956006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.956355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.956615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.956761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.956874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.957189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.957446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.957712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.957846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.957957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.958248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.958493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.958803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.958937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.959060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.959350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.959630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.959866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.959988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.960150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.960413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.960718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.960872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.960996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.961285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.961535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.312 qpair failed and we were unable to recover it. 00:28:00.312 [2024-11-26 08:35:45.961840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.312 [2024-11-26 08:35:45.961947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.961971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.962078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.962329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.962673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.962836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.962969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.963240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.963516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.963791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.963966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.964108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.964381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.964608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.964871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.964981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.965137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.965452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.965741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.965915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.966033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.966292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.966526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.966725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.966844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.967181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.967477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.967709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.967838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.968010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.968241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.968548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.968857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.968961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.969117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.969420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.969734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.969848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.969976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.970082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.970112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.970222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.970323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.970350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.313 qpair failed and we were unable to recover it. 00:28:00.313 [2024-11-26 08:35:45.970471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.313 [2024-11-26 08:35:45.970612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.970639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.970791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.970896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.970920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.971066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.971350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.971595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.971764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.971916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.972198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.972488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.972740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.972891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.973007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.973290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.973613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.973865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.973994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.974180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.974461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.974778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.974907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.975054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.975386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.975641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.975790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.975924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.976186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.976526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.976803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.976926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.977064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.977342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.977654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.977811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.977921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.978270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.978524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.978821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.978954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.979096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.979416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.979651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.979815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.979976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.980076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.314 [2024-11-26 08:35:45.980101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.314 qpair failed and we were unable to recover it. 00:28:00.314 [2024-11-26 08:35:45.980226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.980515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.980789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.980927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.981021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.981316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.981664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.981835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.981935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.982227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.982509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.982847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.982986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.983128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.983427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.983663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.983846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.983979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.984248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.984487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.984780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.984935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.985071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.985384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.985636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.985770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.985921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.986189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.986475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.986803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.986930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.987095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.987387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.987678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.987859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.987982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.988333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.988613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.988885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.988986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.989117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.989391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.315 [2024-11-26 08:35:45.989708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.315 [2024-11-26 08:35:45.989848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.315 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.989992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.990305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.990579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.990867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.990978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.991125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.991418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.991660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.991806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.991958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.992207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.992470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.992771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.992944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.993063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.993341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.993630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.993788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.993939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.994212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.994536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.994761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.994915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.995029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.995331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.995609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.995749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.995875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.996129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.996409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.996718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.996854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.996998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.997343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.997640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.997806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.997941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.998288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.998541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.998725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.998885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.999191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.316 qpair failed and we were unable to recover it. 00:28:00.316 [2024-11-26 08:35:45.999509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.316 [2024-11-26 08:35:45.999627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:45.999783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:45.999897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:45.999925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.000068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.000389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.000666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.000809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.000957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.001284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.001531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.001819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.001943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.002068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.002311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.002591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.002805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.002907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.003198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.003491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.003785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.003949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.004148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.004406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.004661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.004811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.004925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.005230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.005448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.005752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.005891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.006042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.006344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.006608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.006737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.006899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.007165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.007473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.007705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.007873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.007985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.008096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.008124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.317 qpair failed and we were unable to recover it. 00:28:00.317 [2024-11-26 08:35:46.008295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.008401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.317 [2024-11-26 08:35:46.008429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.008561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.008658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.008683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.008786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.008888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.008913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.009087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.009403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.009668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.009809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.009924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.010204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.010458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.010735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.010862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.010957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.011239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.011490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.011824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.011949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.012068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.012342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.012604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.012892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.012991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.013143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.013434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.013805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.013948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.014071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.014352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.014617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.014790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.014916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.015248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.015529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.015820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.015958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.016100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.016413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.016694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.016864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.017006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.017278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.017599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.318 [2024-11-26 08:35:46.017730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.318 qpair failed and we were unable to recover it. 00:28:00.318 [2024-11-26 08:35:46.017824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.017917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.017942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.018041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.018334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.018612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.018882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.018983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.019115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.019386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.019624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.019800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.019906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.020273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.020548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.020830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.020969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.021101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.021387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.021666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.021873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.022000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.022245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.022581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.022860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.022983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.023197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.023457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.023746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.023882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.024011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.024310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.024600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.024855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.024962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.025137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.025433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.025676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.025839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.025978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.026230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.026535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.026817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.319 [2024-11-26 08:35:46.026981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.319 qpair failed and we were unable to recover it. 00:28:00.319 [2024-11-26 08:35:46.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.027381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.027682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.027832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.027949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.028242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.028488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.028655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.028837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.029148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.029447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.029790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.029971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.030099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.030402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.030746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.030881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.030997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.031286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.031518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.031821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.031984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.032093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.032353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.032628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.032807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.032943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.033282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.033578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.033785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.033890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.034203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.034533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.034850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.034975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.035130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.035435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.035719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.035925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.036034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.036320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.036629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.036814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.320 [2024-11-26 08:35:46.036919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.037028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.320 [2024-11-26 08:35:46.037053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.320 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.037142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.037429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.037717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.037882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.037991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.038297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.038628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.038771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.038907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.039202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.039542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.039797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.039976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.040111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.040414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.040702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.040865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.041030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.041277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.041604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.041838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.041967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.042083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.042384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.042678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.042826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.042940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.043249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.043547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.043847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.043994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.044140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.044379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.044656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.044832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.044975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.045261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.045577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.321 qpair failed and we were unable to recover it. 00:28:00.321 [2024-11-26 08:35:46.045895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.321 [2024-11-26 08:35:46.045997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.046171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.046470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.046742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.046889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.046987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.047301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.047653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.047818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.047916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.048209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.048496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.048809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.048938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.049091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.049368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.049617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.049796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.049925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.050202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.050481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.050808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.050964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.051053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.051300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.051564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.051847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.051979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.052131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.052410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.052701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.052851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.052954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.053280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.053558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.053816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.053977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.054126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.054485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.054806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.054939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.055084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.055200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.055228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.055352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.055495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.055523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.322 qpair failed and we were unable to recover it. 00:28:00.322 [2024-11-26 08:35:46.055667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.322 [2024-11-26 08:35:46.055811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.055837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.056021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.056344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.056621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.056833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.056969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.057208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.057500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.057788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.057953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.058082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.058335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.058595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.058771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.058890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.059197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.059512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.059827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.059958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.060055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.060335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.060638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.060800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.060900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.061211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.061499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.061758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.061946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.062073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.062381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.062663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.062837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.062959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.063261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.063569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.063842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.063998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.064115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.064363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.064611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.064775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.064924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.065047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.065072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.065189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.065296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.323 [2024-11-26 08:35:46.065324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.323 qpair failed and we were unable to recover it. 00:28:00.323 [2024-11-26 08:35:46.065478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.065595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.065624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.065733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.065848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.065877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.066000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.066274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.066570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.066797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.066925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.067024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.067261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.067513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.067813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.067955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.068077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.068411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.068703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.068829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.068996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.069301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.069545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.069732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.069878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.070179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.070469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.070745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.070913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.071050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.071333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.071633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.071760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.071886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.072138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.072426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.072715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.072853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.073029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.073317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.073610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.073819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.073971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.074220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.074526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.074708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.324 [2024-11-26 08:35:46.074900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.075015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.324 [2024-11-26 08:35:46.075042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.324 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.075192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.075491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.075783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.075958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.076112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.076389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.076636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.076880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.076978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.077189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.077413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.077751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.077872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.078002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.078274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.078546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.078772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.078920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.079028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.079323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.079619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.079748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.079900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.080230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.080509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.080806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.080931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.081085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.081395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.081641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.081831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.081962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.082292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.082545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.082717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.082887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.083183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.325 [2024-11-26 08:35:46.083458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.325 [2024-11-26 08:35:46.083630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.325 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.083758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.083864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.083888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.084051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.084350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.084601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.084831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.084988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.085123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.085415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.085709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.085836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.085958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.086251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.086626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.086810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.086913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.087222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.087502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.087783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.087911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.088065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.088346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.088600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.088771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.088901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.089183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.089441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.089725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.089863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.089993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.090321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.090584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.090751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.090859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.091155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.091415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.091716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.091909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.092021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.092326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.092631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.092795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.092913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.093025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.093057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.326 qpair failed and we were unable to recover it. 00:28:00.326 [2024-11-26 08:35:46.093239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.093337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.326 [2024-11-26 08:35:46.093362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.093494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.093591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.093616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.093745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.093900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.093925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.094029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.094347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.094614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.094779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.094903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.095161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.095462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.095722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.095882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.096037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.096321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.096642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.096822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.096941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.097183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.097452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.097705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.097867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.098008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.098261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.098570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.098854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.098991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.099144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.099427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.099719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.099860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.100035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.100300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.100625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.100895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.100994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.101127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.101431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.101664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.101831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.101936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.102255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.102575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.327 qpair failed and we were unable to recover it. 00:28:00.327 [2024-11-26 08:35:46.102852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.327 [2024-11-26 08:35:46.102970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.102998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.103118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.103452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.103752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.103891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.103985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.104274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.104557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.104856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.104984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.105122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.105452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.105731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.105871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.106018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.106280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.106531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.106830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.106976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.107156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.107473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.107773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.107903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.108023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.108365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.108642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.108790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.108899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.109226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.109583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.109791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.109916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.110179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.110441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.110701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.110858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.110956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.111187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.111476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.111830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.111985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.112121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.112434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.328 qpair failed and we were unable to recover it. 00:28:00.328 [2024-11-26 08:35:46.112701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.328 [2024-11-26 08:35:46.112842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.112870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.112990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.113210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.113476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.113757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.113881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.113989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.114292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.114580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.114744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.114864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.115179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.115463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.115741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.115905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.116043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.116351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.116635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.116785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.116903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.117183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.117509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.117723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.329 [2024-11-26 08:35:46.117904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.329 qpair failed and we were unable to recover it. 00:28:00.329 [2024-11-26 08:35:46.118023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.118368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.118656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.118799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.118928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.119244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.119513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.119802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.119946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.120062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.120320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.120587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.120794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.610 [2024-11-26 08:35:46.120929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.121030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.610 [2024-11-26 08:35:46.121054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.610 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.121162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.121393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.121699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.121841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.121964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.122231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.122495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.122810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.122953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.123102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.123357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.123625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.123777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.123887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.124185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.124476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.124756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.124898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.125036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.125348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.125605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.125770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.125882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.126161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.126447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.126738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.126940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.127041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.127325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.127616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.127811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.127930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.128224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.128470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.128802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.128926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.611 qpair failed and we were unable to recover it. 00:28:00.611 [2024-11-26 08:35:46.129051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.129213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.611 [2024-11-26 08:35:46.129238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.129371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.129494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.129522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.129666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.129793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.129821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.129976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.130294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.130567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.130758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.130882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.131244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.131516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.131783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.131909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.132007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.132264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.132558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.132845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.132973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.133091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.133427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.133666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.133810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.133979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.134234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.134565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.134759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.134873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.135201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.135450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.135815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.135979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.136119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.136393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.136706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.136900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.137029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.137133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.137158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.137274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.137427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.137451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.612 qpair failed and we were unable to recover it. 00:28:00.612 [2024-11-26 08:35:46.137585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.612 [2024-11-26 08:35:46.137734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.137761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.137871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.138184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.138482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.138838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.138983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.139164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.139395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.139726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.139876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.139990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.140324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.140619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.140749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.140940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.141285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.141558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.141762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.141898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.142198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.142507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.142768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.142902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.143081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.143352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.143663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.143838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.143958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.144226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.144495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.144827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.144954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.145109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.145369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.145647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.145799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.145948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.146100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.146123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.613 qpair failed and we were unable to recover it. 00:28:00.613 [2024-11-26 08:35:46.146275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.613 [2024-11-26 08:35:46.146374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.146400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.146565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.146667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.146705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.146853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.146973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.147150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.147457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.147785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.147940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.148082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.148381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.148660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.148809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.148938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.149219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.149527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.149823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.149986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.150146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.150457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.150789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.150928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.151024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.151343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.151654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.151802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.151952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.152208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.152484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.152813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.152978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.153137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.153444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.153800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.153979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.154089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.154394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.154703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.154876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-26 08:35:46.155010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.614 [2024-11-26 08:35:46.155114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.155138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.155250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.155393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.155421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.155569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.155709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.155737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.155879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.156232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.156498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.156776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.156908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.157041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.157353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.157594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.157862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.157983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.158132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.158461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.158737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.158909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.159030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.159324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.159612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.159870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.159985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.160147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.160446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.160763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.160882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.161002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.161283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.161603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-26 08:35:46.161861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.615 [2024-11-26 08:35:46.161971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.161995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.162113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.162401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.162647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.162803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.162936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.163175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.163467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.163716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.163852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.164006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.164264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.164537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.164833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.164973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.165126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.165410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.165635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.165884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.165976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.166114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.166394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.166705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.166835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.166982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.167266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.167534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.167818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.167970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.168095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.168431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.168763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.168905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.169015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.169294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.169564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-26 08:35:46.169841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.616 [2024-11-26 08:35:46.169972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.169998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.170099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.170349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.170620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.170859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.170985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.171150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.171440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.171750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.171900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.172026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.172303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.172601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.172731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.172861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.173242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.173519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.173799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.173969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.174096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.174400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.174650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.174829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.174968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.175259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.175521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.175847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.175991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.176104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.176368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.176671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.176831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.176959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.177282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.177537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.177828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.177976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.617 qpair failed and we were unable to recover it. 00:28:00.617 [2024-11-26 08:35:46.178118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.617 [2024-11-26 08:35:46.178263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.178291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.178435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.178578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.178606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.178760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.178895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.178919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.179020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.179301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.179609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.179783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.179932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.180233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.180485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.180793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.180937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.181105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.181391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.181642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.181812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.181949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.182229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.182570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.182738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.182879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.183230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.183556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.183845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.183977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.184145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.184456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.184718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.184901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.185065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.185282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.185631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.185774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.185904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.186204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.186487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.618 [2024-11-26 08:35:46.186653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.618 qpair failed and we were unable to recover it. 00:28:00.618 [2024-11-26 08:35:46.186786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.186919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.186947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.187101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.187377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.187693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.187884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.188051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.188372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.188655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.188796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.188942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.189252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.189568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.189723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.189856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.190226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.190497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.190757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.190906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.191085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.191342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.191679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.191863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.191993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.192234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.192496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.192661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.192853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9e4600 is same with the state(5) to be set 00:28:00.619 [2024-11-26 08:35:46.193073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.193396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.193718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.193852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.193957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.194062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.194088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.194218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.194318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.619 [2024-11-26 08:35:46.194343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.619 qpair failed and we were unable to recover it. 00:28:00.619 [2024-11-26 08:35:46.194447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.194578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.194603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.194752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.194904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.194931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.195030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.195361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.195699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.195860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.195965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.196253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.196538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.196788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.196980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.197173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.197382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.197411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.197572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.197751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.197796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.197923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.198318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.198645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.198806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.198913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.199289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.199597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.199760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.199892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.200178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.200490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.200764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.200889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.201063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.201345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.201667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.201878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.201982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.202322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.202616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.202817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.202989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.203155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.203181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.203369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.203508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.620 [2024-11-26 08:35:46.203537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.620 qpair failed and we were unable to recover it. 00:28:00.620 [2024-11-26 08:35:46.203691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.203816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.203841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.203948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.204265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.204582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.204764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.204895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.205164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.205473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.205798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.205919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.206051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.206333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.206587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.206761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.206891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.207206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.207543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.207813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.207968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.208126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.208459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.208742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.208888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.208980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.209302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.209667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.209793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.209948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.210252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.210602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.210892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.210998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.211159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.211469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.211787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.211923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.621 qpair failed and we were unable to recover it. 00:28:00.621 [2024-11-26 08:35:46.212065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.212202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.621 [2024-11-26 08:35:46.212229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.212386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.212515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.212539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.212695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.212808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.212836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.212952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.213325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.213586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.213858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.213991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.214171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.214486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.214756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.214903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.215057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.215347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.215734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.215936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.216083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.216367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.216698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.216827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.216947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.217232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.217556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.217850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.217978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.218130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.218429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.218698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.218875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.219023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.219304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.219609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.219869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.219996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.220170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.220311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.220343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.220487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.220652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.220680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.622 qpair failed and we were unable to recover it. 00:28:00.622 [2024-11-26 08:35:46.220828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.622 [2024-11-26 08:35:46.220938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.220978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.221086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.221385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.221707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.221863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.222034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.222367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.222674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.222868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.222992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.223308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.223566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.223763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.223907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.224218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.224460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.224811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.224945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.225074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.225391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.225731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.225913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.226067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.226374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.226700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.226841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.226966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.227221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.227513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.227844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.227971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.228152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.228462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.228776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.228914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.229010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.229149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.229176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.229318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.229502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.229527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.623 qpair failed and we were unable to recover it. 00:28:00.623 [2024-11-26 08:35:46.229626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.623 [2024-11-26 08:35:46.229758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.229784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.229946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.230234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.230566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.230740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.230873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.231231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.231576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.231731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.231913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.232184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.232557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.232776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.232897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.233077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.233475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.233799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.233970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.234113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.234407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.234732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.234915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.235014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.235266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.235553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.235757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.235893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.236222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.236480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.236796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.236949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.237050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.237199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.237223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.237414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.237549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.237575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.624 qpair failed and we were unable to recover it. 00:28:00.624 [2024-11-26 08:35:46.237738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.624 [2024-11-26 08:35:46.237860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.237887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.238057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.238328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.238628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.238799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.238912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.239153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.239444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.239727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.239845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.239999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.240265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.240600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.240795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.240933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.241289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.241615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.241768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.241945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.242349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.242631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.242747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.242858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.243150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.243486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.243792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.243963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.244103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.244391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.244655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.244813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.244930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.245208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.245500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.245707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.245861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.246012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.246052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.246210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.246337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.625 [2024-11-26 08:35:46.246378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.625 qpair failed and we were unable to recover it. 00:28:00.625 [2024-11-26 08:35:46.246524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.246696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.246725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.246899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.247150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.247508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.247797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.247919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.248044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.248333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.248611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.248872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.248991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.249155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.249455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.249819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.249944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.250064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.250423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.250761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.250945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.251101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.251470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.251755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.251933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.252069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.252366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.252631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.252785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.252895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.253136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.253408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.253661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.253809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.253944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.254212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.254503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.254748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.626 [2024-11-26 08:35:46.254874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.626 qpair failed and we were unable to recover it. 00:28:00.626 [2024-11-26 08:35:46.254977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.255235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.255516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.255777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.255924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.256028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.256313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.256568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.256839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.256973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.257099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.257410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.257656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.257837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.257996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.258248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.258554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.258802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.258949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.259048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.259321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.259551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.259818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.259939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.260076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.260378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.260658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.260797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.260931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.261221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.261464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.261717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.261851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.261990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.262278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.262530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.627 [2024-11-26 08:35:46.262665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.627 qpair failed and we were unable to recover it. 00:28:00.627 [2024-11-26 08:35:46.262784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.262893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.262917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.263072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.263404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.263715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.263878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.264306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.264586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.264738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.264864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.265184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.265459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.265739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.265882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.266007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.266293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.266544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.266805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.266967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.267100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.267360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.267663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.267800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.267897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.268185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.268475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.268766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.268896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.269032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.269300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.269614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.269770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.628 qpair failed and we were unable to recover it. 00:28:00.628 [2024-11-26 08:35:46.269908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.270035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.628 [2024-11-26 08:35:46.270059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.270219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.270496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.270744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.270861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.270965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.271256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.271517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.271931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.272067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.272333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.272595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.272757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.272888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.273135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.273410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.273641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.273799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.273928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.274172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.274459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.274707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.274830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.274955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.275201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.275419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.275661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.275822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.275917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.276174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.276399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.276690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.276811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.276921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.277021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.277048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.277199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.277359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.277384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.629 qpair failed and we were unable to recover it. 00:28:00.629 [2024-11-26 08:35:46.277517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.629 [2024-11-26 08:35:46.277636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.277661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.277810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.277922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.277947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.278099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.278322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.278601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.278845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.278949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.279258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.279515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.279788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.279915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.280035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.280279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.280613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.280771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.280877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.281169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.281451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.281769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.281898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.282064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.282370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.282653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.282814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.282913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.283193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.283447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.283790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.283936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.284064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.284344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.284653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.284818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.284927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.285212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.285554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.285729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.630 qpair failed and we were unable to recover it. 00:28:00.630 [2024-11-26 08:35:46.285887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.630 [2024-11-26 08:35:46.286026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.286198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.286478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.286793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.286937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.287072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.287372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.287630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.287807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.287954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.288269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.288632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.288790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.288897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.289182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.289540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.289850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.289981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.290152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.290434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.290750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.290877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.290982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.291304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.291621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.291779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.291880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.292228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.292602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.292853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.292977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.293169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.293464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.293771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.293951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.294069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.294238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.294266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.294393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.294546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.294575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.631 qpair failed and we were unable to recover it. 00:28:00.631 [2024-11-26 08:35:46.294732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.631 [2024-11-26 08:35:46.294846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.294871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.294964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.295345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.295733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.295877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.295981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.296292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.296559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.296857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.296980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.297124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.297518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.297779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.297915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.298091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.298427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.298676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.298860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.298983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.299234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.299544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.299857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.299984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.300173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.300487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.300780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.300991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.301127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.301403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.301722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.301851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.301952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.302310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.302607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.302866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.302989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.303016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.303152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.303313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.303337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.632 qpair failed and we were unable to recover it. 00:28:00.632 [2024-11-26 08:35:46.303493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.632 [2024-11-26 08:35:46.303613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.303638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.303789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.303899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.303928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.304060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.304352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.304602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.304747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.304878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.305169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.305455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.305696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.305842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.306022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.306328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.306629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.306767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.306882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.307143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.307387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.307663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.307789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.307885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.308159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.308427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.308712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.308861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.309005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.309285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.309608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.309867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.309989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.310093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.310211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.310236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.310368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.310498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.633 [2024-11-26 08:35:46.310522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.633 qpair failed and we were unable to recover it. 00:28:00.633 [2024-11-26 08:35:46.310622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.310726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.310751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.310849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.310953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.310978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.311099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.311345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.311883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.311987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.312105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.312393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.312662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.312829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.312954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.313288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.313498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.313791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.313925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.314045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.314329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.314665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.314807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.314908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.315189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.315491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.315766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.315889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.316014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.316287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.316559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.316950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.317075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.317331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.317574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.317849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.317999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.318023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.318127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.318223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.634 [2024-11-26 08:35:46.318248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.634 qpair failed and we were unable to recover it. 00:28:00.634 [2024-11-26 08:35:46.318403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.318610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.318635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.318792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.318896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.318920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.319124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.319423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.319693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.319823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.319931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.320178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.320482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.320737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.320896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.321027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.321301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.321609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.321759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.321913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.322172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.322462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.322766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.322994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.323121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.323379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.323661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.323802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.323916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.324217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.324600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.324824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.324983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.325138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.325417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.325642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.325902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.325995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.326021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.326172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.326298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.326322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.326449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.326551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.635 [2024-11-26 08:35:46.326576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.635 qpair failed and we were unable to recover it. 00:28:00.635 [2024-11-26 08:35:46.326714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.326813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.326838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.326969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.327250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.327522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.327816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.327941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.328038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.328319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.328598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.328871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.328991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.329101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.329388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.329700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.329826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.329984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.330223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.330503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.330761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.330909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.331035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.331367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.331672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.331823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.331943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.332162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.332442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.332670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.332897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.332995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.333182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.333435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.333710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.333868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.333975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.334130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.334154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.334256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.334388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.636 [2024-11-26 08:35:46.334412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.636 qpair failed and we were unable to recover it. 00:28:00.636 [2024-11-26 08:35:46.334569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.334699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.334725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.334838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.334935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.334960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.335084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.335336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.335581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.335852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.335976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.336097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.336383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.336716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.336895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.337022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.337364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.337653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.337788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.337910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.338129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.338343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.338618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.338865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.338983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.339156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.339412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.339641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.339788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.339910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.340167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.340546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.340831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.340957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.341083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.341329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.341573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.637 qpair failed and we were unable to recover it. 00:28:00.637 [2024-11-26 08:35:46.341850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.341999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.637 [2024-11-26 08:35:46.342024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.342126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.342376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.342648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.342815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.342922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.343200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.343472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.343723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.343878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.343985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.344251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.344507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.344818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.344995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.345152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.345427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.345712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.345871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.345993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.346256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.346517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.346809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.346958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.347106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.347414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.347700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.347854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.347949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.348163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.348499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.348767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.348890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.349019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.349140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.349166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.638 qpair failed and we were unable to recover it. 00:28:00.638 [2024-11-26 08:35:46.349270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.349394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.638 [2024-11-26 08:35:46.349418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.349526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.349676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.349708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.349811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.349967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.349991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.350124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.350377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.350614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.350840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.350985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.351116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.351394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.351655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.351844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.351948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.352258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.352506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.352813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.352968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.353102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.353377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.353658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.353819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.353949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.354202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.354458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.354716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.354847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.355076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.355351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.355600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.355750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.355848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.356368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.356596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.356849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.356975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.357000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.639 qpair failed and we were unable to recover it. 00:28:00.639 [2024-11-26 08:35:46.357128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.357233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.639 [2024-11-26 08:35:46.357256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.357384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.357508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.357532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.357661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.357828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.357853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.357957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.358272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.358498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.358764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.358896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.359002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.359274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.359537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.359822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.359973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.360100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.360350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.360595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.360877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.360980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.361140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.361407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.361713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.361839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.361948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.362253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.362538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.362845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.362978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.363130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.363415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.363698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.363829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.363927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.364182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.364466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.364750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.364897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.640 qpair failed and we were unable to recover it. 00:28:00.640 [2024-11-26 08:35:46.365001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.365123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.640 [2024-11-26 08:35:46.365148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.365277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.365508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.365785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.365934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.366031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.366369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.366597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.366854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.366987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.367105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.367327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.367634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.367754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.367910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.368136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.368403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.368656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.368787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.368901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.369180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.369435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.369698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.369844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.369975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.370259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.370532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.370792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.370947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.371075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.371356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.371667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.371802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.371906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.372188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.372436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.641 qpair failed and we were unable to recover it. 00:28:00.641 [2024-11-26 08:35:46.372718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.641 [2024-11-26 08:35:46.372876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.372997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.373209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.373582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.373887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.373983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.374109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.374380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.374624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.374781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.374915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.375240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.375560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.375876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.375979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.376101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.376365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.376675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.376814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.376919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.377159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.377410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.377693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.377845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.377970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.378216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.378487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.378743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.378918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.379030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.379278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.379528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.642 qpair failed and we were unable to recover it. 00:28:00.642 [2024-11-26 08:35:46.379807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.642 [2024-11-26 08:35:46.379904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.379929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.380032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.380288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.380571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.380849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.380969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.381095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.381397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.381623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.381805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.381898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.382167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.382439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.382669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.382856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.382983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.383230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.383486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.383727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.383854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.384010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.384281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.384587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.384763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.384860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.385200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.385491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.385718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.385872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.385975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.386238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.386495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.386782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.386909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.387032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.387286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.643 qpair failed and we were unable to recover it. 00:28:00.643 [2024-11-26 08:35:46.387531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.643 [2024-11-26 08:35:46.387717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.387826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.387931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.387954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.388081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.388462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.388778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.388928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.389061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.389323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.389605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.389836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.389985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.390112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.390358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.390665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.390886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.390981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.391160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.391466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.391768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.391895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.392010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.392326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.392642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.392870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.392972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.393105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.393321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.393571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.393721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.393889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.394189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.394444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.394719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.394895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.395047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.395152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.395176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.395299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.395428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.395452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.644 qpair failed and we were unable to recover it. 00:28:00.644 [2024-11-26 08:35:46.395549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.644 [2024-11-26 08:35:46.395654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.395678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.395845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.395996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.396145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.396393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.396644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.396812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.396911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.397170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.397384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.397665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.397796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.397901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.398181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.398504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.398823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.398977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.399115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.399398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.399636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.399777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.399889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.400201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.400501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.400789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.400914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.401049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.401302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.401580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.401856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.401984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.402132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.402385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.402722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.402870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.402994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.403129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.403153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.403282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.403380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.645 [2024-11-26 08:35:46.403404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.645 qpair failed and we were unable to recover it. 00:28:00.645 [2024-11-26 08:35:46.403510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.403642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.403666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.403775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.403907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.403931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.404058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.404349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.404608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.404834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.404950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.405198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.405448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.405704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.405854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.405975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.406205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.406469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.406755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.406910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.407014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.407256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.407494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.407719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.407851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.407960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.408216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.408471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.408720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.408877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.408980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.409225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.409472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.409727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.409855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.409981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.410238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.410510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.646 [2024-11-26 08:35:46.410769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.646 [2024-11-26 08:35:46.410902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.646 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.411007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.411230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.411493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.411723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.411848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.411956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.412213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.412439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.412675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.412813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.412910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.413135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.413417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.413648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.413879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.413979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.414133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.414380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.414637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.414871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.414990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.415084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.415333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.415574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.415793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.415946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.416075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.416337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.416567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.416865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.416991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.647 qpair failed and we were unable to recover it. 00:28:00.647 [2024-11-26 08:35:46.417127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.647 [2024-11-26 08:35:46.417226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.417250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.417374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.417503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.417528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.417628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.417761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.417786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.417904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.418150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.418422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.418678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.418845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.418973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.419198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.419458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.419725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.419859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.419954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.420222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.420471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.420756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.420879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.421015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.421267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.421516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.421780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.421902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.422029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.422344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.422604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.422882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.422977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.423129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.423385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.423612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.423864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.423991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.424126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.424341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.648 qpair failed and we were unable to recover it. 00:28:00.648 [2024-11-26 08:35:46.424600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.648 [2024-11-26 08:35:46.424701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.424727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.424871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.424991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.425146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.425368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.425630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.425785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.425903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.426153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.426385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.426649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.426817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.426937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.427220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.427478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.427709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.427866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.428026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.428306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.428518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.428768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.428911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.429018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.429305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.429532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.429796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.429928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.430031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.430271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.430519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.430762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.430884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.431014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.431233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.431493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.431727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.431896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.649 qpair failed and we were unable to recover it. 00:28:00.649 [2024-11-26 08:35:46.432001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.649 [2024-11-26 08:35:46.432129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.432303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.432574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.432828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.432972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.433076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.433295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.433550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.433818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.433957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.434099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.434365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.434655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.434808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.434967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.435242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.435507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.435754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.435943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.436082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.436334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.436631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.436805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.436946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.437191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.437459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.437765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.437916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.438022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.438303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.438593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.438894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.438997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.439126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.439423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.439716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.439841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.650 qpair failed and we were unable to recover it. 00:28:00.650 [2024-11-26 08:35:46.439938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.650 [2024-11-26 08:35:46.440084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.440253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.440524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.440758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.440940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.441042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.441385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.441698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.441835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.441970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.442258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.442489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.442748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.442876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.651 [2024-11-26 08:35:46.442983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.443083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.651 [2024-11-26 08:35:46.443106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.651 qpair failed and we were unable to recover it. 00:28:00.930 [2024-11-26 08:35:46.443252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.930 [2024-11-26 08:35:46.443393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.930 [2024-11-26 08:35:46.443418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.930 qpair failed and we were unable to recover it. 00:28:00.930 [2024-11-26 08:35:46.443553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.930 [2024-11-26 08:35:46.443674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.443713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.443833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.443960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.443990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.444138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.444442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.444722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.444844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.445006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.445301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.445558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.445779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.445884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.446205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.446463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.446890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.447033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.447314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.447537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.447847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.447986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.448135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.448403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.448668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.448845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.448995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.449244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.449525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.449837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.449998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.450123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.450405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.450722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.450847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.450973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.451077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.451104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.451261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.451415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.931 [2024-11-26 08:35:46.451439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.931 qpair failed and we were unable to recover it. 00:28:00.931 [2024-11-26 08:35:46.451544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.451641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.451665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.451795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.451965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.451993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.452106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.452401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.452672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.452817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.452933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.453247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.453525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.453834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.453973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.454154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.454416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.454765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.454886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.455010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.455284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.455590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.455781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.455883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.456213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.456505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.456786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.456911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.457034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.457311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.457592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.457749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.457866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.458176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.458449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.458719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.458848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.458992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.459244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.459469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.932 [2024-11-26 08:35:46.459587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.932 qpair failed and we were unable to recover it. 00:28:00.932 [2024-11-26 08:35:46.459696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.459850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.459875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.460004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.460274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.460527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.460794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.460916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.461017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.461315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.461607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.461855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.461988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.462142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.462353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.462601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.462783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.462885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.463220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.463448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.463679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.463876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.464008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.464314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.464586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.464887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.464992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.465164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.465493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.465780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.465906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.466032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.466333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.466644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.466777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.466878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.467187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.933 qpair failed and we were unable to recover it. 00:28:00.933 [2024-11-26 08:35:46.467445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.933 [2024-11-26 08:35:46.467598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.467714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.467824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.467851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.467963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.468227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.468516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.468749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.468903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.469035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.469297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.469590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.469779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.469914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.470183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.470473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.470756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.470909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.471102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.471387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.471663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.471800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.471975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.472262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.472486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.472829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.472966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.473330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.473607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.473759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.473882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.474188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.474520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.474861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.474973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.475154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.475453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.934 qpair failed and we were unable to recover it. 00:28:00.934 [2024-11-26 08:35:46.475776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.934 [2024-11-26 08:35:46.475903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.475928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.476028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.476342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.476590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.476765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.476894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.477221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.477487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.477808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.477935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.478070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.478350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.478628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.478793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.478912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.479185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.479451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.479701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.479835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.479988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.480231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.480538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.480860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.480975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.481166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.481441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.481781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.481909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.482011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.482273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.482572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.935 qpair failed and we were unable to recover it. 00:28:00.935 [2024-11-26 08:35:46.482874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.935 [2024-11-26 08:35:46.482978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.483134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.483421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.483749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.483900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.484016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.484266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.484567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.484899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.484998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.485169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.485488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.485728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.485921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.486041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.486327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.486622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.486790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.486928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.487248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.487482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.487815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.487945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.488076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.488313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.488621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.488850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.488977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.489112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.489415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.489683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.489866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.489993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.490269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.490531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.490830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.490995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.936 qpair failed and we were unable to recover it. 00:28:00.936 [2024-11-26 08:35:46.491137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.936 [2024-11-26 08:35:46.491280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.491307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.491435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.491540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.491566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.491663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.491821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.491848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.491990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.492296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.492548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.492838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.492986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.493136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.493391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.493683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.493828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.493980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.494266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.494525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.494841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.494999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.495144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.495417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.495735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.495914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.496075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.496348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.496669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.496798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.496909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.497163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.497466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.497763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.497914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.498034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.498371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.498624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.498860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.498985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.499018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.499149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.499252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.499278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.937 qpair failed and we were unable to recover it. 00:28:00.937 [2024-11-26 08:35:46.499409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.937 [2024-11-26 08:35:46.499557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.499584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.499730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.499839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.499866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.499993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.500278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.500563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.500827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.500973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.501137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.501371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.501663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.501860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.501979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.502243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.502508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.502832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.502996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.503136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.503449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.503698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.503865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.503971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.504293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.504576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.504735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.504881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.505214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.505518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.505698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.505857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.506153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.506477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.506715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.506851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.506971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.507221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.507488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.938 qpair failed and we were unable to recover it. 00:28:00.938 [2024-11-26 08:35:46.507750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.938 [2024-11-26 08:35:46.507890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.507914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.508034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.508313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.508548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.508805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.508995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.509120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.509334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.509666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.509836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.509949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.510257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.510569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.510733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.510870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.511160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.511381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.511633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.511802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.511901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.512152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.512427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.512712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.512841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.512941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.513327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.513578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.513865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.513958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.514106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.514420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.514698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.514849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.514968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.515251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.515523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.939 qpair failed and we were unable to recover it. 00:28:00.939 [2024-11-26 08:35:46.515849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.939 [2024-11-26 08:35:46.515955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.515981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.516087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.516331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.516672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.516827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.516960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.517265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.517582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.517839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.517994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.518147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.518428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.518749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.518934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.519094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.519400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.519727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.519857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.519969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.520285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.520533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.520771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.520936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.521046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.521328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.521633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.521879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.521994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.522149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.522458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.522766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.522898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.522999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.523150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.940 [2024-11-26 08:35:46.523175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.940 qpair failed and we were unable to recover it. 00:28:00.940 [2024-11-26 08:35:46.523317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.523558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.523848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.523983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.524100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.524363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.524631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.524756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.524890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.525164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.525446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.525715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.525889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.525993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.526276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.526555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.526802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.526947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.527099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.527403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.527643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.527798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.527949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.528280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.528560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.528803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.528958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.529106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.529346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.529670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.529844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.529939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.530309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.530642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.530775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.530913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.531055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.531082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.531236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.531339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.941 [2024-11-26 08:35:46.531363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.941 qpair failed and we were unable to recover it. 00:28:00.941 [2024-11-26 08:35:46.531491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.531581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.531605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.531737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.531888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.531913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.532020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.532339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.532592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.532764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.532872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.533165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.533459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.533795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.533925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.534025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.534303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.534553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.534874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.534978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.535131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.535440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.535732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.535911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.536049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.536306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.536638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.536794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.536888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.537155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.537403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.537651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.537858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.537954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.538247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.538529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.538825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.538991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.539108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.539212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.539237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.539345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.539497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.539530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.942 qpair failed and we were unable to recover it. 00:28:00.942 [2024-11-26 08:35:46.539700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.942 [2024-11-26 08:35:46.539813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.539841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.539969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.540196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.540541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.540806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.540954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.541068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.541304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.541558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.541827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.541947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.542042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.542338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.542614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.542784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.542924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.543209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.543506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.543784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.543917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.544071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.544365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.544648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.544809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.544912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.545250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.545497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.545841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.545993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.546119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.546388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.546654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.546886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.546978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.547131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.547482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.943 qpair failed and we were unable to recover it. 00:28:00.943 [2024-11-26 08:35:46.547723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.943 [2024-11-26 08:35:46.547824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.547849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.547979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.548230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.548498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.548766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.548962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.549063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.549311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.549590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.549760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.549883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.550165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.550455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.550747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.550909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.551056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.551332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.551581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.551840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.551981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.552106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.552433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.552737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.552881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.553053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.553350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.553594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.553747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.553882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.554190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.554419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.554679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.554875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.944 qpair failed and we were unable to recover it. 00:28:00.944 [2024-11-26 08:35:46.554996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.944 [2024-11-26 08:35:46.555128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.555271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.555575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.555890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.555983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.556129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.556404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.556716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.556849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.556953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.557264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.557568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.557865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.557979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.558117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.558402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.558681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.558835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.558969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.559261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.559546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.559712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.559885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.560130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.560421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.560683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.560827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.560978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.561251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.561508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.561772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.561906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.562008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.562263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.562864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.945 [2024-11-26 08:35:46.562991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.945 qpair failed and we were unable to recover it. 00:28:00.945 [2024-11-26 08:35:46.563116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.563399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.563735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.563868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.563997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.564264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.564510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.564770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.564923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.565056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.565305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.565582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.565736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.565876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.566190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.566470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.566730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.566886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.567011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.567280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.567575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.567896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.567998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.568176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.568431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.568757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.568916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.569037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.569292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.569580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.569846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.569982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.570160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.570424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.570703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.570878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.571008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.571154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.946 [2024-11-26 08:35:46.571182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.946 qpair failed and we were unable to recover it. 00:28:00.946 [2024-11-26 08:35:46.571357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.571456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.571480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.571630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.571790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.571819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.571932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.572220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.572496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.572731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.572905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.573019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.573322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.573588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.573733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.573858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.574192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.574436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.574726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.574874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.574992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.575288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.575540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.575838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.575979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.576157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.576447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.576678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.576837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.576985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.577225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.577523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.577812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.577964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.578091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.578385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.578633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.578812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.578917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.579017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.579042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.579162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.579306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.579333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.947 qpair failed and we were unable to recover it. 00:28:00.947 [2024-11-26 08:35:46.579470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.947 [2024-11-26 08:35:46.579579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.579610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.579738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.579844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.579871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.579985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.580281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.580622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.580854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.580995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.581170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.581461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.581700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.581847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.582020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.582250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.582508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.582810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.582975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.583109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.583392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.583643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.583856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.583978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.584250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.584525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.584817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.584969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.585099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.585434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.585697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.585850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.585958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.586249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.586558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.586847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.586998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.587109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.587271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.587419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.587548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.587574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.948 qpair failed and we were unable to recover it. 00:28:00.948 [2024-11-26 08:35:46.587673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.948 [2024-11-26 08:35:46.587822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.587849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.587978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.588278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.588629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.588771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.588951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.589247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.589497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.589782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.589904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.590031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.590276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.590552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.590990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.591113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.591375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.591712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.591858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.591964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.592216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.592490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.592763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.592929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.593037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.593345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.593623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.593766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.593934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.594242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.594548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.594863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.949 [2024-11-26 08:35:46.594998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.949 qpair failed and we were unable to recover it. 00:28:00.949 [2024-11-26 08:35:46.595157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.595441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.595751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.595902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.596027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.596302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.596587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.596850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.596998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.597119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.597449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.597706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.597841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.597945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.598194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.598469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.598769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.598924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.599063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.599334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.599581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.599849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.599988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.600163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.600403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.600670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.600823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.600927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.601234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.601514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.601821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.601949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.602045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.602308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.602598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.602870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.602972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.950 [2024-11-26 08:35:46.603000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.950 qpair failed and we were unable to recover it. 00:28:00.950 [2024-11-26 08:35:46.603143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.603432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.603713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.603863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.603975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.604282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.604542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.604799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.604962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.605082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.605375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.605627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.605822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.605957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.606252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.606564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.606884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.606980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.607146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.607380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.607699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.607834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.607966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.608203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.608547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.608825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.608992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.609120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.609415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.609745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.609867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.610013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.610309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.610610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.610786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.610877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.611023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.611051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.611185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.611288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.951 [2024-11-26 08:35:46.611313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.951 qpair failed and we were unable to recover it. 00:28:00.951 [2024-11-26 08:35:46.611439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.611577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.611605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.611760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.611894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.611919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.612044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.612274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.612564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.612833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.612973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.613109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.613415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.613664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.613840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.613981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.614292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.614615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.614741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.614886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.615227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.615568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.615833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.615965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.616073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.616342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.616613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.616749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.616887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.617177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.617448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.617704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.617869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.617987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.618256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.618566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.618848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.618980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.619169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.619271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.619296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.619448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.619583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.952 [2024-11-26 08:35:46.619611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.952 qpair failed and we were unable to recover it. 00:28:00.952 [2024-11-26 08:35:46.619734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.619840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.619865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.619996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.620286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.620584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.620853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.620992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.621099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.621367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.621633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.621780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.621892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.622192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.622493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.622731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.622902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.622999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.623269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.623540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.623869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.623998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.624119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.624369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.624649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.624918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.625152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.625371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.625660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.625834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.625930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.626196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.626436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.953 [2024-11-26 08:35:46.626623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.953 qpair failed and we were unable to recover it. 00:28:00.953 [2024-11-26 08:35:46.626736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.626927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.626955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.627110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.627400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.627671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.627828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.627976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.628252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.628536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.628820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.628993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.629147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.629471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.629755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.629882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.630014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.630262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.630511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.630763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.630907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.631062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.631374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.631653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.631811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.631917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.632140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.632399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.632635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.632791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.632936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.633229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.633514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.633783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.633934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.634049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.634312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.954 [2024-11-26 08:35:46.634611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.954 [2024-11-26 08:35:46.634746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.954 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.634845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.634973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.634998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.635105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.635390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.635737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.635928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.636052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.636392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.636623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.636758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.636861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.637168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.637531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.637717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.637848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.638169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.638547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.638861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.638999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.639175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.639543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.639821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.639959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.640142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.640409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.640661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.640927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.641074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.641363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.641623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.641798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.641939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.642213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.642458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.642700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.642853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.642982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.643093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.643123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.955 qpair failed and we were unable to recover it. 00:28:00.955 [2024-11-26 08:35:46.643280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.643407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.955 [2024-11-26 08:35:46.643432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.643536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.643662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.643693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.643844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.644154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.644404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.644683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.644814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.644940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.645211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.645437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.645694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.645849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.645959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.646201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.646450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.646698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.646822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.646920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.647177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.647401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.647738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.647870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.648003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.648237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.648504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.648748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.648902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.649005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.649235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.649617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.649753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.649876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.650165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.650404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.650728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.650889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.956 qpair failed and we were unable to recover it. 00:28:00.956 [2024-11-26 08:35:46.651007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.956 [2024-11-26 08:35:46.651151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.651197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.651365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.651493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.651519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.651630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.651753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.651782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.651954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.652291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.652535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.652859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.652998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.653116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.653411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.653666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.653811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.653913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.654214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.654519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.654802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.654966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.655136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.655425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.655678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.655824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.655926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.656208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.656455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.656679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.656819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.656927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.657198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.657485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.657756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.657926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.658066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.658240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.658283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.957 qpair failed and we were unable to recover it. 00:28:00.957 [2024-11-26 08:35:46.658392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.957 [2024-11-26 08:35:46.658515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.658540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.658640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.658782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.658825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.658927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.659197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.659489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.659778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.659909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.660034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.660329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.660589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.660751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.660885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.661170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.661387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.661640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.661830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.662039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.662376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.662631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.662862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.663019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.663393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.663678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.663896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.664046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.664375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.664613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.664777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.664877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.665159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.665449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.958 [2024-11-26 08:35:46.665802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.958 [2024-11-26 08:35:46.665974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.958 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.666109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.666361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.666613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.666848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.666997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.667122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.667347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.667597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.667757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.667887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.668140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.668389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.668646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.668802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.668929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.669185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.669618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.669869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.669996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.670310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.670568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.670724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.670879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.671207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.671509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.671884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.671986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.672139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.672386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.672635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.672802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.672929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.673269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.673562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.673717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.673852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.674001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.674027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.959 qpair failed and we were unable to recover it. 00:28:00.959 [2024-11-26 08:35:46.674233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.674384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.959 [2024-11-26 08:35:46.674409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.674540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.674658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.674684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.674821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.674926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.674951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.675059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.675344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.675616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.675749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.675924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.676256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.676601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.676815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.676940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.677208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.677490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.677712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.677941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.678123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.678397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.678641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.678871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.679051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.679319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.679574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.679825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.679990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.680373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.680622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.680782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.680913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.681240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.681525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.681808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.681973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.682171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.682479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.960 qpair failed and we were unable to recover it. 00:28:00.960 [2024-11-26 08:35:46.682758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.960 [2024-11-26 08:35:46.682870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.682898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.683013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.683266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.683494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.683756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.683874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.683971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.684232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.684699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.684881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.684985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.685240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.685488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.685747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.685878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.685976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.686231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.686512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.686808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.686945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.687045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.687327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.687611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.687777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.687895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.688174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.688477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.688754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.688978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.689109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.689213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.689238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.961 qpair failed and we were unable to recover it. 00:28:00.961 [2024-11-26 08:35:46.689445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.961 [2024-11-26 08:35:46.689548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.689573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.689678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.689817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.689844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.689974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.690259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.690513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.690765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.690944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.691073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.691331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.691592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.691839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.691991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.692171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.692423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.692672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.692866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.693026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.693411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.693657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.693836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.693964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.694231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.694482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.694816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.694966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.695156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.695459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.695756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.695895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.696018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.696388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.696642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.696844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.697001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.697202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.962 [2024-11-26 08:35:46.697229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.962 qpair failed and we were unable to recover it. 00:28:00.962 [2024-11-26 08:35:46.697371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.697497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.697523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.697655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.697798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.697824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.697952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.698266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.698543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.698725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.698877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.699210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.699462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.699770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.699961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.700075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.700375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.700654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.700817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.700926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.701180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.701463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.701720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.701876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.702004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.702355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.702615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.702768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.702914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.703263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.703617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.703827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.703944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.704144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.704187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.963 qpair failed and we were unable to recover it. 00:28:00.963 [2024-11-26 08:35:46.704341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.963 [2024-11-26 08:35:46.704470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.704495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.704603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.704749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.704793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.704939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.705186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.705501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.705748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.705918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.706064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.706321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.706633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.706808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.706968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.707292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.707551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.707717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.707832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.708202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.708483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.708769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.708935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.709068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.709390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.709673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.709826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.709973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.710228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.710565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.710735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.710889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.711168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.711463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.711838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.711975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.712168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.712506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.964 [2024-11-26 08:35:46.712794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.964 [2024-11-26 08:35:46.712942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.964 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.713099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.713350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.713627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.713776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.713946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.714253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.714512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.714664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.714860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.715200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.715489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.715619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.715787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.716221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.716573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.716754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.716935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.717245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.717617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.717822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.717949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.718242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.718507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.718675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.718820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.719225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.719569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.719740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.719874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.720158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.720495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.720761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.720925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.721069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.721407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.721768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.721915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.965 qpair failed and we were unable to recover it. 00:28:00.965 [2024-11-26 08:35:46.722049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.722185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.965 [2024-11-26 08:35:46.722213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.722348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.722459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.722487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.722642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.722757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.722785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.722921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.723206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.723536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.723863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.723988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.724147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.724417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.724764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.724927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.725055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.725391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.725754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.725885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.725989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.726283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.726606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.726765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.726923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.727277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.727584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.727787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.727888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.728308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.728668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.728852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.729008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.729384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.729700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.729873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.729980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.730245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.730560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.966 [2024-11-26 08:35:46.730867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.966 [2024-11-26 08:35:46.730994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.966 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.731157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.731441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.731788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.731917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.732044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.732353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.732657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.732844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.733018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.733289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.733544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.733830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.733955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.734079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.734364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.734640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.734818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.734940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.735187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.735529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.735719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.735895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.736174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.736471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.736758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.736906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.737054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.737398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.737675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.737838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.737966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.738099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.738125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.738254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.738378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.738404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.967 qpair failed and we were unable to recover it. 00:28:00.967 [2024-11-26 08:35:46.738539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.967 [2024-11-26 08:35:46.738663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.738719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.738851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.739187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.739463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.739759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.739914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.740043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.740354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.740658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.740812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.740978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.741208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.741496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.741784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.741937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.742061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.742362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.742715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.742864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.742995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.743306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.743583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.743764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.743896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.744240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.744520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.744780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.744950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.745056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.745361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.745609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.745864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.745992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.746124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.746432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.746737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.746889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.968 qpair failed and we were unable to recover it. 00:28:00.968 [2024-11-26 08:35:46.747019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.968 [2024-11-26 08:35:46.747112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.747137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.747270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.747399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.747425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.747530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.747712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.747742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.747918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.748229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.748510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.748803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.748960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.749079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.749360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.749622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.749845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.749978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.750297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.750583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.750781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.750927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.751241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.751520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.751838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.751970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.752098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.752429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.752664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.752799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.752957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.753281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.753527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.753742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.753860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.754207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.754537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.754867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.754984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.755011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.755158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.755316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.755341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.969 [2024-11-26 08:35:46.755458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.755606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.969 [2024-11-26 08:35:46.755633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.969 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.755792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.755939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.755968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.756090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.756382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.756661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.756840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.757020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.757277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.757563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.757850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.757980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.758164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.758504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.758817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.758952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.759123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.759486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.759793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.759915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.760098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.760367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.760702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.760875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.760981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.761311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.761630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.761786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.761885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.762174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.762486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.762746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.762923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.763053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.763302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.763604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.763770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.763903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.764029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.970 [2024-11-26 08:35:46.764055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:00.970 qpair failed and we were unable to recover it. 00:28:00.970 [2024-11-26 08:35:46.764181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.764524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.764788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.764949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.765083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.765326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.765606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.765781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.765883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.766181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.766740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.766897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.766993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.767312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.767585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.767748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.767875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.768142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.768472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.768746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.768892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.769038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.769322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.769571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.769841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.769989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.770133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.770447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.770735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.770913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.771032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.771159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.771185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.771318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.771423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.771448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.253 qpair failed and we were unable to recover it. 00:28:01.253 [2024-11-26 08:35:46.771572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.253 [2024-11-26 08:35:46.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.771728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.771856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.771958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.771984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.772084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.772347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.772704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.772840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.772972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.773283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.773600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.773835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.773957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.774080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.774361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.774632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.774766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.774901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.775194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.775483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.775827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.775982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.776163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.776447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.776786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.776944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.777064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.777361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.777659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.777810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.777955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.778207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.778480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.778789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.778971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.779094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.779226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.779257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.779353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.779526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.254 [2024-11-26 08:35:46.779555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.254 qpair failed and we were unable to recover it. 00:28:01.254 [2024-11-26 08:35:46.779704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.779830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.779856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.779996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.780271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.780606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.780816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.780973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.781272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.781535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.781711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.781886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.782172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.782545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.782859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.782988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.783157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.783478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.783727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.783928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.784068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.784412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.784697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.784815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.784967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.785265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.785581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.785857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.785988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.786113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.786426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.786710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.786856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.786984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.787298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.787601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.787784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.787964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.788116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.788141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.255 [2024-11-26 08:35:46.788259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.788373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.255 [2024-11-26 08:35:46.788400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.255 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.788552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.788663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.788699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.788845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.788967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.788993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.789121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.789400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.789696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.789846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.789982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.790264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.790577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.790858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.790995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.791167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.791514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.791823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.791997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.792135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.792482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.792751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.792932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.793102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.793370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.793698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.793836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.793977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.794291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.794578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.794756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.794895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.795215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.795473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.795791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.795956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.796084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.796343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.256 qpair failed and we were unable to recover it. 00:28:01.256 [2024-11-26 08:35:46.796575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.256 [2024-11-26 08:35:46.796741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.796870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.796972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.796997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.797129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.797452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.797802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.797951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.798073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.798632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.798800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.798932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.799210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.799472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.799753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.799910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.800033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.800327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.800575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.800732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.800876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.801214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.801517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.801809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.801964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.802134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.802390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.802648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.802793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.802940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.803220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.803567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.257 [2024-11-26 08:35:46.803762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.257 qpair failed and we were unable to recover it. 00:28:01.257 [2024-11-26 08:35:46.803903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.804212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.804471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.804832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.804965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.805074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.805359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.805600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.805754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.805905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.806180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.806462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.806796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.806965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.807107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.807370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.807669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.807816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.807925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.808259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.808593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.808783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.808912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.809254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.809506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.809814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.809968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.810122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.810406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.810694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.810831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.810978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.811286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.811577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.811775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.811892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.812024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.812048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.258 [2024-11-26 08:35:46.812173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.812305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.258 [2024-11-26 08:35:46.812330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.258 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.812470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.812567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.812591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.812718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.812873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.812899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.813025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.813284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.813576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.813835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.813987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.814159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.814439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.814715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.814871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.814995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.815269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.815541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.815704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.815873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.816193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.816519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.816822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.816985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.817143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.817448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.817741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.817920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.818098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.818433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.818745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.818893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.819093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.819411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.819725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.819892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.820009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.820291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.820577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.259 qpair failed and we were unable to recover it. 00:28:01.259 [2024-11-26 08:35:46.820887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.820989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.259 [2024-11-26 08:35:46.821016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.821122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.821426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.821723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.821881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.822008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.822315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.822583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.822836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.822980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.823172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.823458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.823682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.823806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.823940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.824291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.824592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.824764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.824935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.825225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.825505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.825838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.825974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.826131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.826415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.826717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.826878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.827005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.827294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.827639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.827811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.827938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.828200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.828457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.828756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.828916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.829067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.829242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.829271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.260 qpair failed and we were unable to recover it. 00:28:01.260 [2024-11-26 08:35:46.829390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.260 [2024-11-26 08:35:46.829499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.829528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.829648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.829823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.829849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.830011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.830276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.830629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.830813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.830959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.831234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.831547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.831840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.831970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.832129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.832465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.832726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.832863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.832996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.833303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.833595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.833754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.833860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.834174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.834498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.834670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.835140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.835352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.835405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.835587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.835776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.835805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.835922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.836230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.836519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.836818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.836969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.837107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.837412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.837650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.837814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.837954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.838097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.838125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.261 [2024-11-26 08:35:46.838242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.838369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.261 [2024-11-26 08:35:46.838394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.261 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.838510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.838697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.838724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.838824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.838931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.838956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.839062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.839319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.839704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.839871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.840049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.840361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.840649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.840828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.840958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.841244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.841555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.841830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.841949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.842102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.842396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.842747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.842874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.843002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.843315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.843598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.843753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.843882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.844166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.844427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.844682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.844811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.844922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.845201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.845485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.262 [2024-11-26 08:35:46.845649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.262 qpair failed and we were unable to recover it. 00:28:01.262 [2024-11-26 08:35:46.845853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.845959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.845984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.846114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.846352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.846654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.846844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.846989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.847213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.847528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.847762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.847944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.848061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.848345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.848660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.848820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.848980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.849284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.849596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.849775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.849918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.850201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.850533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.850764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.850906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.851045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.851425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.851728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.851885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.851988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.852306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.852558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.852870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.852992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.853120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.853395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.853733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.853896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.263 [2024-11-26 08:35:46.854022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.854112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.263 [2024-11-26 08:35:46.854136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.263 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.854279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.854375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.854400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.854571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.854716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.854746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.854995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.855285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.855651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.855827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.855943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.856271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.856551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.856767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.856900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.857208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.857446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.857724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.857850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.858003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.858284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.858632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.858790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.858890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.859236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.859644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.859784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.859943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.860187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.860532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.860665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.860872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.861220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.861578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.861766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.861877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.862132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.862438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.862736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.862877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.264 qpair failed and we were unable to recover it. 00:28:01.264 [2024-11-26 08:35:46.863019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.264 [2024-11-26 08:35:46.863132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.863283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.863584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.863829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.863979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.864079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.864385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.864666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.864831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.864935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.865193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.865570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.865734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.865884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.866219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.866534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.866871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.866996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.867140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.867383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.867695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.867893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.868023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.868357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.868607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.868764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.868896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.869195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.869513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.869816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.869971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.870103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.870397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.870666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.870857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.871015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.871144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.871170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.871327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.871455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.265 [2024-11-26 08:35:46.871480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.265 qpair failed and we were unable to recover it. 00:28:01.265 [2024-11-26 08:35:46.871635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.871762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.871788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.871971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.872375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.872655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.872851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.872970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.873279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.873560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.873844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.873983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.874126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.874443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.874772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.874921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.875046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.875340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.875654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.875852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.876012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.876271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.876557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.876706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.876882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.877138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.877502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.877767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.877917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.878099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.878412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.878717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.878872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.878979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.879164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.879192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.266 qpair failed and we were unable to recover it. 00:28:01.266 [2024-11-26 08:35:46.879357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.879499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.266 [2024-11-26 08:35:46.879526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.879678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.879789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.879816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.879950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.880253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.880692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.880841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.880997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.881338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.881683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.881844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.881985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.882331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.882647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.882904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.883039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.883348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.883738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.883887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.884042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.884322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.884655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.884820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.884927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.885195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.885537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.885845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.885978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.886149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.886497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.886743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.886895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.887051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.887320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.887580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.887756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.887891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.888029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.888054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.267 [2024-11-26 08:35:46.888181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.888337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.267 [2024-11-26 08:35:46.888363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.267 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.888519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.888676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.888711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.888883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.889188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.889447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.889676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.889879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.890056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.890312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.890647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.890801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.890973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.891255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.891582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.891833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.891984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.892144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.892514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.892809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.892941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.893068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.893344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.893646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.893780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.893933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.894258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.894611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.894764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.894930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.895244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.895564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.895833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.895976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.896158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.896413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.896662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.896825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.268 qpair failed and we were unable to recover it. 00:28:01.268 [2024-11-26 08:35:46.896971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.897139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.268 [2024-11-26 08:35:46.897167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.897293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.897413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.897439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.897572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.897675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.897707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.897865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.898188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.898503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.898821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.898946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.899044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.899295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.899568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.899858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.899977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.900082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.900443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.900700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.900884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.901061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.901370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.901679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.901850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.901960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.902260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.902616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.902753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.902886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.903178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.903473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.903720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.903902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.904051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.904419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.904715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.904890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.904992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.905122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.905148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.905277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.905409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.269 [2024-11-26 08:35:46.905434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.269 qpair failed and we were unable to recover it. 00:28:01.269 [2024-11-26 08:35:46.905644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.905788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.905815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.905929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.906168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.906422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.906677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.906833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.906932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.907177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.907405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.907694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.907826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.907962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.908201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.908478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.908756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.908909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.909066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.909349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.909598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.909858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.909982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.910109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.910388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.910642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.910827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.910939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.911168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.911389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.911705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.911871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.911973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.912199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.912466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.912756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.912918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.270 [2024-11-26 08:35:46.913125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.913222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.270 [2024-11-26 08:35:46.913248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.270 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.913375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.913531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.913557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.913691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.913819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.913844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.913941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.914197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.914444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.914710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.914847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.914950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.915222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.915511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.915794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.915929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.916033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.916287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.916588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.916821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.916941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.917038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.917330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.917566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.917851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.917969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.918064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.918316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.918599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.918894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.918989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.919141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.919407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.271 [2024-11-26 08:35:46.919697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.271 [2024-11-26 08:35:46.919863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.271 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.919964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.920298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.920558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.920791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.920997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.921161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.921385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.921638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.921794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.921902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.922160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.922390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.922682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.922839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.922953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.923260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.923572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.923811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.923939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.924063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.924336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.924608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.924832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.924938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.925203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.925489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.925756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.925891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.926020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.926236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.926521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.926813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.926966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.927066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.927315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.272 qpair failed and we were unable to recover it. 00:28:01.272 [2024-11-26 08:35:46.927572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.272 [2024-11-26 08:35:46.927735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.927830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.927959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.927984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.928112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.928391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.928666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.928812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.929020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.929246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.929533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.929787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.929993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.930148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.930441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.930707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.930838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.930946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.931227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.931506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.931736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.931862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.931994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.932243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.932577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.932737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.932869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.933134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.933398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.933634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.933768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.933870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.934158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.934516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.934808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.934932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-11-26 08:35:46.935136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.935258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.273 [2024-11-26 08:35:46.935283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.935416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.935513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.935538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.935671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.935808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.935835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.935930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.936210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.936526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.936793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.936974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.937071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.937326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.937605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.937759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.937966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.938207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.938439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.938706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.938868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.938975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.939242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.939497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.939771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.939896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.940007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.940233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.940524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.940795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.940961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.941088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.941360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.941590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.941875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.941996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.942158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.942477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-11-26 08:35:46.942752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.274 [2024-11-26 08:35:46.942923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.943091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.943433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.943664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.943828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.943958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.944179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.944417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.944693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.944855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.944998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.945287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.945566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.945806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.945958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.946122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.946521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.946816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.946993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.947138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.947408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.947682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.947852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.947983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.948257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.948577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.948767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.948975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.949304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.949595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.949756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.949858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.950213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-11-26 08:35:46.950583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.275 [2024-11-26 08:35:46.950774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.950872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.951246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.951508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.951830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.951956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.952122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.952413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.952693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.952873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.953025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.953332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.953602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.953870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.953999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.954110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.954398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.954692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.954818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.954918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.955194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.955543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.955814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.955951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.956047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.956356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.956640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.956795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.956925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.957220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.957502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.957852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.957969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.958096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.958385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.958649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.958835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.276 qpair failed and we were unable to recover it. 00:28:01.276 [2024-11-26 08:35:46.958979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.276 [2024-11-26 08:35:46.959112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.959255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.959536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.959849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.959997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.960103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.960452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.960728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.960864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.960987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.961324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.961600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.961860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.961990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.962147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.962435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.962701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.962877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.962990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.963297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.963528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.963817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.963972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.964092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.964435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.964720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.964845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.964937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.965189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.965447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.965678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.965872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.965995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.966278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.966564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.277 qpair failed and we were unable to recover it. 00:28:01.277 [2024-11-26 08:35:46.966797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.277 [2024-11-26 08:35:46.966924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.966966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.967065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.967344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.967602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.967729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.967862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.968180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.968459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.968742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.968911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.969088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.969363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.969648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.969836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.969978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.970251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.970552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.970807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.970973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.971150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.971425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.971652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.971830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.971960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.972240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.972522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.972674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.972808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.973179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.973433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.973693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.973890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.974014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.974310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.974589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.974854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.278 [2024-11-26 08:35:46.974981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.278 qpair failed and we were unable to recover it. 00:28:01.278 [2024-11-26 08:35:46.975111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.975364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.975619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.975847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.975981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.976108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.976363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.976616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.976774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.976904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.977133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.977394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.977672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.977837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.977934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.978186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.978411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.978693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.978819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.978929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.979185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.979421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.979642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.979778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.979908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.980162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.980421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.980652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.980885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.980984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.981117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.981405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.981666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.981803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.981899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.982010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.982035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.279 [2024-11-26 08:35:46.982130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.982234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.279 [2024-11-26 08:35:46.982259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.279 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.982360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.982462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.982487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.982641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.982798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.982825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.982931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.983142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.983377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.983655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.983890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.983990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.984111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.984376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.984634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.984762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.984866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.985142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.985442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.985698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.985856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.985975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.986299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.986554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.986795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.986937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.987077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.987295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.987820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.987946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.988104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.988378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.988658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.988801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.280 qpair failed and we were unable to recover it. 00:28:01.280 [2024-11-26 08:35:46.988931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.280 [2024-11-26 08:35:46.989054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.989079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.989238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.989391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.989417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.989522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.989648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.989675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.989838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.990148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.990412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.990678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.990854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.990979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.991231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.991477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.991748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.991927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.992070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.992339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.992599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.992849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.992971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.993069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.993310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.993556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.993839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.993955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.994082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.994363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.994583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.994744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.994899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.995177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.995403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.995681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.995846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.995958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.996193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.281 qpair failed and we were unable to recover it. 00:28:01.281 [2024-11-26 08:35:46.996442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.281 [2024-11-26 08:35:46.996569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.996667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.996791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.996817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.996952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.997219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.997443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.997758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.997932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.998039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.998268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.998518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.998782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.998936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.999070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.999305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.999534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:46.999691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:46.999850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.000169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.000452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.000712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.000863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.000974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.001259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.001501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.001780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.001934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.002072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.002349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.002659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.002840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.002939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.003218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.003532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.003838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.003995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.004019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.004166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.004288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.004315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.282 qpair failed and we were unable to recover it. 00:28:01.282 [2024-11-26 08:35:47.004462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.282 [2024-11-26 08:35:47.004588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.004616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.004754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.004883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.004908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.005024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.005379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.005675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.005849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.005944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.006212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.006506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.006702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.006831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.007141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.007431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.007766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.007915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.008042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.008326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.008584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.008716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.008875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.009158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.009411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.009751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.009876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.010000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.010259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.010556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.010848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.010963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.011088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.011355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.011705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.011827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.011934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.012268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.283 [2024-11-26 08:35:47.012610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.283 [2024-11-26 08:35:47.012795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.283 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.012903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.012999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.013220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.013524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.013838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.013985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.014114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.014437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.014703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.014841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.014984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.015273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.015600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.015861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.015986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.016127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.016374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.016660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.016855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.016987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.017302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.017594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.017858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.017984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.018131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.018408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.018681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.018817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.018976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.019274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.019535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.019845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.019990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.020157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.020451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.020742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.020890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.284 qpair failed and we were unable to recover it. 00:28:01.284 [2024-11-26 08:35:47.021004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.021117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.284 [2024-11-26 08:35:47.021147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.021287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.021539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.021818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.021995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.022088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.022364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.022624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.022806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.022961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.023272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.023548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.023744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.023924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.024209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.024433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.024712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.024869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.024971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.025325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.025623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.025817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.025958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.026247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.026544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.026881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.026988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.027131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.027440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.027712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.027885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.028027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.028136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.028164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.028286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.028413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.285 [2024-11-26 08:35:47.028438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.285 qpair failed and we were unable to recover it. 00:28:01.285 [2024-11-26 08:35:47.028553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.028695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.028723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.028863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.028976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.029127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.029406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.029747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.029915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.030064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.030333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.030627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.030789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.030909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.031198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.031482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.031776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.031936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.032074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.032368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.032643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.032811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.032918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.033221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.033496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.033785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.033966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.034101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.034389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.034745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.034917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.035023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.035305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.035588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.035880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.035997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.036026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.036148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.036296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.036322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.036442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.036608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.286 [2024-11-26 08:35:47.036635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.286 qpair failed and we were unable to recover it. 00:28:01.286 [2024-11-26 08:35:47.036809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.036916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.036942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.037065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.037358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.037637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.037818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.037943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.038250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.038566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.038850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.038979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.039129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.039405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.039737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.039899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.040020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.040294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.040586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.040841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.040977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.041146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.041475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.041731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.041854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.042007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.042293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.042564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.042734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.042885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.043196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.043455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.043742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.043883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.044035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.044358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.044666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.044815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.287 [2024-11-26 08:35:47.044963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.045090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.287 [2024-11-26 08:35:47.045115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.287 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.045271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.045414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.045442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.045590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.045749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.045775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.045876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.045982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.046152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.046426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.046741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.046899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.047011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.047309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.047666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.047863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.047985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.048333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.048657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.048787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.048898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.049151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.049465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.049715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.049888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.050001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.050279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.050549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.050871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.050999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.051109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.051417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.051736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.051865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.051967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.052332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.052630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.052800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.052895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.053232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.288 [2024-11-26 08:35:47.053494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.288 [2024-11-26 08:35:47.053635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.288 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.053762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.053891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.053916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.054027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.054345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.054575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.054829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.054976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.055101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.055402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.055650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.055823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.055946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.056263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.056567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.056834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.056982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.057121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.057374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.057662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.057846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.057974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.058217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.058477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.058778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.058932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.059117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.059419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.059715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.059840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.059973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.060335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.289 qpair failed and we were unable to recover it. 00:28:01.289 [2024-11-26 08:35:47.060627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.289 [2024-11-26 08:35:47.060754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.060880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.060979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.061144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.061471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.061770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.061927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.062056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.062360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.062610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.062799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.062897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.063214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.063507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.063779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.063909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.064003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.064305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.064592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.064797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.064926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.065244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.065511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.065781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.065913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.066018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.066296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.066560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.066886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.066985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.067129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.067503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.067786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.067917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.068038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.068358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.068680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.068818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.290 [2024-11-26 08:35:47.068992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.069109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.290 [2024-11-26 08:35:47.069137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.290 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.069252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.069820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.069954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.070099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.070372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.070646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.070807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.070950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.071219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.071468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.071745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.071901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.071999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.072254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.072505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.072747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.072893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.073040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.073355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.073652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.073795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.073945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.074258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.074844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.074983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.075179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.075398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.075787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.075918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.076056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.076307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.076618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.076768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.076922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.077014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.077038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.291 qpair failed and we were unable to recover it. 00:28:01.291 [2024-11-26 08:35:47.077189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.077304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.291 [2024-11-26 08:35:47.077332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.077481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.077627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.077652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.077764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.077880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.077905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.078054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.078370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.078640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.078812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.078914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.079270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.079604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.079872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.079986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.080124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.080401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.080669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.080830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.080948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.081231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.081481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.081766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.081915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.082021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.082333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.082585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.082808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.082942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.083236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.083541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.292 [2024-11-26 08:35:47.083677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.292 qpair failed and we were unable to recover it. 00:28:01.292 [2024-11-26 08:35:47.083795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.083892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.083918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.593 qpair failed and we were unable to recover it. 00:28:01.593 [2024-11-26 08:35:47.084128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.084275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.084303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.593 qpair failed and we were unable to recover it. 00:28:01.593 [2024-11-26 08:35:47.084442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.084550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.084577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.593 qpair failed and we were unable to recover it. 00:28:01.593 [2024-11-26 08:35:47.084719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.593 [2024-11-26 08:35:47.084847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.084873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.084977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.085284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.085541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.085824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.085949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.086061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.086339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.086596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.086742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.086884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.087276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.087557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.087843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.087975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.088121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.088373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.088663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.088803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.088935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.089186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.089442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.089733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.089856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.089973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.090099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.090126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.090280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.090417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.090444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.594 qpair failed and we were unable to recover it. 00:28:01.594 [2024-11-26 08:35:47.090618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.594 [2024-11-26 08:35:47.090747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.090772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.090873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.091212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.091493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.091758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.091879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.091986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.092284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.092534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.092848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.092988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.093160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.093437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.093717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.093852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.093987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.094247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.094546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.094857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.094992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.095121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.095401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.095672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.095833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.095927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.096190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.096467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.595 qpair failed and we were unable to recover it. 00:28:01.595 [2024-11-26 08:35:47.096809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.595 [2024-11-26 08:35:47.096951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.097068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.097324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.097624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.097757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.097859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.098209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.098525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.098818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.098936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.099075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.099315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.099630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.099796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.099931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.100246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.100521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.100698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.100854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.101187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.101524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.101727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.101885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.102193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.102519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.102678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.102859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.103156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.596 [2024-11-26 08:35:47.103466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.596 [2024-11-26 08:35:47.103647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.596 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.103843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.103945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.103980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.104161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.104431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.104730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.104889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.105068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.105331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.105665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.105786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.105889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.106240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.106557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.106722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.106880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.107170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.107521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.107692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.107845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.108182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.108504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.108774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.108968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.109067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.109393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.109749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.109874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.110053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.110223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.597 [2024-11-26 08:35:47.110251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.597 qpair failed and we were unable to recover it. 00:28:01.597 [2024-11-26 08:35:47.110424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.110522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.110548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.110662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.110801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.110829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.111009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.111283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.111574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.111747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.111879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.112162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.112423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.112679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.112844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.113022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.113359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.113697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.113852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.113986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.114285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.114561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.114843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.114991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.115129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.115401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.115719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.115851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.115980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.116256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.598 [2024-11-26 08:35:47.116552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.598 [2024-11-26 08:35:47.116679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.598 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.116864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.117198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.117487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.117743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.117927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.118095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.118409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.118734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.118865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.119029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.119336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.119679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.119845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.119991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.120349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.120656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.120806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.120950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.121266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.121530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.121816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.121973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.599 qpair failed and we were unable to recover it. 00:28:01.599 [2024-11-26 08:35:47.122093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.599 [2024-11-26 08:35:47.122182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.122206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.122297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.122451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.122479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.122648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.122759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.122787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.122953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.123291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.123633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.123781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.123908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.124211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.124522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.124839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.124996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.125180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.125500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.125813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.125932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.126069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.126347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.126733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.126913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.127054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.127345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.127677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.127833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.127937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.128032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.128058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.128205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.128341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.128368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.600 qpair failed and we were unable to recover it. 00:28:01.600 [2024-11-26 08:35:47.128516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.600 [2024-11-26 08:35:47.128645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.128669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.128829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.129148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.129528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.129819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.129951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.130080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.130425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.130649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.130792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.130928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.131213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.131514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.131822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.131975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.132180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.132454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.132767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.132992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.133136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.133449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.133786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.133945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.134100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.134374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.134639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.134814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.134987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.135086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.135113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.601 qpair failed and we were unable to recover it. 00:28:01.601 [2024-11-26 08:35:47.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.601 [2024-11-26 08:35:47.135406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.135433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.135573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.135833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.135860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.136039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.136376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.136678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.136824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.136971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.137231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.137504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.137859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.137981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.138163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.138467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.138794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.138920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.139030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.139287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.139631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.139785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.139976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.140223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.140467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.140696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.140867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.141051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.141327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.141649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.141829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.602 qpair failed and we were unable to recover it. 00:28:01.602 [2024-11-26 08:35:47.141984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.602 [2024-11-26 08:35:47.142130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.142308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.142581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.142878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.142984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.143139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.143486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.143754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.143943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.144095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.144348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.144628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.144830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.144970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.145212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.145558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.145839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.145987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.146138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.146296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.146321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.146437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1082913 Killed "${NVMF_APP[@]}" "$@" 00:28:01.603 [2024-11-26 08:35:47.146582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.146610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.146750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.146860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.146885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 08:35:47 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:28:01.603 [2024-11-26 08:35:47.147022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 08:35:47 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:01.603 [2024-11-26 08:35:47.147166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.147195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 08:35:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:01.603 08:35:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:01.603 [2024-11-26 08:35:47.147364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 08:35:47 -- common/autotest_common.sh@10 -- # set +x 00:28:01.603 [2024-11-26 08:35:47.147479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.147508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.147632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.148702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.148736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.148883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.149031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.603 [2024-11-26 08:35:47.149056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.603 qpair failed and we were unable to recover it. 00:28:01.603 [2024-11-26 08:35:47.149190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.149429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.149692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.149889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.150018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.150327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.150648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.150797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.150947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.151079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 08:35:47 -- nvmf/common.sh@469 -- # nvmfpid=1083493 00:28:01.604 [2024-11-26 08:35:47.151104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 08:35:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:01.604 08:35:47 -- nvmf/common.sh@470 -- # waitforlisten 1083493 00:28:01.604 [2024-11-26 08:35:47.151236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.151365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.151391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 08:35:47 -- common/autotest_common.sh@829 -- # '[' -z 1083493 ']' 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.151514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 08:35:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:01.604 08:35:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:01.604 [2024-11-26 08:35:47.151642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.151668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 08:35:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:01.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:01.604 [2024-11-26 08:35:47.151840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 08:35:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:01.604 08:35:47 -- common/autotest_common.sh@10 -- # set +x 00:28:01.604 [2024-11-26 08:35:47.151964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.152000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.152124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.152285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.152310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.152440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.153699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.153734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.153854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.153997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.154139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.154468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.154755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.154942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.155095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.155435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.155674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.155837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.155938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.156064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.156089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.604 qpair failed and we were unable to recover it. 00:28:01.604 [2024-11-26 08:35:47.156221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.604 [2024-11-26 08:35:47.156331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.156358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.156473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.156574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.156599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.156755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.156899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.156924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.157024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.157284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.157560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.157847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.157978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.158107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.158337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.158592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.158855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.158999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.159127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.159381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.159666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.159833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.159932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.160209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.160453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.160680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.160815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.160912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.161039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.605 [2024-11-26 08:35:47.161064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.605 qpair failed and we were unable to recover it. 00:28:01.605 [2024-11-26 08:35:47.161220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.161469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.161727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.161904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.162056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.162372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.162613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.162820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.162987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.163320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.163611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.163802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.163921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.164223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.164502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.164753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.164935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.165083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.165360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.165698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.165908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.166102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.166374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.166630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.166851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.166963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.167132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.167175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.167310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.167403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.167428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.606 qpair failed and we were unable to recover it. 00:28:01.606 [2024-11-26 08:35:47.167554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.606 [2024-11-26 08:35:47.167681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.167720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.167829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.168159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.168450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.168681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.168877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.169056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.169354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.169641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.169814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.169929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.170280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.170571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.170733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.170863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.171222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.171482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.171671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.171825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.172197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.172507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.172745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.172902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.173068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.173429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.173759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.173966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.607 qpair failed and we were unable to recover it. 00:28:01.607 [2024-11-26 08:35:47.174143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.174262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.607 [2024-11-26 08:35:47.174288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.174415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.174572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.174597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.174746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.174895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.174920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.175052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.175327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.175640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.175820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.175963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.176294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.176598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.176784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.176911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.177168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.177472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.177833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.177986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.178116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.178400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.178631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.178795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.178922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.179229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.179502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.179789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.179961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.180151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.180298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.180323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.608 qpair failed and we were unable to recover it. 00:28:01.608 [2024-11-26 08:35:47.180478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.180597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.608 [2024-11-26 08:35:47.180622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.180775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.180878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.180904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.181045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.181320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.181626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.181816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.181999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.182307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.182562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.182722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.182874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.183187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.183481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.183737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.183906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.184051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.184314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.184625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.184788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.184947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.185277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.185699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.185875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.186270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.186534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.186707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.186860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.187009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.187036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.609 qpair failed and we were unable to recover it. 00:28:01.609 [2024-11-26 08:35:47.187193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.609 [2024-11-26 08:35:47.187343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.187368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.187498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.187628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.187655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.187824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.187994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.188162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.188418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.188711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.188936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.189068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.189338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.189615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.189806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.189955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.190307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.190610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.190787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.190931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.191229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.191561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.191748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.191872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.192072] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:01.610 [2024-11-26 08:35:47.192148] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:01.610 [2024-11-26 08:35:47.192167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.192460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.192932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.193108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.193250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.193278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.610 [2024-11-26 08:35:47.193427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.193575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.610 [2024-11-26 08:35:47.193602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.610 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.193739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.193843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.193869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.194057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.194364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.194718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.194858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.194955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.195234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.195569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.195744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.195879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.196224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.196540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.196794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.196992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.197163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.197472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.197825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.197999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.198177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.198337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.198362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.198546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.198720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.198746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.198874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.199186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.199516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.199989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.200013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.611 qpair failed and we were unable to recover it. 00:28:01.611 [2024-11-26 08:35:47.200165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.611 [2024-11-26 08:35:47.200300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.200329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.200468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.200574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.200602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.200728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.200839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.200865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.201043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.201207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.201235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.201367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.201523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.201551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.201712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.202302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.202639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.202774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.202911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.203288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.203625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.203809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.203913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.204209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.204530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.204794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.204901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.205270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.205654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.205807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.205905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.206196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.206523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.612 qpair failed and we were unable to recover it. 00:28:01.612 [2024-11-26 08:35:47.206837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.612 [2024-11-26 08:35:47.206933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.206959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.207079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.207385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.207769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.207919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.208057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.208327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.208666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.208821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.208990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.209305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.209634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.209812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.209945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.210245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.210617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.210806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.210953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.211323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.211659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.211865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.211982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.212345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.212695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.212818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.212966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.213348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.213660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.213837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.213985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.214150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.214177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.214291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.214393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.214421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.613 qpair failed and we were unable to recover it. 00:28:01.613 [2024-11-26 08:35:47.214542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.613 [2024-11-26 08:35:47.214679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.214720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.214897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.215252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.215563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.215886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.215991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.216146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.216464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.216771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.216974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.217133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.217410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.217720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.217864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.217988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.218382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.218671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.218891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.219042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.219297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.219604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.219856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.219980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.220135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.220425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.220722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.220884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.614 qpair failed and we were unable to recover it. 00:28:01.614 [2024-11-26 08:35:47.221017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.614 [2024-11-26 08:35:47.221153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.221178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.221338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.221482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.221510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.221762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.221916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.221941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.222075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.222312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.222625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.222808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.222916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.223230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.223578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.223779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.223951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.224223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.224566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.224746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.224905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.225195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.225469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.225796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.225974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.226119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.226421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.226782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.226951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.227101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.227382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.227726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.227874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.615 qpair failed and we were unable to recover it. 00:28:01.615 [2024-11-26 08:35:47.228001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.615 [2024-11-26 08:35:47.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.228145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.616 [2024-11-26 08:35:47.228336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.228467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.228507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.228662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.228766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.228791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.228950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.229240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.229557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.229821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.229945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.230102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.230441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.230782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.230938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.231097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.231425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.231714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.231873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.232035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.232289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.232562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.232872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.232995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.233118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.233378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.233647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.233778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.233888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.234008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.234032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.616 [2024-11-26 08:35:47.234149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.234278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.616 [2024-11-26 08:35:47.234303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.616 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.234454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.234555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.234581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.234713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.234879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.234903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.235046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.235327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.235580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.235843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.235997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.236131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.236407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.236697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.236850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.237009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.237283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.237566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.237829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.237980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.238081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.238354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.238575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.238883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.238987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.239012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.239122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.239272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.239297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.617 qpair failed and we were unable to recover it. 00:28:01.617 [2024-11-26 08:35:47.239398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.617 [2024-11-26 08:35:47.239497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.239522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.239681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.239838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.239864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.239966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.240210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.240490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.240757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.240880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.241034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.241306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.241596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.241746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.241903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.242240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.242578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.242742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.242897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.243148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.243378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.243660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.243789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.243921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.244196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.244420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.244734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.244865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.244964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.245235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.245521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.618 qpair failed and we were unable to recover it. 00:28:01.618 [2024-11-26 08:35:47.245815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.618 [2024-11-26 08:35:47.245972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.245997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.246131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.246425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.246715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.246869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.246996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.247254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.247538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.247824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.247944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.248074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.248362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.248648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.248784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.248907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.249215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.249544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.249824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.249941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.250068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.250365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.250642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.250801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.250908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.251165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.251476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.251769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.251901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.619 qpair failed and we were unable to recover it. 00:28:01.619 [2024-11-26 08:35:47.252017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.619 [2024-11-26 08:35:47.252144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.252327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.252782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.252913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.253015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.253323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.253610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.253773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.253929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.254182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.254429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.254673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.254802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.254898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.255157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.255681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.255809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.255910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.256197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.256504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.256836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.256980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.257072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.257291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.257624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.620 [2024-11-26 08:35:47.257777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.620 qpair failed and we were unable to recover it. 00:28:01.620 [2024-11-26 08:35:47.257871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.257980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.258134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.258386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.258643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.258845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.258952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.259249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.259479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.259764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.259920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.260034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.260337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.260549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.260863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.260984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.261107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.261352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.261635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.261799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.261925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.262221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.262466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.262695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.262823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:01.621 [2024-11-26 08:35:47.262850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.262975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.263286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.263538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.263829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.621 [2024-11-26 08:35:47.263982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.621 qpair failed and we were unable to recover it. 00:28:01.621 [2024-11-26 08:35:47.264107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.264448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.264742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.264893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.265024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.265304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.265581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.265767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.265896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.266171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.266442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.266695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.266852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.267004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.267282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.267574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.267847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.267998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.268093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.268440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.268724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.268881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.269003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.269257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.269509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.269822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.269998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.270133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.270442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.270723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.270852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.270958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.271084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.271109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.622 qpair failed and we were unable to recover it. 00:28:01.622 [2024-11-26 08:35:47.271214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.622 [2024-11-26 08:35:47.271336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.271362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.271604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.271734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.271760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.271891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.272170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.272454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.272713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.272838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.273002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.273309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.273615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.273898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.273996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.274181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.274489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.274712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.274893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.275050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.275280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.275540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.275769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.275916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.276013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.276167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.276192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.623 qpair failed and we were unable to recover it. 00:28:01.623 [2024-11-26 08:35:47.276423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.276523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.623 [2024-11-26 08:35:47.276548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.276678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.276781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.276806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.276934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.277215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.277494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.277758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.277907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.278010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.278325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.278608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.278840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.278976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.279106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.279398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.279647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.279802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.279901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.280183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.280508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.280777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.280915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.281131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.281427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.281679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.281833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.281939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.282212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.624 qpair failed and we were unable to recover it. 00:28:01.624 [2024-11-26 08:35:47.282513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.624 [2024-11-26 08:35:47.282644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.282773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.282876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.282901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.283032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.283278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.283537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.283832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.283983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.284078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.284363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.284676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.284802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.284910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.285158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.285458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.285750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.285880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.286005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.286291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.286541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.286792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.286921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.287041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.287301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.287556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.287838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.287964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.288076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.288353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.288660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.625 [2024-11-26 08:35:47.288798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.625 qpair failed and we were unable to recover it. 00:28:01.625 [2024-11-26 08:35:47.288899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.289178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.289476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.289731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.289865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.289983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.290261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.290487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.290774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.290906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.291064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.291322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.291570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.291823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.291956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.292124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.292406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.292682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.292830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.292963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.293255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.293479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.293701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.293826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.293985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.294242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.294491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.294749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.294877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.295035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.295305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.295565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.295794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.295940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.626 qpair failed and we were unable to recover it. 00:28:01.626 [2024-11-26 08:35:47.296036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.296144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.626 [2024-11-26 08:35:47.296169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.296323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.296584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.296858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.296982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.297082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.297295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.297553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.297842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.297968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.298073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.298326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.298569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.298730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.298863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.299180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.299461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.299797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.299954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.300058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.300312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.300622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.300764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.300907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.301174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.301396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.301767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.301886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.301999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.302280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.302559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.302822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.302945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.303070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.303178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.627 [2024-11-26 08:35:47.303203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.627 qpair failed and we were unable to recover it. 00:28:01.627 [2024-11-26 08:35:47.303308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.303552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.303871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.303996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.304088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.304303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.304614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.304877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.304981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.305113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.305362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.305626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.305757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.305850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.306179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.306469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.306747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.306864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.307021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.307354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.307639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.307795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.307932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.308188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.308437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.308807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.308966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.309102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.309403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.309717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.628 [2024-11-26 08:35:47.309867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.628 qpair failed and we were unable to recover it. 00:28:01.628 [2024-11-26 08:35:47.309971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.310250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.310474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.310792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.310926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.311069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.311366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.311621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.311783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.311882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.312155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.312405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.312682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.312845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.312954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.313190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.313414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.313717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.313842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.313983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.314245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.314501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.314845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.314979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.315130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.315382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.315635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.315850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.315966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.316124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.316437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.316740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.316866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.629 [2024-11-26 08:35:47.316990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.317088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.629 [2024-11-26 08:35:47.317114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.629 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.317237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.317524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.317762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.317915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.318048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.318292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.318542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.318826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.318976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.319131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.319410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.319634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.319887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.319980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.320131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.320415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.320689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.320881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.321046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.321321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.321638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.321873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.321999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.322158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.322381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.322601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.322722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.322878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.323172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.323436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.323751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.323877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.630 qpair failed and we were unable to recover it. 00:28:01.630 [2024-11-26 08:35:47.323999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.324130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.630 [2024-11-26 08:35:47.324155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.324319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.324470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.324495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.324623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.324829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.324855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.325001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.325231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.325513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.325851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.325977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.326139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.326422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.326693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.326846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.326987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.327291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.327548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.327841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.327970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.328158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.328438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.328712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.328840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.329018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.329334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.329627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.329793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.329935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.330236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.330507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.330811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.330995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.331095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.331356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.331665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.331829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.631 qpair failed and we were unable to recover it. 00:28:01.631 [2024-11-26 08:35:47.331963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.332107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.631 [2024-11-26 08:35:47.332133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.332263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.332553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.332821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.332974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.333087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.333403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.333699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.333818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.333919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.334168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.334432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.334718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.334880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.335045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.335355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.335665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.335853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.335980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.336290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.336551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.336812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.336960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.337103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.337359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.337615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.337789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.337921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.338267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.338558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.338816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.338933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.339038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.339172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.339198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.632 qpair failed and we were unable to recover it. 00:28:01.632 [2024-11-26 08:35:47.339327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.632 [2024-11-26 08:35:47.339462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.339487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.339614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.339712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.339738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.339844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.339974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.339999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.340097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.340386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.340677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.340831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.340937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.341220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.341493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.341821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.341975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.342106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.342391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.342631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.342815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.342916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.343197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.343492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.343831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.343981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.344088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.344434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.344718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.344843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.344969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.345221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.633 [2024-11-26 08:35:47.345510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.633 [2024-11-26 08:35:47.345653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.633 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.345765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.345860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.345886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.345986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.346227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.346486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.346744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.346862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.347019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.347281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.347562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.347813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.347934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.348028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.348282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.348568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.348838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.348988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.349168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.349486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.349764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.349891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.350054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.350286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.350598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.350859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.350993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.351090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.351426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.351710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.351827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.351954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.352272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.352545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.352810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.352968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.634 [2024-11-26 08:35:47.353095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.353228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.634 [2024-11-26 08:35:47.353253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.634 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.353356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.353455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.353481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.353620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.353741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.353767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.353899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.353995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.354148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.354451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.354698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.354886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.355009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.355316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.355603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.355860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.355982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.356164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.356440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.356721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.356871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.356978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.357327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.357583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.357865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.357991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.358096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.358341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.358628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.358883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.358980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.359135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.359408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.359692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.359836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.359944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.360174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.360487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.360742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.360863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.635 [2024-11-26 08:35:47.360962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.361087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.635 [2024-11-26 08:35:47.361113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.635 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.361268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.361545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.361802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.361920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.362026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.362293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.362632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.362779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.362887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.363131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.363390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.363704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.363860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.364013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.364324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.364609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.364792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.364901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.365145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.365430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.365719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.365843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.365964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.366221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.366516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.366805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.366964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.367062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.367274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.367495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.367776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.367896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.368001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.368253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.368539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.368797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.368913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.636 qpair failed and we were unable to recover it. 00:28:01.636 [2024-11-26 08:35:47.369009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.636 [2024-11-26 08:35:47.369114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.369244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.369465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.369796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.369950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.370046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.370322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.370544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.370824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.370974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.371141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.371278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.371303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.371856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.372469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.372501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.372613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.372766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.372793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.372897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.373204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.373484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.373762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.373899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.374044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.374301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.374597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.374850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.374988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.375149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.375466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.375728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.375903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.376057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.376306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.376594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.376841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.376963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.377063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.377278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:01.637 [2024-11-26 08:35:47.377293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377403] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:01.637 [2024-11-26 08:35:47.377412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.637 [2024-11-26 08:35:47.377422] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:01.637 qpair failed and we were unable to recover it. 00:28:01.637 [2024-11-26 08:35:47.377435] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:01.637 [2024-11-26 08:35:47.377528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:01.637 [2024-11-26 08:35:47.377525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:01.637 [2024-11-26 08:35:47.377624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.637 [2024-11-26 08:35:47.377652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 [2024-11-26 08:35:47.377547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:01.638 [2024-11-26 08:35:47.377550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.377801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.377930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.377960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.378069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.378322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.378576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.378860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.378981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.379087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.379368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.379619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.379759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.379883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.380144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.380417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.380696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.380824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.380924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.381208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.381468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.381736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.381900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.382036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.382313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.382587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.382823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.382977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.383094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.383206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.383232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.383333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.383469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.638 [2024-11-26 08:35:47.383494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.638 qpair failed and we were unable to recover it. 00:28:01.638 [2024-11-26 08:35:47.383606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.383720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.383746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.383904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.384182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.384476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.384727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.384880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.385017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.385272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.385609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.385805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.385905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.386134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.386440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.386697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.386864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.386956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.387217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.387468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.387743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.387874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.388034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.388301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.388568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.388803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.388951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.389091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.389347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.389609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.389787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.389911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.390144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.390398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.390665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.390826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.390930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.391034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.639 [2024-11-26 08:35:47.391058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.639 qpair failed and we were unable to recover it. 00:28:01.639 [2024-11-26 08:35:47.391160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.391378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.391639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.391855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.391952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.392221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.392474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.392765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.392894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.393031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.393300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.393545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.393851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.393994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.394096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.394384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.394660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.394819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.394917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.395162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.395388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.395637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.395779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.395917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.396179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.396437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.396718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.396845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.396954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.397200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.397451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.397719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.397858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.397961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.398204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.640 qpair failed and we were unable to recover it. 00:28:01.640 [2024-11-26 08:35:47.398457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.640 [2024-11-26 08:35:47.398581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.398711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.398805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.398830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.398937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.399194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.399484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.399752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.399933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.400041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.400285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.400579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.400889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.400995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.401121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.401387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.401665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.401800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.401926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.402188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.402433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.402718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.402881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.402985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.403217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.403463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.403765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.403916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.404098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.404348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.404626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.404903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.404998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.405149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.405394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.405646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.405810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.405945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.406232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.406533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.641 qpair failed and we were unable to recover it. 00:28:01.641 [2024-11-26 08:35:47.406776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.641 [2024-11-26 08:35:47.406936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.407083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.407356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.407667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.407815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.407928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.408250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.408612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.408770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.408895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.409217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.409499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.409734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.409894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.410021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.410286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.410516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.410771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.410902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.411011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.411279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.411517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.411797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.411921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.412042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.412312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.412594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.412775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.412884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.413203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.413486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.413825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.413945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.414089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.414360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.414612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.414869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.414992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.415150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.415388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.415602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.415732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.415889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.416179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.416413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.416734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.416872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.417018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.417130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.417155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.642 qpair failed and we were unable to recover it. 00:28:01.642 [2024-11-26 08:35:47.417259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.642 [2024-11-26 08:35:47.417381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.417406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.417507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.417609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.417633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.417742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.417876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.417901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.418016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.418288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.418516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.418791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.418913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.419049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.419365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.419634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.419776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.419885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.420160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.420458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.420677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.420815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.420913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.421148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.421396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.421694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.421827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.421957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.422244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.422527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.643 [2024-11-26 08:35:47.422783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.643 [2024-11-26 08:35:47.422926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.643 qpair failed and we were unable to recover it. 00:28:01.929 [2024-11-26 08:35:47.423112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.929 qpair failed and we were unable to recover it. 00:28:01.929 [2024-11-26 08:35:47.423356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.929 qpair failed and we were unable to recover it. 00:28:01.929 [2024-11-26 08:35:47.423621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.929 [2024-11-26 08:35:47.423800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.929 qpair failed and we were unable to recover it. 00:28:01.929 [2024-11-26 08:35:47.423929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.424204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.424456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.424730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.424890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.424995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.425269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.425500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.425792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.425924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.426032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.426338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.426576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.426831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.426966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.427074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.427297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.427581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.427841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.427989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.428092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.428362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.428627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.428802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.428909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.429046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.429070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.930 qpair failed and we were unable to recover it. 00:28:01.930 [2024-11-26 08:35:47.429194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.930 [2024-11-26 08:35:47.429284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.429309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.429447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.429554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.429578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.429727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.429849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.429874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.429979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.430226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.430504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.430772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.430896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.431030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.431279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.431633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.431777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.431914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.432186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.432432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.432704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.432846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.432948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.433178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.433475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.433701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.433867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.433994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.434283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.434514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.434733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.434858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.931 qpair failed and we were unable to recover it. 00:28:01.931 [2024-11-26 08:35:47.434949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.931 [2024-11-26 08:35:47.435111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.435236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.435474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.435725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.435851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.436205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.436430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.436666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.436834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.436965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.437222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.437462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.437739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.437871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.437972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.438257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.438477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.438745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.438914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.439018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.439317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.439609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.439874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.439995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.440118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.440357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.932 qpair failed and we were unable to recover it. 00:28:01.932 [2024-11-26 08:35:47.440655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.932 [2024-11-26 08:35:47.440765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.440790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.440900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.441179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.441440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.441696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.441830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.441923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.442169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.442400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.442629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.442874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.442999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.443103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.443334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.443562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.443852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.443978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.444144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.444388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.444677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.444836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.444928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.445193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.445439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.445661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.445846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.445947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.446039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.446064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.933 qpair failed and we were unable to recover it. 00:28:01.933 [2024-11-26 08:35:47.446161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.933 [2024-11-26 08:35:47.446260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.446285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.446448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.446547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.446572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.446668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.446796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.446822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.446929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.447163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.447417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.447739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.447859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.447960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.448219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.448467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.448724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.448857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.448967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.449265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.449555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.449785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.449918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.450028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.450269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.450552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.450785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.450908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.451032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.451314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.451574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.451863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.451999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.452100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.452202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.934 [2024-11-26 08:35:47.452228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.934 qpair failed and we were unable to recover it. 00:28:01.934 [2024-11-26 08:35:47.452372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.452471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.452495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.452586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.452710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.452736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.452845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.452969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.453117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.453374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.453625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.453870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.453995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.454139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.454397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.454650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.454877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.454983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.455107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.455366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.455620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.455893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.455997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.456021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.456176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.456312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.456337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.935 qpair failed and we were unable to recover it. 00:28:01.935 [2024-11-26 08:35:47.456469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.935 [2024-11-26 08:35:47.456568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.456592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.456741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.456839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.456865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.456960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.457218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.457458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.457715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.457842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.457942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.458219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.458463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.458721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.458845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.458946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.459234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.459491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.459743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.459861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.459968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.460249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.460529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.460776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.460929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.461069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.461312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.461531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.461844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.461977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.462121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.462218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.462243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.936 qpair failed and we were unable to recover it. 00:28:01.936 [2024-11-26 08:35:47.462337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.936 [2024-11-26 08:35:47.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.462492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.462622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.462754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.462780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.462878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.463127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.463419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.463629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.463810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.463958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.464183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.464461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.464763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.464919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.465048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.465280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.465488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.465808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.465959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.466079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.466297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.466599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.466870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.466990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.467094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.467345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.467647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.467876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.467997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.468020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.937 [2024-11-26 08:35:47.468135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.468229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.937 [2024-11-26 08:35:47.468254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.937 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.468377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.468471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.468646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.468745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.468770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.468881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.468977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.469111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.469359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.469620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.469872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.469993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.470143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.470426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.470680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.470826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.470957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.471244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.471538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.471831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.471946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.472052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.472324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.472659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.472794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.472906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.473174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.473436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.473717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.473854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.473982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.474091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.474116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.938 [2024-11-26 08:35:47.474247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.474352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.938 [2024-11-26 08:35:47.474376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.938 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.474504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.474639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.474663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.474786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.474881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.474905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.475047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.475303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.475593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.475854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.475977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.476077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.476367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.476624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.476885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.476982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.477120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.477396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.477707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.477870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.477968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.478219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.478495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.478771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.478929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.479062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.479331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.479619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.479852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.479979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.939 [2024-11-26 08:35:47.480003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.939 qpair failed and we were unable to recover it. 00:28:01.939 [2024-11-26 08:35:47.480103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.480373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.480599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.480866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.480981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.481089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.481339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.481606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.481764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.481886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.482191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.482445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.482659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.482821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.482948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.483190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.483417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.483703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.483860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.483965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.484225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.484499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.484788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.484914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.485025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.485301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.485551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.940 qpair failed and we were unable to recover it. 00:28:01.940 [2024-11-26 08:35:47.485823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.940 [2024-11-26 08:35:47.485976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.486102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.486383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.486659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.486809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.486936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.487213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.487421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.487647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.487827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.487922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.488205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.488535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.488805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.488926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.489093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.489398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.489695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.489843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.489941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.490202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.941 [2024-11-26 08:35:47.490520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.941 [2024-11-26 08:35:47.490649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.941 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.490777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.490910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.490936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.491035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.491253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.491469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.491782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.491933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.492055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.492307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.492575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.492834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.492981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.493078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.493554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.493809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.493931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.494069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.494302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.494508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.494811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.494965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.495067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.495297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.495516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.495746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.495896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.496029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.496137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.496161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.942 [2024-11-26 08:35:47.496281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.496398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.942 [2024-11-26 08:35:47.496422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.942 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.496539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.496676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.496706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.496817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.496913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.496937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.497047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.497270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.497544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.497817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.497942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.498057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.498336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.498565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.498853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.498976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.499102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.499395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.499647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.499872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.499999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.500155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.500432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.500652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.500779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.500912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.501219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.501440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.501663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.501853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.943 [2024-11-26 08:35:47.501975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.502067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.943 [2024-11-26 08:35:47.502096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.943 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.502191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.502435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.502660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.502792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.502918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.503205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.503485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.503766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.503881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.503982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.504222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.504483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.504759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.504887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.504997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.505230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.505441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.505701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.505860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.505961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.506210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.506437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.506680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.506816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.506940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.507212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.507491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.944 [2024-11-26 08:35:47.507784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.944 [2024-11-26 08:35:47.507915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.944 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.508038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.508311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.508563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.508826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.508952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.509051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.509337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.509588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.509821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.509950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.510048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.510291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.510541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.510832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.510986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.511138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.511370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.511630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.511786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.511909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.512133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.512441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.512678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.512814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.512917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.513176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.513393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.513618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.513840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.945 [2024-11-26 08:35:47.513953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.945 qpair failed and we were unable to recover it. 00:28:01.945 [2024-11-26 08:35:47.514084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.514310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.514553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.514809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.514935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.515037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.515256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.515497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.515760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.515876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.515983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.516240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.516491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.516772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.516883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.516989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.517196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.517459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.517718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.517882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.517975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.518236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.518515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.518757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.518908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.519013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.519296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.519521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.946 [2024-11-26 08:35:47.519668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.946 qpair failed and we were unable to recover it. 00:28:01.946 [2024-11-26 08:35:47.519786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.519898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.519922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.520058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.520306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.520563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.520852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.520980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.521107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.521364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.521626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.521890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.521991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.522105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.522328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.522595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.522863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.522989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.523120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.523375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.523611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.523878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.523994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.947 [2024-11-26 08:35:47.524094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.524185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.947 [2024-11-26 08:35:47.524209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.947 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.524336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.524574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.524838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.524980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.525074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.525360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.525644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.525808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.525916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.526145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.526400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.526675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.526856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.526948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.527171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.527419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.527624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.527851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.527966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.528073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.528323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.528633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.528867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.528999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.529124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.529406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.529628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.948 [2024-11-26 08:35:47.529749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.948 qpair failed and we were unable to recover it. 00:28:01.948 [2024-11-26 08:35:47.529882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.530158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.530406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.530646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.530872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.530994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.531101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.531352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.531588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.531838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.531964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.532092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.532353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.532626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.532891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.532985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.533112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.533391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.533631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.533755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.533881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.534128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.534361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.534590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.534751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.534880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.535003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.535027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.949 [2024-11-26 08:35:47.535151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.535272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.949 [2024-11-26 08:35:47.535296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.949 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.535404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.535537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.535561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.535700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.535807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.535831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.535957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.536241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.536496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.536786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.536912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.537038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.537302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.537564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.537794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.537918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.538017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.538323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.538559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.538841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.538966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.539092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.539342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.539580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.539848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.539972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.540083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.540323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.540572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.950 qpair failed and we were unable to recover it. 00:28:01.950 [2024-11-26 08:35:47.540864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.950 [2024-11-26 08:35:47.540987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.541164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.541417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.541632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.541869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.541984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.542114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.542352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.542604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.542853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.542981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.543129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.543363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.543643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.543839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.543963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.544216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.544461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.544738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.544859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.544982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.545193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.545441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.545730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.545880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.951 qpair failed and we were unable to recover it. 00:28:01.951 [2024-11-26 08:35:47.546031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.546160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.951 [2024-11-26 08:35:47.546186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.546312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.546562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.546824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.546955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.547073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.547319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.547594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.547826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.547944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.548102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.548345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.548615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.548779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.548889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.549154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.549389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.549621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.549895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.549992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.550121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.550342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.550568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.550852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.550973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.551076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.551203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.551232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.551328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.551457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.952 [2024-11-26 08:35:47.551483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.952 qpair failed and we were unable to recover it. 00:28:01.952 [2024-11-26 08:35:47.551587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.551739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.551765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.551889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.552147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.552375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.552678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.552801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.552923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.553173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.553423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.553697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.553819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.553934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.554204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.554481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.554807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.554956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.555060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.555283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.555561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.953 qpair failed and we were unable to recover it. 00:28:01.953 [2024-11-26 08:35:47.555793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.953 [2024-11-26 08:35:47.555898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.555923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.556047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.556291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.556555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.556811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.556957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.557067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.557367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.557590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.557851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.557980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.558098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.558374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.558624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.558887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.558983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.559104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.559356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.559592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.559817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.559931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.560064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.560315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.560549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.954 [2024-11-26 08:35:47.560818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.954 [2024-11-26 08:35:47.560939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.954 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.561037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.561288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.561561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.561862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.561979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.562128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.562401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.562675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.562832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.562924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.563158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.563421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.563678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.563800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.563905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.564137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.564421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.564703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.564856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.565011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.565319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.565557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.565832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.565986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.566074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.566199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.566223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.955 qpair failed and we were unable to recover it. 00:28:01.955 [2024-11-26 08:35:47.566346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.566441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.955 [2024-11-26 08:35:47.566466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.566569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.566723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.566749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.566848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.567159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.567410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.567691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.567846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.567956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.568260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.568488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.568744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.568923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.569020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.569299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.569537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.569815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.569943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.570044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.570304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.570585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.570862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.570984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.571109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.571353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.571571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.571820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.571964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.572070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.572159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.956 [2024-11-26 08:35:47.572183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.956 qpair failed and we were unable to recover it. 00:28:01.956 [2024-11-26 08:35:47.572280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.572540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.572818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.572972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.573074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.573333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.573558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.573826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.573956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.574085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.574374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.574607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.574827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.574951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.575101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.575379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.575633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.575786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.575910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.576189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.576428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.576668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.576794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.576887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.577165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.577448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.577706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.577832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.577934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.578059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.957 [2024-11-26 08:35:47.578084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.957 qpair failed and we were unable to recover it. 00:28:01.957 [2024-11-26 08:35:47.578183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.578469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.578727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.578876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.579006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.579227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.579481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.579754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.579871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.579964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.580241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.580462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.580721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.580852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.580980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.581218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.581445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.581668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.581899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.581992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.582152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.582402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.582611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.582870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.582989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.583013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.583110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.583211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.583236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.958 [2024-11-26 08:35:47.583336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.583462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.958 [2024-11-26 08:35:47.583488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.958 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.583584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.583737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.583762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.583889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.584140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.584391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.584674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.584811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.584972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.585201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.585488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.585765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.585918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.586017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.586266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.586500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.586753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.586908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.587006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.587254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.587499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.587786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.587907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.588043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.588177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.588201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.588331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.588422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.588447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.959 qpair failed and we were unable to recover it. 00:28:01.959 [2024-11-26 08:35:47.588543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.959 [2024-11-26 08:35:47.588650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.588675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.588818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.588908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.588932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.589036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.589244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.589491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.589783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.589929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.590019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.590247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.590486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.590732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.590886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.591011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.591249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.591468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.591713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.591833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.591925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.592143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.592372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.592617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.592759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.592910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.593245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.593525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.593765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.593936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.960 qpair failed and we were unable to recover it. 00:28:01.960 [2024-11-26 08:35:47.594061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.960 [2024-11-26 08:35:47.594217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.594341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.594569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.594803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.594934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.595057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.595282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.595556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.595839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.595989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.596092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.596455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.596716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.596850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.596953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.597203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.597468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.597721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.597846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.597952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.598169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.598430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.598672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.598802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.598904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.599161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.599392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.961 qpair failed and we were unable to recover it. 00:28:01.961 [2024-11-26 08:35:47.599762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.961 [2024-11-26 08:35:47.599894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.599920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.600044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.600256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.600503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.600891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.600992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.601149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.601429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.601655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.601813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.601969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.602213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.602604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.602851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.602979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.603142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.603426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.603656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.603795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.603928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.604291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.604547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.604783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.604914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.605027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.605299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.605533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.605788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.605916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.962 qpair failed and we were unable to recover it. 00:28:01.962 [2024-11-26 08:35:47.606024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.962 [2024-11-26 08:35:47.606179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.606206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.606306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.606405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.606436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.606644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.606764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.606791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.606888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.607194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.607452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.607674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.607809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.607935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.608169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.608431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.608673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.608839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.608941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.609233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.609519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.609862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.609995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.610122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.610380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.610696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.610927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.611031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.611285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.611549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.611816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.611946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.612050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.612150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.612176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.963 qpair failed and we were unable to recover it. 00:28:01.963 [2024-11-26 08:35:47.612281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.963 [2024-11-26 08:35:47.612404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.612430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.612561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.612668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.612702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.612807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.612903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.612928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.613060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.613315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.613539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.613813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.613952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.614059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.614313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.614584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.614825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.614974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.615103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.615423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.615701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.615839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.615974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.616266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.616512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.616780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.616906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.617009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.617276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.617532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.617854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.964 [2024-11-26 08:35:47.617975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.964 qpair failed and we were unable to recover it. 00:28:01.964 [2024-11-26 08:35:47.618080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.618339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.618621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.618855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.618988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.619115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.619351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.619602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.619868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.619991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.620140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.620381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.620608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.620841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.620940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.621167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.621385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.621636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.621788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.621921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.622151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.622400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.622658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.622822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.622922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.623024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.965 [2024-11-26 08:35:47.623049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.965 qpair failed and we were unable to recover it. 00:28:01.965 [2024-11-26 08:35:47.623178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.623437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.623676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.623846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.623945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.624229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.624477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.624762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.624889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.624987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.625266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.625575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.625799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.625934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.626029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.626292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.626533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.626834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.626953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.627048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.627281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.627551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.627852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.627979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.628115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.628375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.966 [2024-11-26 08:35:47.628641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.966 [2024-11-26 08:35:47.628785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.966 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.628884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.628989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.629111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.629382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.629598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.629878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.629987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.630122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.630360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.630586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.630768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.630912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.631147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.631451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.631695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.631871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.631967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.632192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.632458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.632740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.632917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.633035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.633321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.633576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.633834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.633986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.634119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.634212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.634237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.634332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.634453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.634478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.967 qpair failed and we were unable to recover it. 00:28:01.967 [2024-11-26 08:35:47.634580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.967 [2024-11-26 08:35:47.634684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.634716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.634820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.634952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.634977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.635071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.635334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.635587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.635826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.635977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.636139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.636360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.636644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.636777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.636904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.637150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.637425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.637651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.637894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.637990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.638108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.638322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.638572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.638884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.638985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.639116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.639342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.639602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.639862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.639983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.968 qpair failed and we were unable to recover it. 00:28:01.968 [2024-11-26 08:35:47.640076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.968 [2024-11-26 08:35:47.640174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.640331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.640590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.640872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.640992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.641091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.641342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.641591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.641819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.641945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.642072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.642311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.642570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.642847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.642981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.643082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.643319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.643561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.643824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.643975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.644099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.644345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.644595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.644854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.644985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.645085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.645213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.645240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.645344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.645476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.645502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.969 qpair failed and we were unable to recover it. 00:28:01.969 [2024-11-26 08:35:47.645611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.969 [2024-11-26 08:35:47.645718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.645744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.645842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.645947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.645972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.646103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.646316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.646562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.646813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.646968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.647078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.647353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.647566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.647752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.647908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.648164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.648414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.648636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.648863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.648993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.649098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.649381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.649612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.649834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.649948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.650056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.650285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.650532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.650785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.650909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.970 [2024-11-26 08:35:47.651011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.651138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.970 [2024-11-26 08:35:47.651163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.970 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.651294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.651518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.651787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.651963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.652098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.652323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.652575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.652829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.652954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.653087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.653327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.653548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.653806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.653934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.654065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.654299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.654615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.654742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.654876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.655142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.655420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.655675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.655902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.655997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.656022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.971 [2024-11-26 08:35:47.656156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.656294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.971 [2024-11-26 08:35:47.656319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.971 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.656418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.656538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.656563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.656695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.656820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.656846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.656941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.657175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.657459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.657712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.657841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.657947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.658232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.658455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.658722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.658884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.658992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.659208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.659418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.659661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.659788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.659921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.660179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.660429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.660638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.660893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.660991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.661118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.661422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.661674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.661825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.661926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.662017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.662043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.662172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.662266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.662292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.972 qpair failed and we were unable to recover it. 00:28:01.972 [2024-11-26 08:35:47.662420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.972 [2024-11-26 08:35:47.662517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.662542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.662632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.662763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.662791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.662892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.663200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.663420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.663675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.663836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.663960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.664206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.664420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.664668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.664828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.664951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.665165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.665388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.665648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.665865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.665992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.666092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.666385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.666602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.666859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.666987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.667085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.667364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.667603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.667868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.667997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.668022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.973 [2024-11-26 08:35:47.668157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.668291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.973 [2024-11-26 08:35:47.668316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.973 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.668418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.668543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.668568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.668666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.668776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.668802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.668905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.669188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.669451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.669703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.669822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.669926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.670159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.670438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.670695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.670830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.670927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.671188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.671463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.671719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.671837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.671941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.672182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.672431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.672674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.672805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.672914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.673170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.673460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.673716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.673866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.674000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.674255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.674521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.974 qpair failed and we were unable to recover it. 00:28:01.974 [2024-11-26 08:35:47.674776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.974 [2024-11-26 08:35:47.674879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.674905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.675044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.675294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.675553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.675843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.675983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.676111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.676367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.676610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.676846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.676970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.677121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.677335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.677549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.677777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.677922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.678036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.678304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.678595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.678822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.678951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.679063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.679352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.679578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.679826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.679949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.680084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.680355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.680635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.680854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.680974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.975 qpair failed and we were unable to recover it. 00:28:01.975 [2024-11-26 08:35:47.681104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.975 [2024-11-26 08:35:47.681198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.681321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.681609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.681879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.681994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.682102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.682378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.682652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.682785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.682874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.683178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.683435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.683697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.683854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.683957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.684203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.684458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.684682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.684811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.684906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.685149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.685433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.685694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.685844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.685952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.686196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.686451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.686655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.686816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.686920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.687227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.687493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.687768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.687949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.688044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.688328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.688580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.688895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.688993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.689150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.689409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.689624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.689880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.689980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.690128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.690347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.690615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.690832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.690986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.691384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.691609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.691763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.691856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.692138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.692357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.692564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.976 qpair failed and we were unable to recover it. 00:28:01.976 [2024-11-26 08:35:47.692851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.976 [2024-11-26 08:35:47.692977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.693076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.693326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.693537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.693799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.693981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.694081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.694300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.694529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.694819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.694940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.695060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.695397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.695680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.695816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.695955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.696166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.696472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.696727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.696873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.696993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.697206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.697455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.697726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.697876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.698002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.698262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.698526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.698767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.698891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.699028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.699279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.699520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.699967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.700090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.700325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.700552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.700826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.700953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.701093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.701384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.701681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.701813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.701919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.702172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.702401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.702627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.702881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.702978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.703102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.703382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.703632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.703763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.703892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.704197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.704484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.704697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.704854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.704952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.705237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.705490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.705786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.705945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.706075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.706290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.706561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.706831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.706948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.977 qpair failed and we were unable to recover it. 00:28:01.977 [2024-11-26 08:35:47.707073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.977 [2024-11-26 08:35:47.707168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.707322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.707556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.707839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.707988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.708113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.708340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.708561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.708823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.708980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.709105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.709393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.709623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.709781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.709905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.710196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.710450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.710691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.710819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.710976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.711207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.711460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.711714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.711834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.711965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.712254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.712531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.712781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.712937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.713062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.713316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.713562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.713800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.713947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.714069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.714353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.714597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.714859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.714979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.715113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.715324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.715628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.715887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.715979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.716130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.716377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.716624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.716883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.716986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.717147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.717400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.717710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.717833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.717931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.718185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.718439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.718696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.718854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.718958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.719169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.719415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.719706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.978 [2024-11-26 08:35:47.719866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.978 qpair failed and we were unable to recover it. 00:28:01.978 [2024-11-26 08:35:47.719972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.720261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.720480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.720767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.720894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.720994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.721270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.721529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.721824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.721944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.722068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.722311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.722543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.722837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.722965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.723068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.723295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.723549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.723868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.723991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.724118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.724344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.724594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.724777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.724902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.725163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.725436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.725653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.725785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.725898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.726200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.726423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.726692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.726813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.726949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.727201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.727460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.727724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.727849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.727954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.728269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.728575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.728731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.728866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.729148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.729425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.729707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.729835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.729936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.730157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.730451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.730733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.730856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.730953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.731203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.731495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.731773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.731892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.731992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.732237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.732511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.732764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.732921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.733049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.733299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.733580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.733814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.733941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.979 qpair failed and we were unable to recover it. 00:28:01.979 [2024-11-26 08:35:47.734056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.734165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.979 [2024-11-26 08:35:47.734190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.734288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.734543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.734804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.734927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.735025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.735297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.735578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.735850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.735985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.736112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.736336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.736591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.736829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.736956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.737078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.737294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.737508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.737792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.737918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.738053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.738299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.738522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.738795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.738964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.739091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.739344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.739562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.739861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.739989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.740121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.740381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.740631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.740753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.740879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.741171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.741402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.741651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.741776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.741886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.742155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.742437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.742692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.742813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.742942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.743198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.743472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.743752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.743887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.744002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.744281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.744568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.744858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.744986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.745108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.745395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.745672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.745828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.745966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.746196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.746478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.746736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.746888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.747018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.747298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.747553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.747859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.747985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.980 [2024-11-26 08:35:47.748092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.748192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.980 [2024-11-26 08:35:47.748217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.980 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.748368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.748457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.748483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.748596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.748722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.748748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.748881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.748982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.749138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.749419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.749682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.749811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.749907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.750167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.750388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.750695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.750853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.751012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.751261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.751490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.751783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.751939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.752043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.752270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.752544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.752799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.752949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.753080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.753333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.753566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.753826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.753988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.754103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.754367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.754633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.754763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.754865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.755148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.755407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.755640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.755857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.755980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.756084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.756299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.756587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.756775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.756907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.757159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.981 [2024-11-26 08:35:47.757409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.981 [2024-11-26 08:35:47.757558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.981 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.757665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.757772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.757798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.982 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.757904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.982 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.758173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.982 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.758396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.982 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.758644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.982 [2024-11-26 08:35:47.758806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:01.982 qpair failed and we were unable to recover it. 00:28:01.982 [2024-11-26 08:35:47.758912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.759173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.759422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.759674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.759803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.759955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.760194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.760478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.760707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.760874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.760977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.761242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.761493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.761823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.761947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.762098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.762375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.762604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.267 qpair failed and we were unable to recover it. 00:28:02.267 [2024-11-26 08:35:47.762886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.762975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.267 [2024-11-26 08:35:47.763000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.763129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.763382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.763592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.763842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.763997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.764106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.764388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.764617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.764873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.764997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.765342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.765582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.765817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.765940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.766036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.766265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.766548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.766778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.766907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.767008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.767248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.767501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.767785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.767908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.768009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.768291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.768504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.768757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.768880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.769001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.769279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.769527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.769760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.769880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.268 qpair failed and we were unable to recover it. 00:28:02.268 [2024-11-26 08:35:47.770006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.268 [2024-11-26 08:35:47.770099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.770218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.770494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.770714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.770858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.770953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.771245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.771524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.771766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.771920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.772017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.772239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.772496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.772759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.772910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.773002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.773284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.773549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.773792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.773919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.774030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.774274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.774514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.774780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.774909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.775006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.775232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.775452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.775671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.775806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.775911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.776129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.776387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.776611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.776762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.776898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.777052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.777077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.269 qpair failed and we were unable to recover it. 00:28:02.269 [2024-11-26 08:35:47.777176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.269 [2024-11-26 08:35:47.777298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.777323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.777414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.777511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.777537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.777641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.777746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.777772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.777904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.778148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.778359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.778612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.778873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.778997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.779122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.779361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.779653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.779815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.779937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.780226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.780480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.780726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.780852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.780960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.781240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.781540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.781833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.781954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.782059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.782347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.782609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.782847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.782969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.783073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.783292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.783546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.783779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.783925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.784028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.784134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.784158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.270 qpair failed and we were unable to recover it. 00:28:02.270 [2024-11-26 08:35:47.784280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.784405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.270 [2024-11-26 08:35:47.784429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.784535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.784628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.784657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.784777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.784885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.784910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.785044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.785286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.785569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.785806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.785950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.786082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.786340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.786584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.786840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.786965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.787092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.787332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.787589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.787817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.787944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.788043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.788290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.788539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.788823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.788951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.789078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.789316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.789627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.789890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.789989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.790109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.790329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.790584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.790809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.790928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.791025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.791149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.271 [2024-11-26 08:35:47.791173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.271 qpair failed and we were unable to recover it. 00:28:02.271 [2024-11-26 08:35:47.791267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.791545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.791778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.791907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.792018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.792297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.792523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.792778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.792900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.793036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.793245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.793502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.793777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.793901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.793996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.794219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.794503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.794789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.794923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.795019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.795329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.795555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.795806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.795935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.796059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.796284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.796525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.796799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.796953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.797056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.797334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.272 [2024-11-26 08:35:47.797647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.272 [2024-11-26 08:35:47.797782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.272 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.797909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.797998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.798182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.798428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.798640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.798768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.798875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.799130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.799334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.799586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.799835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.799980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.800086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.800328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.800539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.800832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.800958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.801083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.801359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.801609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.801861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.801987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.802089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.802364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.802644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.802779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.802910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.803164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.803413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.803677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.803853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.803954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.804208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.804482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.273 qpair failed and we were unable to recover it. 00:28:02.273 [2024-11-26 08:35:47.804754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.273 [2024-11-26 08:35:47.804847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.804871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.804973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.805222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.805506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.805719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.805847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.805945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.806205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.806477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.806743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.806869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.806967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.807227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.807457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.807671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.807907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.807999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.808123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.808376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.808626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.808866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.808988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.809109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.809326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.809590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.809825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.809941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.810044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.810333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.810647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.810778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.810878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.811124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.811420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.811695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.811813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.274 qpair failed and we were unable to recover it. 00:28:02.274 [2024-11-26 08:35:47.811937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.274 [2024-11-26 08:35:47.812035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.812156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.812402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.812656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.812800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.812905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.813153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.813442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.813694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.813822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.813922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.814153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.814387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.814636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.814885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.814982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.815132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.815356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.815622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.815855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.815968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.816070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.816324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.816575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.816803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.816953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.817076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.817278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.817513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.817787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.817934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.818063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.818291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.818535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.818795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.275 [2024-11-26 08:35:47.818915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.275 qpair failed and we were unable to recover it. 00:28:02.275 [2024-11-26 08:35:47.819070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.819287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.819542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.819800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.819935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.820061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.820311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.820530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.820791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.820930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.821036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.821286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.821545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.821784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.821910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.822034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.822271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.822542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.822803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.822958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.823064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.823305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.823599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.823843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.823965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.824067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.824306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.824550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.824787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.824940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.825064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.825152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.825176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.276 qpair failed and we were unable to recover it. 00:28:02.276 [2024-11-26 08:35:47.825314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.276 [2024-11-26 08:35:47.825418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.825443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.825546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.825652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.825678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.825794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.825919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.825944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.826047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.826270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.826527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.826810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.826963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.827065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.827288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.827546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.827784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.827919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.828046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.828346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.828623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.828775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.828882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.829134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.829421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.829669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.829792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.829887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.830150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.830398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.830625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.830772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.830899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.831123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.831434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.831647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.831871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.831981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.832097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.832361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.277 qpair failed and we were unable to recover it. 00:28:02.277 [2024-11-26 08:35:47.832617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.277 [2024-11-26 08:35:47.832749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.832775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.832903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.832995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.833115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.833392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.833605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.833862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.833986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.834113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.834338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.834649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.834801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.834909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.835163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.835416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.835640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.835801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.835942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.836235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.836513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.836799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.836950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.837047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.837312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.837570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.837791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.837940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.838072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.838329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.838584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.838824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.838944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.839035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.839286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.839539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.839791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.278 [2024-11-26 08:35:47.839919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.278 qpair failed and we were unable to recover it. 00:28:02.278 [2024-11-26 08:35:47.840020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.840234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.840495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.840736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.840861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.840965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.841266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.841512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.841766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.841920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.842074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.842327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.842549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.842808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.842937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.843036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.843250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.843552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.843788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.843942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.844071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.844354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.844656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.844783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.844876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.845169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.845416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.845667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.845824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.845936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.846216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.846482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.846721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.846864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.846995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.847089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.847114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.847204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.847337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.279 [2024-11-26 08:35:47.847362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.279 qpair failed and we were unable to recover it. 00:28:02.279 [2024-11-26 08:35:47.847464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.847593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.847619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.847736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.847837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.847862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.847988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.848208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.848462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.848719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.848846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.848954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.849255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.849566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.849811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.849924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.850083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.850317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.850576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.850804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.850962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.851092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.851359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.851574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.851811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.851960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.852084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.852333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.852598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.852884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.852993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.853125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.853368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.853619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.853746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.853878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.854129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.854375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.854634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.280 [2024-11-26 08:35:47.854762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.280 qpair failed and we were unable to recover it. 00:28:02.280 [2024-11-26 08:35:47.854891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.854999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.855133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.855381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.855660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.855806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.855906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.856115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.856393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.856603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.856863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.856985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.857109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.857353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.857639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.857788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.857917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.858163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.858390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.858638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.858785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.858906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.859155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.859387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.859602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.859885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.859984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.860008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.281 [2024-11-26 08:35:47.860108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.860199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.281 [2024-11-26 08:35:47.860223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.281 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.860317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.860546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.860796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.860930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.861033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.861278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.861517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.861743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.861868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.861975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.862228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.862513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.862755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.862909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.863014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.863258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.863487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.863728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.863877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.863971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.864217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.864464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.864691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.864822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.864950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.865194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.865411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.865629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.865783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.865889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.866156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.866402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.866676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.866823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.866953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.867078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.867102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.282 qpair failed and we were unable to recover it. 00:28:02.282 [2024-11-26 08:35:47.867197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.282 [2024-11-26 08:35:47.867352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.867377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.867501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.867597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.867622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.867714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.867843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.867869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.867973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.868202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.868418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.868664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.868818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.868914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.869203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.869486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.869923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.870016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.870302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.870530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.870783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.870910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.871044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.871296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.871541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.871773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.871922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.872055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.872277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.872507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.872800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.872949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.873105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.873359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.873605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.873761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.873873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.874131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.874346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.283 qpair failed and we were unable to recover it. 00:28:02.283 [2024-11-26 08:35:47.874603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.283 [2024-11-26 08:35:47.874727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.874753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.874856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.874979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.875139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.875412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.875659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.875819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.875951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.876192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.876507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.876753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.876870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.877002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.877255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.877481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.877781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.877907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.878004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.878289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.878536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.878814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.878971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.879102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.879354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.879612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.879757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.879912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.880175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.880421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.880663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.880814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.880912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.881168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.881398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.881614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.881798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.881892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.882021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.882045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.284 qpair failed and we were unable to recover it. 00:28:02.284 [2024-11-26 08:35:47.882178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.284 [2024-11-26 08:35:47.882300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.882325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.882444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.882532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.882557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.882668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.882766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.882792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.882921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.883132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.883348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.883565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.883855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.883975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.884129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.884381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.884601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.884743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.884866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.885143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.885396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.885635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.885788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.885883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.886153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.886419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.886665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.886794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.886958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.887203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.887442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.887682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.887847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.887936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.888215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.888456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.285 [2024-11-26 08:35:47.888633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.285 qpair failed and we were unable to recover it. 00:28:02.285 [2024-11-26 08:35:47.888758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.888852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.888878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.888968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.889250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.889464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.889744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.889860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.889987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.890210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.890472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.890708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.890825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.890925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.891178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.891433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.891717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.891839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.891966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.892214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.892435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.892691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.892823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.892954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.893212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.893430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.893709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.893840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.893934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.894218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.894471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.894752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.894907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.895043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.895251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.895501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.286 qpair failed and we were unable to recover it. 00:28:02.286 [2024-11-26 08:35:47.895718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.286 [2024-11-26 08:35:47.895841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.895867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.895962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.896205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.896470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.896722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.896868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.896997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.897244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.897522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.897802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.897959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.898117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.898363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.898643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.898765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.898877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.899137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.899408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.899632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.899847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.899997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.900096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.900356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.900643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.900796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.900953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.901228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.901508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.901758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.901934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.902040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.902272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.902523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.902780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.902927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.287 [2024-11-26 08:35:47.903026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.903146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.287 [2024-11-26 08:35:47.903172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.287 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.903269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.903499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.903761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.903919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.904015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.904239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.904486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.904739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.904871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.904980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.905237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.905462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.905723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.905847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.905944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.906190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.906410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.906655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.906899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.906995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.907125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.907344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.907589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.907879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.907993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.908095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.908357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.908584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.908803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.908935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.909063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.909310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.909561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.909789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.909922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.288 [2024-11-26 08:35:47.910020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.910121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.288 [2024-11-26 08:35:47.910146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.288 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.910244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.910491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.910749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.910895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.910991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.911240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.911488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.911759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.911906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.912030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.912323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.912569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.912811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.912964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.913066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.913299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.913568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.913798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.913912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.914005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.914256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.914482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.914717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.914832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.914935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.915236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.915480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.915761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.915888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.916019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.916298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.916576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.916833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.916950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.917047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.917137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.917163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.289 qpair failed and we were unable to recover it. 00:28:02.289 [2024-11-26 08:35:47.917288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.917387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.289 [2024-11-26 08:35:47.917412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.917537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.917640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.917666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.917767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.917893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.917917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.918020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.918233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.918488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.918761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.918881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.918971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.919241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.919480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.919730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.919858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.919958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.920236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.920487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.920733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.920865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.921001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.921253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.921501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.921728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.921883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.922008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.922220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.922517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.922766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.922924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.923019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.923258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.923505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.290 [2024-11-26 08:35:47.923671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.290 qpair failed and we were unable to recover it. 00:28:02.290 [2024-11-26 08:35:47.923803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.923933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.923958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.924084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.924372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.924610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.924873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.924997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.925131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.925342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.925682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.925810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.925935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.926155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.926404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.926678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.926808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.926910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.927195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.927470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.927730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.927845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.927953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.928235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.928523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.928834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.928985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.929115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.929341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.929614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.929770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.929877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.930134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.930382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.930669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.930790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.930885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.931009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.931033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.291 [2024-11-26 08:35:47.931133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.931233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.291 [2024-11-26 08:35:47.931257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.291 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.931388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.931614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.931824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.931972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.932075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.932292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.932560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.932792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.932937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.933032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.933271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.933515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.933743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.933889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.934018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.934276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.934570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.934826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.934960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.935055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.935313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.935526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.935788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.935918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.936027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.936292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.936515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.936742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.936874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.936981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.937225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.937493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.292 [2024-11-26 08:35:47.937723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.292 [2024-11-26 08:35:47.937874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.292 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.937996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.938281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.938534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.938793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.938948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.939041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.939284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.939551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.939780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.939929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.940051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.940294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.940543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.940780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.940904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.941017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.941259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.941506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.941797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.941935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.942056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.942333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.942580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.942839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.942958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.943061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.943328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.943559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.293 [2024-11-26 08:35:47.943709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.293 qpair failed and we were unable to recover it. 00:28:02.293 [2024-11-26 08:35:47.943807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.943904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.943929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.944036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.944268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.944498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.944744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.944895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.944997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.945207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.945452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.945697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.945826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.945935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.946231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.946480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.946736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.946853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.946942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.947172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.947423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.947669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.947902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.947996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.948146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.948416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.948666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.948789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.948886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.949132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.949411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.949701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.949825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.949921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.950140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.950369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.294 qpair failed and we were unable to recover it. 00:28:02.294 [2024-11-26 08:35:47.950655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.294 [2024-11-26 08:35:47.950814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.950915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.951172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.951387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.951609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.951758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.951866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.952154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.952407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.952626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.952781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.952875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.953143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.953406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.953656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.953815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.953911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.954183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.954406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.954723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.954851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.954978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.955105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.295 [2024-11-26 08:35:47.955129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.295 qpair failed and we were unable to recover it. 00:28:02.295 [2024-11-26 08:35:47.955256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.955481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.955713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.955834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.955928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.956165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.956401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.956644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.956801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.956940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.957175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.957460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.957684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.957815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.957914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.958157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.958423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.958701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.958821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.958935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.959189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.959458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.959796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.959942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.960034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.960315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.960569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.960809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.960960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.961087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.961337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.961552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.961832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.961964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.962062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.962155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.962183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.296 qpair failed and we were unable to recover it. 00:28:02.296 [2024-11-26 08:35:47.962277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.962409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.296 [2024-11-26 08:35:47.962433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.962591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.962701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.962728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.962833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.962958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.962982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.963082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.963368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.963584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.963826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.963973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.964063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.964343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.964592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.964842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.964993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.965119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.965340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.965555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.965877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.965998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.966127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.966366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.966614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.966739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.966871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.967126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.967368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.967581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.967859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.967974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.297 qpair failed and we were unable to recover it. 00:28:02.297 [2024-11-26 08:35:47.968072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.297 [2024-11-26 08:35:47.968196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.968332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.968602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.968848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.968976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.969089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.969336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.969587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.969841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.969963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.970118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.970403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.970652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.970779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.970918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.971170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.971389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.971619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.971800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.971907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.972168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.972372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.972621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.972801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.972916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.973175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.973456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.973698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.973819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.973942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.974180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.974432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.298 [2024-11-26 08:35:47.974681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.298 [2024-11-26 08:35:47.974832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.298 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.974922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.975156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.975398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.975673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.975809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.975938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.976187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.976428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.976662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.976849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.976948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.977188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.977445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.977727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.977845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.977952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.978200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.978442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.978746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.978879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.978979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.979224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.979432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.979682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.979811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.979915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.980170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.980409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.980638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.980791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.980888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.981023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.981048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.299 qpair failed and we were unable to recover it. 00:28:02.299 [2024-11-26 08:35:47.981157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.299 [2024-11-26 08:35:47.981256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.981280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.981429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.981532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.981557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.981654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.981785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.981810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.981907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.982134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.982341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.982672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.982832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.982960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.983237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.983454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.983678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.983864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.983993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.984248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.984497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.984756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.984899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.985030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.985285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.985539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.985849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.985975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.986071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.986223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.986247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.300 qpair failed and we were unable to recover it. 00:28:02.300 [2024-11-26 08:35:47.986351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.300 [2024-11-26 08:35:47.986457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.986482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.986602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.986703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.986728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.986854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.986982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.987138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.987363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.987698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.987816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.987918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.988204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.988457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.988729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.988875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.988974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.989191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.989428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.989709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.989830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.989923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.990220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.990447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.990717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.990839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.990960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.991204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.991443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.991664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.991794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.991897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.992190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.992440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.992712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.992835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.992961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.993078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.993103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.993202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.993322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.993347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.301 qpair failed and we were unable to recover it. 00:28:02.301 [2024-11-26 08:35:47.993456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.301 [2024-11-26 08:35:47.993578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.993602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.993731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.993855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.993880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.994010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.994265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.994481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.994705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.994856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.994967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.995216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.995466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.995697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.995825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.995925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.996171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.996387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.996705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.996854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.996980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.997209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.997442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.997691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.997838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.997966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.998177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.998414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.998684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.998813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.998912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.999244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.999491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:47.999776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:47.999895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:48.000020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:48.000278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.302 [2024-11-26 08:35:48.000549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.302 [2024-11-26 08:35:48.000723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.302 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.000833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.000935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.000964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.001090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.001335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.001575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.001809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.001926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.002052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.002330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.002606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.002734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.002894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.003138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.003429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.003641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.003803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.003896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.004140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.004426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.004669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.004829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.004935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.005210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.005488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.005742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.005863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.005959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.006208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.006459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.006733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.006884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.006974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.007233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.007520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.007767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.007896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.303 [2024-11-26 08:35:48.008021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.008119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.303 [2024-11-26 08:35:48.008143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.303 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.008294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.008520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.008778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.008906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.009043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.009320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.009561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.009830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.009958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.010088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.010303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.010560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.010820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.010948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.011073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.011288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.011568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.011821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.011934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.012031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.012294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.012499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.012814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.012962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.013089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.013307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.013588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.013826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.013982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.014083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.014295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.014526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.014810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.014988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.015085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.015178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.015202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.304 qpair failed and we were unable to recover it. 00:28:02.304 [2024-11-26 08:35:48.015300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.015406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.304 [2024-11-26 08:35:48.015431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.015555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.015656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.015680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.015787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.015881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.015906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.016001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.016235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.016487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.016763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.016910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.017011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.017286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.017573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.017843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.017978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.018104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.018333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.018567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.018845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.018987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.019079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.019322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.019581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.019812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.019925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.020030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.020266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.020494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.020764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.020911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.021005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.021131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.021155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.021261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.021356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.021380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.305 qpair failed and we were unable to recover it. 00:28:02.305 [2024-11-26 08:35:48.021506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.305 [2024-11-26 08:35:48.021635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.021659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.021770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.021856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.021880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.021991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.022204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.022420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.022657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.022830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.022959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.023180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.023417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.023698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.023816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.023908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.024190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.024416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.024672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.024816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.024942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.025159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.025391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.025617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.025857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.025970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.026075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.026347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.026588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.026865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.026992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.027112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.027362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.027608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.027858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.027990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.028080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.028168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.028192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.028296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.028415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.028440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.306 qpair failed and we were unable to recover it. 00:28:02.306 [2024-11-26 08:35:48.028539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.306 [2024-11-26 08:35:48.028663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.028692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.028793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.028885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.028910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.029040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.029288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.029532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.029786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.029937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.030035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.030289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.030511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.030773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.030890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.031013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.031260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.031539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.031804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.031953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.032082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.032332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.032576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.032859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.032977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.033104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.033327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.033575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.033841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.033959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.034113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.034334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.034580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.034841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.034969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.035097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.035349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.035573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.307 qpair failed and we were unable to recover it. 00:28:02.307 [2024-11-26 08:35:48.035858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.307 [2024-11-26 08:35:48.035948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.035973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.036072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.036305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.036552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.036857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.036980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.037087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.037344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.037589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.037846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.037998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.038132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.038376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.038624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.038868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.038988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.039121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.039365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.039648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.039783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.039914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.040146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.040389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.040638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.040899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.040993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.041168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.041452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.041666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.041825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.041940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.042191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.042448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.042707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.042854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.042980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.043069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.308 [2024-11-26 08:35:48.043093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.308 qpair failed and we were unable to recover it. 00:28:02.308 [2024-11-26 08:35:48.043199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.043443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.043697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.043831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.043958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.044205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.044418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.044713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.044827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.044928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.045212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.045459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.045715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.045864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.045960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.046207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.046457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.046715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.046867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.046961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.047176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.047396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.047617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.047847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.047995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.048116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.048378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.048602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.048826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.048955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.049054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.049298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.049550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.049836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.049952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.050078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.050180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.050205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.309 qpair failed and we were unable to recover it. 00:28:02.309 [2024-11-26 08:35:48.050338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.309 [2024-11-26 08:35:48.050437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.050462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.050565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.050691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.050717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.050850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.050948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.050973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.051064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.051319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.051619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.051739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.051864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.052164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.052413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.052653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.052812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.052934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.053175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.053427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.053682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.053829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.053925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.054203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.054473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.054732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.054859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.054982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.055200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.055422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.055656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.055792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.055888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.056169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.056428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.056661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.056817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.056942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.057220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.057442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.057756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.057873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.310 qpair failed and we were unable to recover it. 00:28:02.310 [2024-11-26 08:35:48.057970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.310 [2024-11-26 08:35:48.058099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.058255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.058514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.058803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.058925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.059020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.059291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.059590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.059817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.059978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.060077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.060353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.060596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.060859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.060983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.061079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.061326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.061550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.061803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.061953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.062052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.062302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.062552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.062813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.062943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.063040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.063313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.063602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.063829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.063994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.064105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.064364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.064579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.064837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.064991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.065127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.065383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.065628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.311 qpair failed and we were unable to recover it. 00:28:02.311 [2024-11-26 08:35:48.065863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.311 [2024-11-26 08:35:48.065992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.066169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.066433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.066662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.066811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.066902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.067152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.067428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.067654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.067821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.067927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.068205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.068482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.068720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.068849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.068937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.069193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.069528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.069745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.069893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.069980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.070270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.070520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.070776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.070901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.071000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.071218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.071479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.071732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.071883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.072015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.072263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.072553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.072777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.072905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.073038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.073277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.073489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.073775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.073932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.074030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.074128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.074153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.312 qpair failed and we were unable to recover it. 00:28:02.312 [2024-11-26 08:35:48.074285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.312 [2024-11-26 08:35:48.074375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.074400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.074530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.074632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.074657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.074769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.074890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.074915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.075008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.075259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.075496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.075760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.075883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.075991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.076245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.076460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.076719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.076873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.076977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.077235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.077489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.077835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.077960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.078073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.078319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.078549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.078833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.078963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.079085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.079334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.079563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.079827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.079950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.080050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.080295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.080571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.080838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.080959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.081061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.081322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.081562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.081787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.081912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.082015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.082282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.082498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.313 [2024-11-26 08:35:48.082627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.313 qpair failed and we were unable to recover it. 00:28:02.313 [2024-11-26 08:35:48.082750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.082858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.082882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.082989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.083244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.083465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.083723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.083840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.083948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.084239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.084501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.084720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.084879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.084978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.085200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.085500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.085740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.085896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.085995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.086248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.086477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.086752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.086900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.086999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.087277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.087523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.087856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.087982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.314 qpair failed and we were unable to recover it. 00:28:02.314 [2024-11-26 08:35:48.088112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.314 [2024-11-26 08:35:48.088213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.088237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.088365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.088457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.088483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.088614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.088739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.088765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.088886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.089192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.089452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.089712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.089870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.090029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.090261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.090620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.090898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.090995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.091120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.091353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.091576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.091830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.091979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.092076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.092299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.092558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.092842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.092974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.093112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.093388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.093662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.093797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.093894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.094144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.094403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.094650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.094836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.094941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.095063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.095089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.095208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.095333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.095358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.315 qpair failed and we were unable to recover it. 00:28:02.315 [2024-11-26 08:35:48.095451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.315 [2024-11-26 08:35:48.095581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.316 [2024-11-26 08:35:48.095606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.316 qpair failed and we were unable to recover it. 00:28:02.316 [2024-11-26 08:35:48.095722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.316 [2024-11-26 08:35:48.095831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.316 [2024-11-26 08:35:48.095857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.316 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.096081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.096364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.096597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.096749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.096875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.097122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.097395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.097608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.097871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.097986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.098089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.098336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.098672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.098827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.098934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.099194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.099454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.099670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.099802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.589 qpair failed and we were unable to recover it. 00:28:02.589 [2024-11-26 08:35:48.099932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.100058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.589 [2024-11-26 08:35:48.100083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.100180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.100397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.100645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.100802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.100934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.101154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.101368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.101656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.101878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.101996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.102129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.102383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.102625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.102747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.102899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.103167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.103388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.103637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.103768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.103879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.104132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.104387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.104615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.104872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.104994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.105118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.105342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.105642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.105860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.105991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.106109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.106386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.106669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.106813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.106943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.107071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.107097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.590 qpair failed and we were unable to recover it. 00:28:02.590 [2024-11-26 08:35:48.107199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.590 [2024-11-26 08:35:48.107362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.107386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.107488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.107598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.107622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.107730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.107823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.107849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.107981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.108230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.108497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.108724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.108881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.109003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.109248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.109474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.109695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.109816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.109937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.110242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.110493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.110765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.110919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.111037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.111293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.111562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.111824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.111944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.112059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.112336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.112577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.112858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.112981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.113106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.113363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.113608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.113767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.113863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.114052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.114078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.114181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.114315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.114340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.591 qpair failed and we were unable to recover it. 00:28:02.591 [2024-11-26 08:35:48.114429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.591 [2024-11-26 08:35:48.114551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.114576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.114681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.114812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.114836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.114938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.115167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.115401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.115709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.115841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.115972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.116225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.116479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.116739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.116913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.117019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.117293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.117550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.117773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.117898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.118010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.118223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.118504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.118732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.118855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.118950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.119189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.119405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.119658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.119854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.119979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.120251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.120533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.120772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.120922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.121061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.121282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.121533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.592 [2024-11-26 08:35:48.121653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.592 qpair failed and we were unable to recover it. 00:28:02.592 [2024-11-26 08:35:48.121763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.121915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.121940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.122066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.122313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.122547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.122792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.122917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.123069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.123290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.123511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.123783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.123904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.124002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.124274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.124521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.124738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.124868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.124967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.125232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.125486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.125741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.125861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.125964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.126204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.126420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.126659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.126828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.126918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.127133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.127413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.127634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.127885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.127975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.128001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.128114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.128239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.128263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.593 qpair failed and we were unable to recover it. 00:28:02.593 [2024-11-26 08:35:48.128420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.128520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.593 [2024-11-26 08:35:48.128545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.128665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.128759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.128785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.128882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.128973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.128997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.129090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.129338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.129595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.129870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.129977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.130123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.130409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.130629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.130757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.130879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.131161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.131418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.131653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.131815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.131919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.132141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.132385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.132637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.132864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.132989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.133140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.133355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.133608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.133790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.133894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.134172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.134390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.594 qpair failed and we were unable to recover it. 00:28:02.594 [2024-11-26 08:35:48.134639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.594 [2024-11-26 08:35:48.134731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.134757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.134858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.134953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.134977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.135076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.135378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.135622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.135800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.135920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.136169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.136376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.136602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.136835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.136989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.137090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.137392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.137623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.137845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.137969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.138067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.138314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.138525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.138827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.138979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.139100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.139342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.139591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.139828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.139984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.140084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.140345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.140602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.140859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.140982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.141103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.141204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.141229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.595 qpair failed and we were unable to recover it. 00:28:02.595 [2024-11-26 08:35:48.141327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.595 [2024-11-26 08:35:48.141460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.141484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.141577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.141670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.141702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.141807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.141931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.141956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.142059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.142327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.142637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.142855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.142985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.143135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.143381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.143640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.143791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.143934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.144175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.144459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.144695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.144849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.144989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.145263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.145493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.145725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.145872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.145970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.146244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.146470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.146732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.146892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.146987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.147207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.147421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.147639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.147765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.147896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.148016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.148040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.148163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.148296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.596 [2024-11-26 08:35:48.148321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.596 qpair failed and we were unable to recover it. 00:28:02.596 [2024-11-26 08:35:48.148412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.148512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.148535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.148661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.148784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.148809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.148910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.149151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.149381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.149635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.149865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.149985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.150109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.150410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.150682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.150866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.150963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.151216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.151472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.151717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.151863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.151972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.152185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.152481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.152721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.152837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.152939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.153197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.153472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.153699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.153817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.153973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.154203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.154461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.154712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.154860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.154954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.155061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.155085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.155180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.155280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.597 [2024-11-26 08:35:48.155305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.597 qpair failed and we were unable to recover it. 00:28:02.597 [2024-11-26 08:35:48.155429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.155524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.155553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.155645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.155752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.155778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.155878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.155973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.156131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.156386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.156599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.156818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.156979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.157086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.157306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.157546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.157805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.157963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.158066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.158321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.158557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.158837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.158951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.159073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.159406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.159651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.159901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.159997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.160146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.160375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.160651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.160770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.160874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.161002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.161027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.598 [2024-11-26 08:35:48.161129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.161253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.598 [2024-11-26 08:35:48.161277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.598 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.161377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.161462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.161486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.161622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.161728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.161753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.161854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.161978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.162108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.162354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.162635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.162757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.162913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.163133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.163382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.163610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.163843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.163965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.164086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.164336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.164555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.164777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.164904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.165005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.165228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.165482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.165733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.165854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.165957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.166210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.166439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.166667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.166809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.166938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.167194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.167446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.167827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.167950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.168054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.168083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.599 qpair failed and we were unable to recover it. 00:28:02.599 [2024-11-26 08:35:48.168188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.599 [2024-11-26 08:35:48.168316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.168342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.168466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.168597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.168622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.168716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.168815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.168841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.168970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.169215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.169490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.169738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.169856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.169984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.170207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.170453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.170703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.170826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.170931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.171167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.171471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.171744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.171896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.172025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.172285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.172517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.172744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.172870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.172996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.173230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.173461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.173713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.173862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.173991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.174239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.174489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.174773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.174900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.175023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.175152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.175177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.175317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.175446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.175473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.600 qpair failed and we were unable to recover it. 00:28:02.600 [2024-11-26 08:35:48.175575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.600 [2024-11-26 08:35:48.175699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.175725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.175836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.175940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.175965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.176057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.176304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.176540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.176777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.176894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.177016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.177257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.177540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.177830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.177978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.178088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.178297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.178552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.178796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.178930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.179064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.179288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.179536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.179792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.179948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.180041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.180291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.180535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.180797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.180957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.181093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.181305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.181587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.181824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.181971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.182112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.182202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.182227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.601 qpair failed and we were unable to recover it. 00:28:02.601 [2024-11-26 08:35:48.182319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.601 [2024-11-26 08:35:48.182424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.182449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.182551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.182648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.182674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.182814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.183174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.183391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.183679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.183810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.184016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.184259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.184511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.184761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.184918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.185022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.185334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.185589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.185754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.185882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.186134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.186383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.186603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.186891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.186981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.187100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.187452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.187704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.187827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.602 qpair failed and we were unable to recover it. 00:28:02.602 [2024-11-26 08:35:48.187929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.188021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.602 [2024-11-26 08:35:48.188045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.188172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.188425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.188706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.188824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.188922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.189189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.189441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.189665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.189822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.189963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.190214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.190426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.190752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.190883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.190982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.191263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.191485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.191761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.191884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.191989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.192239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.192551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.192828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.192960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.193082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.193342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.193652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.193899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.193990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.194015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.603 qpair failed and we were unable to recover it. 00:28:02.603 [2024-11-26 08:35:48.194108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.603 [2024-11-26 08:35:48.194205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.194329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.194609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.194854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.194977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.195099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.195339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.195581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.195835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.195969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.196067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.196293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.196515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.196783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.196929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.197028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.197275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.197530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.197748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.197877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.197970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.198201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.198455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.198724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.198847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.198970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.199218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.199465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.199750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.199875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.199982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.200111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.604 [2024-11-26 08:35:48.200136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.604 qpair failed and we were unable to recover it. 00:28:02.604 [2024-11-26 08:35:48.200232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.200520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.200754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.200880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.200995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.201254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.201504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.201768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.201898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.202001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.202242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.202469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.202786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.202916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.203007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.203256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.203487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.203729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.203881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.203974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.204181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9e4600 (9): Bad file descriptor 00:28:02.605 [2024-11-26 08:35:48.204323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.204573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.204777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.204975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.205485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.205511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.205676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.206332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.206608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 [2024-11-26 08:35:48.206875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.206992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 08:35:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:02.605 [2024-11-26 08:35:48.207126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 08:35:48 -- common/autotest_common.sh@862 -- # return 0 00:28:02.605 [2024-11-26 08:35:48.207263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.207289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.605 qpair failed and we were unable to recover it. 00:28:02.605 08:35:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:02.605 [2024-11-26 08:35:48.207397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 08:35:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:02.605 [2024-11-26 08:35:48.207500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.605 [2024-11-26 08:35:48.207526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.606 [2024-11-26 08:35:48.207657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.207773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.207804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.207912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.208133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.208412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.208636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.208771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.208875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.209157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.209465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.209732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.209855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.209983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.210219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.210503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.210743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.210896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.210992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.211238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.211508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e8000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.211756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.211909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.212066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.212378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.212604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.212873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.212991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.213155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.213439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.213669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.606 [2024-11-26 08:35:48.213801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.606 qpair failed and we were unable to recover it. 00:28:02.606 [2024-11-26 08:35:48.213904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.214153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.214395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.214672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.214839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.214946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.215213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.215453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.215850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.215955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.216277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.216536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.216768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.216892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.216991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.217214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.217530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.217755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.217871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.218014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.218273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.218522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.218774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.218899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.219028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.219293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.219539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.607 [2024-11-26 08:35:48.219826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.607 [2024-11-26 08:35:48.219954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.607 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.220059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.220357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.220582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.220839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.220966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.221063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.221363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.221581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.221852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.221975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.222076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.222362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.222581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.222828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.222973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.223066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.223304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.223538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9f0000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.223779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.223918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.224022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.224288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.224533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.224778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.224900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.224998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.225255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.225515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.225781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.225922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.226024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.226124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.226150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.608 qpair failed and we were unable to recover it. 00:28:02.608 [2024-11-26 08:35:48.226250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.226411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.608 [2024-11-26 08:35:48.226436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.226528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.226618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.226644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.226758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.226863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.226890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.227018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff9e4000b90 with addr=10.0.0.2, port=4420 00:28:02.609 08:35:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.227324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 08:35:48 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:02.609 [2024-11-26 08:35:48.227452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.609 [2024-11-26 08:35:48.227611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.609 [2024-11-26 08:35:48.227710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.227833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.227956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.228060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.228279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.228517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.228773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.228902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.229003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.229249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.229523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.229784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.229934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.230030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.230266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.230499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.609 [2024-11-26 08:35:48.230776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.609 [2024-11-26 08:35:48.230892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.609 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.230995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.231219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.231523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.231755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.231880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.232002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.232254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.232478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.232762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.232885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.232987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.233241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.233505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.233753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.233869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.233963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.234182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.234463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.234736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.234863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.234986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.235293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.235520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.235760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.235877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.235972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.236256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.236510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.236738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.236867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.236968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.237225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.237466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.237701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.237885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.610 qpair failed and we were unable to recover it. 00:28:02.610 [2024-11-26 08:35:48.237987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.610 [2024-11-26 08:35:48.238145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.238298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.238548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.238820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.238945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.239051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.239333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.239612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.239868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.239975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.240156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.240403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.240624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.240809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.240935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.241191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.241417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.241668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.241804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.241937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.242153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.242430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.242660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.242821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.242921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.243168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.243411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.243662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.243791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.243894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.244197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.244455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.244715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.244869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.244977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.245092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.245117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.611 qpair failed and we were unable to recover it. 00:28:02.611 [2024-11-26 08:35:48.245270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.611 [2024-11-26 08:35:48.245379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.245403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.245537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.245627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.245652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.245760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.245884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.245909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.246009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.246252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.246471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.246714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.246860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.246950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.247224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.247507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.247752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.247873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.247997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.248250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.248501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.248754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.248884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.248990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.249143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.249168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.249271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 Malloc0 00:28:02.612 [2024-11-26 08:35:48.249393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.249418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.249548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.612 [2024-11-26 08:35:48.249641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.249666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.249765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 08:35:48 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:02.612 [2024-11-26 08:35:48.249868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.249893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.612 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.612 [2024-11-26 08:35:48.250013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.250270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.250552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.250839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.250961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.251105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.251354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.251583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.251849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.251975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.252113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.252263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.252288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.612 qpair failed and we were unable to recover it. 00:28:02.612 [2024-11-26 08:35:48.252385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.612 [2024-11-26 08:35:48.252540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.252565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.252663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.252776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.252801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.252911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.252976] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:02.613 [2024-11-26 08:35:48.253034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.253150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.253375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.253708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.253846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.253953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.254211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.254454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.254673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.254824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.254932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.255190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.255424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.255724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.255876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.255986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.256204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.256446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.256680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.256816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.256921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.257156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.257416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.257641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.257869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.257991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.258094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.258209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.258235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.258357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.258448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.613 [2024-11-26 08:35:48.258472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.613 qpair failed and we were unable to recover it. 00:28:02.613 [2024-11-26 08:35:48.258601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.258697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.258723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.258828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.258967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.258993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.259119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.259369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.259598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.259828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.259981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.260085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.260342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.260619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.260840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.260968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.261064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.261161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.261185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.614 [2024-11-26 08:35:48.261314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 08:35:48 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:02.614 [2024-11-26 08:35:48.261446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.614 [2024-11-26 08:35:48.261471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.261575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.614 [2024-11-26 08:35:48.261663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.261695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.261807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.261960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.261985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.262094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.262333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.262542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.262844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.262968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.263085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.263319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.263580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.263861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.263987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.264110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.264326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.264573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.264860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.264981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.265119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.265212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.265237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.614 qpair failed and we were unable to recover it. 00:28:02.614 [2024-11-26 08:35:48.265359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.614 [2024-11-26 08:35:48.265463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.265488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.265623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.265721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.265747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.265853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.265950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.265974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.266075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.266336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.266607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.266846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.266994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.267118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.267385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.267613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.267899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.267993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.268158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.268436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.268657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.268841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.268939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.269166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.615 [2024-11-26 08:35:48.269266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 08:35:48 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:02.615 [2024-11-26 08:35:48.269414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.615 [2024-11-26 08:35:48.269509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.615 [2024-11-26 08:35:48.269663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.269782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.269909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.270180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.270392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.270618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.270892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.270990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.271142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.271396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.271650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.271846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.271942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.272188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.615 qpair failed and we were unable to recover it. 00:28:02.615 [2024-11-26 08:35:48.272440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.615 [2024-11-26 08:35:48.272558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.272668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.272777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.272802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.272900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.272996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.273122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.273381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.273610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.273851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.273981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.274110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.274349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.274586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.274872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.274977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.275136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.275444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.275715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.275842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.275964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.276223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.276517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.276753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.276879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.277014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.277251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.616 [2024-11-26 08:35:48.277350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 08:35:48 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:02.616 [2024-11-26 08:35:48.277486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.616 [2024-11-26 08:35:48.277584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.616 [2024-11-26 08:35:48.277753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.277899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.278003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.278257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.278490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.278755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.278876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.278973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.279096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.279121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.279283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.279408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.616 [2024-11-26 08:35:48.279433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.616 qpair failed and we were unable to recover it. 00:28:02.616 [2024-11-26 08:35:48.279561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.279652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.279677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.279788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.279879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.279904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.280014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.280249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.280498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.280718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.280833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.280927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.281075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.617 [2024-11-26 08:35:48.281099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9d6cb0 with addr=10.0.0.2, port=4420 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.281252] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:02.617 [2024-11-26 08:35:48.283634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.283784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.283818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.283834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.283846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.283880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.617 08:35:48 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:02.617 08:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.617 08:35:48 -- common/autotest_common.sh@10 -- # set +x 00:28:02.617 08:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.617 08:35:48 -- host/target_disconnect.sh@58 -- # wait 1083070 00:28:02.617 [2024-11-26 08:35:48.293539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.293644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.293681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.293704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.293717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.293747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.303597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.303707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.303747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.303762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.303774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.303803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.313574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.313709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.313735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.313749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.313761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.313789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.323577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.323700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.323734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.323753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.323766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.323795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.333575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.333682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.333715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.333730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.333741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.333770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.343603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.343710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.343736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.343750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.343762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.343790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.353606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.353715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.353742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.353756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.353768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.353796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.363740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.363861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.363887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.363902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.617 [2024-11-26 08:35:48.363919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.617 [2024-11-26 08:35:48.363948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.617 qpair failed and we were unable to recover it. 00:28:02.617 [2024-11-26 08:35:48.373699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.617 [2024-11-26 08:35:48.373807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.617 [2024-11-26 08:35:48.373832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.617 [2024-11-26 08:35:48.373847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.373859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.373887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.618 [2024-11-26 08:35:48.383707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.618 [2024-11-26 08:35:48.383814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.618 [2024-11-26 08:35:48.383839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.618 [2024-11-26 08:35:48.383853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.383865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.383893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.618 [2024-11-26 08:35:48.393850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.618 [2024-11-26 08:35:48.393962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.618 [2024-11-26 08:35:48.393988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.618 [2024-11-26 08:35:48.394003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.394015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.394043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.618 [2024-11-26 08:35:48.403932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.618 [2024-11-26 08:35:48.404049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.618 [2024-11-26 08:35:48.404075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.618 [2024-11-26 08:35:48.404089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.404101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.404129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.618 [2024-11-26 08:35:48.413800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.618 [2024-11-26 08:35:48.413895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.618 [2024-11-26 08:35:48.413929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.618 [2024-11-26 08:35:48.413944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.413956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.413984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.618 [2024-11-26 08:35:48.423859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.618 [2024-11-26 08:35:48.424000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.618 [2024-11-26 08:35:48.424026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.618 [2024-11-26 08:35:48.424040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.618 [2024-11-26 08:35:48.424052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.618 [2024-11-26 08:35:48.424079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.618 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.433894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.434032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.434057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.434071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.434083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.434111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.443866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.443976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.444001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.444016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.444028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.444055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.453908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.454013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.454038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.454052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.454070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.454099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.463929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.464029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.464054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.464067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.464079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.464107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.473985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.474088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.474114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.474128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.474139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.474167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.483984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.484096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.484122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.484136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.484148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.484175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.494032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.494133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.494158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.494172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.494184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.494212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.504087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.504194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.504219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.504234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.504246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.504274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.514139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.514249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.514276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.514290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.514302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.878 [2024-11-26 08:35:48.514331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.878 qpair failed and we were unable to recover it. 00:28:02.878 [2024-11-26 08:35:48.524139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.878 [2024-11-26 08:35:48.524247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.878 [2024-11-26 08:35:48.524273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.878 [2024-11-26 08:35:48.524287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.878 [2024-11-26 08:35:48.524300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.524329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.534153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.534254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.534280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.534294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.534306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.534334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.544164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.544259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.544293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.544307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.544325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.544354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.554247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.554364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.554389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.554404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.554415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.554444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.564271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.564401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.564427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.564440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.564452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.564480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.574260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.574361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.574386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.574400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.574412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.574441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.584304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.584405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.584440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.584454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.584466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.584493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.594369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.594484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.594509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.594523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.594536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.594564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.604362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.604494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.604520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.604534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.604546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.604574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.614399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.614504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.614529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.614543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.614555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.614582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.624430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.624531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.624557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.624571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.624583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.624611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.634489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.634593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.634618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.634632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.634651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.634680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.644493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.879 [2024-11-26 08:35:48.644642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.879 [2024-11-26 08:35:48.644668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.879 [2024-11-26 08:35:48.644682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.879 [2024-11-26 08:35:48.644702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.879 [2024-11-26 08:35:48.644731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.879 qpair failed and we were unable to recover it. 00:28:02.879 [2024-11-26 08:35:48.654492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.654588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.654613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.654627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.654639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.654667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.664525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.664653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.664678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.664701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.664716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.664744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.674584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.674698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.674723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.674737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.674749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.674777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.684576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.684692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.684717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.684731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.684743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.684771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.694635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.694738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.694764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.694778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.694790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.694818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.704667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.704773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.704799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.704813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.704825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.704852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.714704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.714873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.714901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.714916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.714928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.714958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:02.880 [2024-11-26 08:35:48.724732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.880 [2024-11-26 08:35:48.724850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.880 [2024-11-26 08:35:48.724876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.880 [2024-11-26 08:35:48.724890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.880 [2024-11-26 08:35:48.724907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:02.880 [2024-11-26 08:35:48.724936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.880 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-26 08:35:48.734840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.139 [2024-11-26 08:35:48.734940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.139 [2024-11-26 08:35:48.734966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.139 [2024-11-26 08:35:48.734980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.139 [2024-11-26 08:35:48.734992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.139 [2024-11-26 08:35:48.735020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-26 08:35:48.744755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.744857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.744882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.744896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.744908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.744936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.754818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.754928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.754953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.754966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.754978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.755006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.764836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.764949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.764974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.764988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.765000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.765028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.774891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.775014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.775039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.775053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.775065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.775092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.784981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.785082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.785107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.785121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.785132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.785159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.794940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.795041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.795066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.795088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.795100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.795129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.804961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.805069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.805097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.805111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.805123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.805151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.814967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.815071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.815096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.815111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.815129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.815158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.825022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.825143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.825168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.825182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.825194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.825222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.835129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.835300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.835324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.835338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.835350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.835391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.845060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.845173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.845198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.845212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.845225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.845252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.855146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.855300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.855324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.855338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.855350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.855392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.865150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.140 [2024-11-26 08:35:48.865249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.140 [2024-11-26 08:35:48.865274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.140 [2024-11-26 08:35:48.865288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.140 [2024-11-26 08:35:48.865300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.140 [2024-11-26 08:35:48.865327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-26 08:35:48.875145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.875251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.875275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.875289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.875301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.875329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.885161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.885268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.885294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.885307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.885320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.885347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.895271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.895392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.895420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.895435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.895448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.895476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.905226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.905324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.905349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.905371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.905384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.905412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.915299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.915428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.915453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.915467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.915480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.915522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.925280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.925388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.925414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.925429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.925441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.925469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.935319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.935426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.935452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.935466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.935478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.935506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.945348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.945443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.945468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.945483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.945495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.945522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.955375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.955480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.955506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.955519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.955531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.955559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.965394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.965544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.965570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.965584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.965595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.965623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.975423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.975523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.975552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.975567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.975579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.975606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-26 08:35:48.985443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.141 [2024-11-26 08:35:48.985539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.141 [2024-11-26 08:35:48.985563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.141 [2024-11-26 08:35:48.985577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.141 [2024-11-26 08:35:48.985590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.141 [2024-11-26 08:35:48.985618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:48.995493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:48.995595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:48.995621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:48.995641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:48.995655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:48.995683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.005543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:49.005652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:49.005678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:49.005700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:49.005713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:49.005741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.015532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:49.015629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:49.015654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:49.015668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:49.015680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:49.015715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.025558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:49.025663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:49.025694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:49.025710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:49.025722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:49.025750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.035662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:49.035817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:49.035842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:49.035856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:49.035868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:49.035896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.045732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.403 [2024-11-26 08:35:49.045835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.403 [2024-11-26 08:35:49.045860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.403 [2024-11-26 08:35:49.045875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.403 [2024-11-26 08:35:49.045886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.403 [2024-11-26 08:35:49.045915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.403 qpair failed and we were unable to recover it. 00:28:03.403 [2024-11-26 08:35:49.055729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.055829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.055855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.055870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.055881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.055909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.065692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.065794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.065819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.065832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.065844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.065872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.075743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.075865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.075890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.075904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.075916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.075943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.085755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.085864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.085889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.085909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.085922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.085950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.095807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.095914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.095939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.095953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.095965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.095992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.105825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.105969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.105994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.106008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.106019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.106047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.115929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.116027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.116053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.116067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.116078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.116106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.125907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.126021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.126047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.126061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.126073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.126101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.135914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.136018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.136043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.136057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.136070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.136097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.145942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.146072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.146097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.146111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.146123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.146150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.155984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.156088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.156113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.156127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.156139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.156166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.165985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.166094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.166120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.166134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.166146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.166174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.176017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.176139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.404 [2024-11-26 08:35:49.176164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.404 [2024-11-26 08:35:49.176183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.404 [2024-11-26 08:35:49.176197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.404 [2024-11-26 08:35:49.176225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.404 qpair failed and we were unable to recover it. 00:28:03.404 [2024-11-26 08:35:49.186033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.404 [2024-11-26 08:35:49.186134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.186159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.186174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.186186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.186213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.196067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.196171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.196196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.196209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.196222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.196250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.206161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.206296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.206321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.206335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.206347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.206389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.216207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.216317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.216342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.216355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.216367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.216396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.226208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.226310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.226336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.226350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.226362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.226390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.236188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.236293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.236317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.236331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.236344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.236371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.246219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.246328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.246354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.246367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.246379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.246407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.405 [2024-11-26 08:35:49.256259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.405 [2024-11-26 08:35:49.256359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.405 [2024-11-26 08:35:49.256383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.405 [2024-11-26 08:35:49.256396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.405 [2024-11-26 08:35:49.256408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.405 [2024-11-26 08:35:49.256436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.405 qpair failed and we were unable to recover it. 00:28:03.666 [2024-11-26 08:35:49.266354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.666 [2024-11-26 08:35:49.266458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.666 [2024-11-26 08:35:49.266483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.666 [2024-11-26 08:35:49.266508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.666 [2024-11-26 08:35:49.266521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.666 [2024-11-26 08:35:49.266549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.666 qpair failed and we were unable to recover it. 00:28:03.666 [2024-11-26 08:35:49.276348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.666 [2024-11-26 08:35:49.276464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.666 [2024-11-26 08:35:49.276489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.666 [2024-11-26 08:35:49.276503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.666 [2024-11-26 08:35:49.276514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.666 [2024-11-26 08:35:49.276542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.666 qpair failed and we were unable to recover it. 00:28:03.666 [2024-11-26 08:35:49.286385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.666 [2024-11-26 08:35:49.286551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.666 [2024-11-26 08:35:49.286579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.666 [2024-11-26 08:35:49.286594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.666 [2024-11-26 08:35:49.286606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.666 [2024-11-26 08:35:49.286649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.666 qpair failed and we were unable to recover it. 00:28:03.666 [2024-11-26 08:35:49.296388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.666 [2024-11-26 08:35:49.296497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.666 [2024-11-26 08:35:49.296526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.666 [2024-11-26 08:35:49.296541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.666 [2024-11-26 08:35:49.296553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.666 [2024-11-26 08:35:49.296583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.666 qpair failed and we were unable to recover it. 00:28:03.666 [2024-11-26 08:35:49.306426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.666 [2024-11-26 08:35:49.306527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.666 [2024-11-26 08:35:49.306553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.666 [2024-11-26 08:35:49.306567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.306579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.306607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.316450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.316559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.316584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.316598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.316611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.316638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.326538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.326651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.326676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.326698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.326711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.326739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.336485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.336617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.336642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.336656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.336669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.336704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.346499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.346593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.346619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.346633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.346645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.346673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.356587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.356709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.356741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.356756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.356768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.356797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.366552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.366657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.366683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.366706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.366718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.366747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.376603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.376712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.376738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.376752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.376764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.376792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.386616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.386743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.386769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.386783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.386794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.386822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.396660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.396771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.396796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.396810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.396822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.396850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.406694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.406817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.406843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.406856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.406868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.406896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.416794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.416933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.416959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.416973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.416985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.417013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.667 [2024-11-26 08:35:49.426748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.667 [2024-11-26 08:35:49.426865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.667 [2024-11-26 08:35:49.426893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.667 [2024-11-26 08:35:49.426909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.667 [2024-11-26 08:35:49.426921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.667 [2024-11-26 08:35:49.426950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.667 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.436861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.437027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.437052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.437066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.437078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.437122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.446784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.446895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.446926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.446941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.446953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.446981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.456813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.456923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.456949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.456963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.456975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.457004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.466922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.467023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.467049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.467063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.467075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.467103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.476929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.477040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.477066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.477080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.477092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.477120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.486903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.487021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.487047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.487061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.487072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.487101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.496937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.497041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.497069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.497083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.497095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.497123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.506983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.507082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.507110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.507125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.507137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.507166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.668 [2024-11-26 08:35:49.517021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.668 [2024-11-26 08:35:49.517145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.668 [2024-11-26 08:35:49.517170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.668 [2024-11-26 08:35:49.517184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.668 [2024-11-26 08:35:49.517196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.668 [2024-11-26 08:35:49.517224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.668 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.527000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.527111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.527136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.527151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.527163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.527190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.537027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.537129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.537161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.537177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.537189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.537217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.547087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.547216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.547243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.547257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.547269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.547297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.557086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.557194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.557220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.557234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.557246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.557274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.567114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.567231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.567257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.567271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.567283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.567311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.577153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.930 [2024-11-26 08:35:49.577249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.930 [2024-11-26 08:35:49.577275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.930 [2024-11-26 08:35:49.577290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.930 [2024-11-26 08:35:49.577301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.930 [2024-11-26 08:35:49.577335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.930 qpair failed and we were unable to recover it. 00:28:03.930 [2024-11-26 08:35:49.587302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.587402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.587427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.587442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.587453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.587481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.597214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.597316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.597341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.597355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.597367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.597395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.607248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.607359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.607384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.607398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.607410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.607438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.617293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.617414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.617440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.617454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.617466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.617493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.627310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.627430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.627461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.627476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.627489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.627517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.637351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.637458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.637487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.637502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.637514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.637543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.647364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.647471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.647498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.647512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.647524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.647554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.657499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.657635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.657660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.657675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.657695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.657726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.667431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.667536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.667562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.667576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.667588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.667625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.677461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.677564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.677589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.677603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.677615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.677644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.687507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.687636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.687662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.687676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.687698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.687728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.697517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.697616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.697641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.697655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.697667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.931 [2024-11-26 08:35:49.697702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.931 qpair failed and we were unable to recover it. 00:28:03.931 [2024-11-26 08:35:49.707562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.931 [2024-11-26 08:35:49.707659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.931 [2024-11-26 08:35:49.707693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.931 [2024-11-26 08:35:49.707710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.931 [2024-11-26 08:35:49.707725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.707753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.717595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.717709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.717741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.717758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.717771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.717799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.727655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.727790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.727816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.727830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.727842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.727870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.737668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.737831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.737860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.737875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.737887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.737917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.747666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.747773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.747799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.747814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.747826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.747854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.757722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.757838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.757864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.757879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.757892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.757926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.767814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.767960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.768000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.768013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.768025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.768067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:03.932 [2024-11-26 08:35:49.777791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.932 [2024-11-26 08:35:49.777904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.932 [2024-11-26 08:35:49.777928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.932 [2024-11-26 08:35:49.777942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.932 [2024-11-26 08:35:49.777954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:03.932 [2024-11-26 08:35:49.777982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.932 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.787773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.787878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.787907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.787921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.787933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.787961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.797841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.797948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.797973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.797987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.797999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.798027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.807856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.807964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.807995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.808010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.808022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.808050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.817857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.817951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.817976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.817990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.818002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.818029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.827888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.827984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.828010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.828025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.828037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.828065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.838029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.838134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.838162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.838177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.838189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.838217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.847962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.848068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.848093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.848108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.848120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.848153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.857982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.858081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.858106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.858120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.858131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.858159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.867993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.868088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.868114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.868128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.868140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.868168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.878033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.878134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.193 [2024-11-26 08:35:49.878159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.193 [2024-11-26 08:35:49.878173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.193 [2024-11-26 08:35:49.878185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.193 [2024-11-26 08:35:49.878213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.193 qpair failed and we were unable to recover it. 00:28:04.193 [2024-11-26 08:35:49.888050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.193 [2024-11-26 08:35:49.888155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.888181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.888195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.888207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.888234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.898089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.898183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.898214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.898229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.898241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.898269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.908171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.908293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.908318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.908332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.908344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.908372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.918156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.918260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.918285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.918299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.918311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.918339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.928283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.928396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.928421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.928435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.928447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.928475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.938244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.938345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.938370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.938384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.938396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.938434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.948352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.948458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.948484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.948498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.948510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.948537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.958355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.958461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.958486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.958500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.958512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.958540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.968287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.968391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.968417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.968432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.968444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.968471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.978314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.978411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.978436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.978450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.978462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.978490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.988359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.988458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.988489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.988504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.988516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.988546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:49.998415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:49.998566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:49.998591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:49.998604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:49.998616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:49.998660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:50.008573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:50.008704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:50.008735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:50.008749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.194 [2024-11-26 08:35:50.008762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.194 [2024-11-26 08:35:50.008794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.194 qpair failed and we were unable to recover it. 00:28:04.194 [2024-11-26 08:35:50.018460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.194 [2024-11-26 08:35:50.018568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.194 [2024-11-26 08:35:50.018594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.194 [2024-11-26 08:35:50.018609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.195 [2024-11-26 08:35:50.018622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.195 [2024-11-26 08:35:50.018651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.195 qpair failed and we were unable to recover it. 00:28:04.195 [2024-11-26 08:35:50.028531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.195 [2024-11-26 08:35:50.028643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.195 [2024-11-26 08:35:50.028668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.195 [2024-11-26 08:35:50.028682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.195 [2024-11-26 08:35:50.028715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.195 [2024-11-26 08:35:50.028745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.195 qpair failed and we were unable to recover it. 00:28:04.195 [2024-11-26 08:35:50.038597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.195 [2024-11-26 08:35:50.038761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.195 [2024-11-26 08:35:50.038789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.195 [2024-11-26 08:35:50.038804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.195 [2024-11-26 08:35:50.038817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.195 [2024-11-26 08:35:50.038848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.195 qpair failed and we were unable to recover it. 00:28:04.454 [2024-11-26 08:35:50.048549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.454 [2024-11-26 08:35:50.048660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.454 [2024-11-26 08:35:50.048692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.454 [2024-11-26 08:35:50.048709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.454 [2024-11-26 08:35:50.048725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.454 [2024-11-26 08:35:50.048753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.454 qpair failed and we were unable to recover it. 00:28:04.454 [2024-11-26 08:35:50.058623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.454 [2024-11-26 08:35:50.058745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.454 [2024-11-26 08:35:50.058772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.454 [2024-11-26 08:35:50.058786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.454 [2024-11-26 08:35:50.058803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.454 [2024-11-26 08:35:50.058834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.454 qpair failed and we were unable to recover it. 00:28:04.454 [2024-11-26 08:35:50.068665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.454 [2024-11-26 08:35:50.068783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.454 [2024-11-26 08:35:50.068810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.454 [2024-11-26 08:35:50.068825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.454 [2024-11-26 08:35:50.068837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.454 [2024-11-26 08:35:50.068866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.454 qpair failed and we were unable to recover it. 00:28:04.454 [2024-11-26 08:35:50.078628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.078758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.078784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.078797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.078809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.078838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.088645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.088759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.088785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.088800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.088812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.088840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.098760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.098910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.098938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.098953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.098966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.099009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.108725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.108833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.108859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.108873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.108885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.108913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.118748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.118880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.118905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.118919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.118937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.118967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.128777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.128918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.128943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.128958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.128969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.128997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.138821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.138935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.138960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.138975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.138987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.139015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.148816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.148918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.148943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.148957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.148969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.148997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.158854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.158970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.158995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.159009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.159021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.159049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.168868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.168989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.169016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.169030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.169042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.169070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.178888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.178988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.179014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.179028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.179040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.179068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.188933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.189032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.189058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.189071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.189083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.189111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.199016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.199173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.455 [2024-11-26 08:35:50.199197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.455 [2024-11-26 08:35:50.199212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.455 [2024-11-26 08:35:50.199223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.455 [2024-11-26 08:35:50.199266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.455 qpair failed and we were unable to recover it. 00:28:04.455 [2024-11-26 08:35:50.208995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.455 [2024-11-26 08:35:50.209102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.209130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.209146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.209164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.209194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.219103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.219224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.219249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.219263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.219275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.219303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.229058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.229181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.229207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.229221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.229233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.229261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.239224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.239337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.239363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.239377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.239389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.239417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.249144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.249256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.249281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.249295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.249307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.249334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.259160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.259268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.259292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.259306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.259317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.259345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.269175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.269282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.269307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.269322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.269333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.269361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.279244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.279356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.279381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.279394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.279406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.279434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.289251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.289359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.289384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.289398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.289410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.289438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.456 [2024-11-26 08:35:50.299344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.456 [2024-11-26 08:35:50.299473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.456 [2024-11-26 08:35:50.299498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.456 [2024-11-26 08:35:50.299512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.456 [2024-11-26 08:35:50.299532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.456 [2024-11-26 08:35:50.299561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.456 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.309380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.309508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.309533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.309547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.309559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.309586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.319337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.319459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.319484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.319498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.319510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.319538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.329332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.329446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.329471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.329486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.329497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.329525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.339371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.339472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.339496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.339510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.339521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.339549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.349447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.349571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.349596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.349610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.349622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.349649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.359463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.359579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.359603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.359618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.359629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.359657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.369453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.369549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.369574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.369588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.369600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.369628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.379514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.379632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.379659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.379673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.379692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.379723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.389509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.389612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.389638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.389652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.389670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.389706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.399569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.399680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.399712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.399726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.716 [2024-11-26 08:35:50.399738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.716 [2024-11-26 08:35:50.399766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.716 qpair failed and we were unable to recover it. 00:28:04.716 [2024-11-26 08:35:50.409546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.716 [2024-11-26 08:35:50.409657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.716 [2024-11-26 08:35:50.409682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.716 [2024-11-26 08:35:50.409704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.409716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.409744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.419601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.419711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.419736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.419751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.419763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.419791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.429640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.429754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.429780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.429794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.429806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.429835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.439667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.439805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.439831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.439846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.439858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.439887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.449715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.449822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.449847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.449861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.449873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.449901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.459725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.459828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.459853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.459867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.459879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.459908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.469789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.469897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.469922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.469937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.469949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.469977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.479781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.479934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.479959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.479979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.479992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.480019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.489805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.489907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.489933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.489948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.489960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.489989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.499847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.499951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.499977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.499991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.500003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.500031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.509947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.510056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.510082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.510096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.510108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.510137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.519925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.520057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.520082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.520096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.520109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.520137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.529934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.530048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.530073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.530088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.530099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.530127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.717 qpair failed and we were unable to recover it. 00:28:04.717 [2024-11-26 08:35:50.539947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.717 [2024-11-26 08:35:50.540046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.717 [2024-11-26 08:35:50.540072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.717 [2024-11-26 08:35:50.540086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.717 [2024-11-26 08:35:50.540098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.717 [2024-11-26 08:35:50.540126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.718 qpair failed and we were unable to recover it. 00:28:04.718 [2024-11-26 08:35:50.549964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.718 [2024-11-26 08:35:50.550065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.718 [2024-11-26 08:35:50.550090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.718 [2024-11-26 08:35:50.550104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.718 [2024-11-26 08:35:50.550116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.718 [2024-11-26 08:35:50.550144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.718 qpair failed and we were unable to recover it. 00:28:04.718 [2024-11-26 08:35:50.560072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.718 [2024-11-26 08:35:50.560229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.718 [2024-11-26 08:35:50.560254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.718 [2024-11-26 08:35:50.560268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.718 [2024-11-26 08:35:50.560280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.718 [2024-11-26 08:35:50.560309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.718 qpair failed and we were unable to recover it. 00:28:04.977 [2024-11-26 08:35:50.570038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.977 [2024-11-26 08:35:50.570167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.977 [2024-11-26 08:35:50.570194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.977 [2024-11-26 08:35:50.570214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.977 [2024-11-26 08:35:50.570227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.977 [2024-11-26 08:35:50.570255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.977 qpair failed and we were unable to recover it. 00:28:04.977 [2024-11-26 08:35:50.580125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.977 [2024-11-26 08:35:50.580228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.977 [2024-11-26 08:35:50.580253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.977 [2024-11-26 08:35:50.580268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.977 [2024-11-26 08:35:50.580279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.977 [2024-11-26 08:35:50.580308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.977 qpair failed and we were unable to recover it. 00:28:04.977 [2024-11-26 08:35:50.590105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.977 [2024-11-26 08:35:50.590204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.977 [2024-11-26 08:35:50.590230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.590244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.590257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.590284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.600169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.600287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.600312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.600326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.600338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.600366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.610288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.610417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.610442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.610456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.610468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.610495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.620258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.620376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.620402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.620416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.620428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.620456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.630238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.630340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.630365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.630379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.630391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.630419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.640352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.640511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.640537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.640551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.640563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.640591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.650326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.650480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.650505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.650519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.650531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.650559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.660384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.660508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.660533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.660553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.660567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.660595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.670463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.670593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.670619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.670633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.670645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.670673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.680375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.680522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.680546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.680560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.680572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.680610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.690402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.690513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.690541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.690556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.690568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.690597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.700419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.700540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.700565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.700579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.700592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.978 [2024-11-26 08:35:50.700620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.978 qpair failed and we were unable to recover it. 00:28:04.978 [2024-11-26 08:35:50.710470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.978 [2024-11-26 08:35:50.710581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.978 [2024-11-26 08:35:50.710606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.978 [2024-11-26 08:35:50.710620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.978 [2024-11-26 08:35:50.710632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.710660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.720498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.720613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.720648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.720662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.720674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.720733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.730507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.730606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.730632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.730646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.730657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.730693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.740578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.740692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.740717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.740732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.740744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.740773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.750589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.750710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.750736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.750756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.750768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.750800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.760638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.760765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.760790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.760804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.760817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.760845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.770628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.770787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.770813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.770827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.770839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.770867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.780769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.780908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.780934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.780948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.780960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.780988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.790737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.790844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.790870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.790884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.790896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.790924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.800749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.800865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.800894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.800909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.800921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.800949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.810844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.810970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.810996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.811010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.811022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.811050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.820828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.820931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.820957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.820971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.820982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.821011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.979 qpair failed and we were unable to recover it. 00:28:04.979 [2024-11-26 08:35:50.830846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:04.979 [2024-11-26 08:35:50.830948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:04.979 [2024-11-26 08:35:50.830974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:04.979 [2024-11-26 08:35:50.830988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:04.979 [2024-11-26 08:35:50.831000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:04.979 [2024-11-26 08:35:50.831028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:04.980 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.840893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.841056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.841081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.841105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.841134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.841161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.850879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.850987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.851012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.851026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.851038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.851074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.860927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.861032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.861057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.861071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.861083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.861111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.870930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.871038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.871064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.871078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.871090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.871118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.880970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.881106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.881131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.881145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.881157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.881185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.890972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.891097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.891122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.891136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.891148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.891176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.901011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.241 [2024-11-26 08:35:50.901111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.241 [2024-11-26 08:35:50.901137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.241 [2024-11-26 08:35:50.901151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.241 [2024-11-26 08:35:50.901163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.241 [2024-11-26 08:35:50.901191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.241 qpair failed and we were unable to recover it. 00:28:05.241 [2024-11-26 08:35:50.911097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.911209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.911234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.911248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.911260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.911288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.921072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.921223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.921252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.921266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.921278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.921307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.931103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.931249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.931274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.931294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.931309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.931338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.941238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.941345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.941370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.941384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.941411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.941439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.951241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.951372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.951397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.951411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.951423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.951450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.961235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.961349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.961374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.961388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.961400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.961427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.971241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.971351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.971376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.971389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.971401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.971429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.981244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.981344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.981370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.981384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.981395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.981423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:50.991290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:50.991393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:50.991418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:50.991433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:50.991444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:50.991472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:51.001306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:51.001423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:51.001449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:51.001463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:51.001475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:51.001504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:51.011315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:51.011426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.242 [2024-11-26 08:35:51.011451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.242 [2024-11-26 08:35:51.011465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.242 [2024-11-26 08:35:51.011477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.242 [2024-11-26 08:35:51.011505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.242 qpair failed and we were unable to recover it. 00:28:05.242 [2024-11-26 08:35:51.021357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.242 [2024-11-26 08:35:51.021473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.021504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.021519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.021531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.021559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.031472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.031576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.031605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.031619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.031632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.031661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.041543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.041671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.041706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.041722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.041734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.041762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.051514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.051618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.051644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.051674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.051691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.051736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.061479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.061582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.061607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.061621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.061633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.061661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.071499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.071604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.071630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.071644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.071656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.071683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.081556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.081718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.081744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.081758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.081773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.081805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.243 [2024-11-26 08:35:51.091570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.243 [2024-11-26 08:35:51.091707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.243 [2024-11-26 08:35:51.091734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.243 [2024-11-26 08:35:51.091748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.243 [2024-11-26 08:35:51.091760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.243 [2024-11-26 08:35:51.091788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.243 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.101609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.101758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.101784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.101799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.101811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.101839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.111610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.111714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.111745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.111761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.111773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.111801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.121683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.121836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.121861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.121876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.121888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.121916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.131692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.131809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.131838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.131853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.131866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.131895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.141716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.141852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.141878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.141892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.141903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.141932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.151707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.151851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.151878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.151892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.151904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.151932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.161744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.504 [2024-11-26 08:35:51.161847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.504 [2024-11-26 08:35:51.161872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.504 [2024-11-26 08:35:51.161886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.504 [2024-11-26 08:35:51.161898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.504 [2024-11-26 08:35:51.161926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.504 qpair failed and we were unable to recover it. 00:28:05.504 [2024-11-26 08:35:51.171796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.171926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.171953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.171969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.171984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.172013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.181838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.181964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.181991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.182005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.182016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.182044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.191863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.191956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.191982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.191996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.192008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.192036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.201862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.202018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.202049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.202064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.202077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.202105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.211887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.211988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.212014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.212029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.212041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.212068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.221951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.222084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.222109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.222124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.222136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.222164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.232062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.232198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.232224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.232238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.232250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.232278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.242007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.242111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.242136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.242150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.242162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.242196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.252044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.252171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.252197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.252211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.505 [2024-11-26 08:35:51.252223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.505 [2024-11-26 08:35:51.252251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.505 qpair failed and we were unable to recover it. 00:28:05.505 [2024-11-26 08:35:51.262047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.505 [2024-11-26 08:35:51.262166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.505 [2024-11-26 08:35:51.262190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.505 [2024-11-26 08:35:51.262203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.262215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.262242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.272056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.272152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.272178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.272192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.272204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.272231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.282107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.282210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.282235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.282249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.282261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.282288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.292142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.292257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.292289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.292303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.292315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.292343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.302145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.302242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.302267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.302281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.302293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.302320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.312251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.312354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.312379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.312393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.312405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.312433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.322250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.322361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.322386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.322400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.322412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.322440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.332260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.332412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.332437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.332450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.332462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.332495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.342271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.342380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.342405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.342419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.342431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.342459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.506 [2024-11-26 08:35:51.352321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.506 [2024-11-26 08:35:51.352442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.506 [2024-11-26 08:35:51.352468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.506 [2024-11-26 08:35:51.352483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.506 [2024-11-26 08:35:51.352494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.506 [2024-11-26 08:35:51.352522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.506 qpair failed and we were unable to recover it. 00:28:05.767 [2024-11-26 08:35:51.362347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.767 [2024-11-26 08:35:51.362465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.767 [2024-11-26 08:35:51.362491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.767 [2024-11-26 08:35:51.362506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.767 [2024-11-26 08:35:51.362518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.767 [2024-11-26 08:35:51.362546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.767 qpair failed and we were unable to recover it. 00:28:05.767 [2024-11-26 08:35:51.372447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.767 [2024-11-26 08:35:51.372555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.767 [2024-11-26 08:35:51.372581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.767 [2024-11-26 08:35:51.372595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.767 [2024-11-26 08:35:51.372607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.767 [2024-11-26 08:35:51.372635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.767 qpair failed and we were unable to recover it. 00:28:05.767 [2024-11-26 08:35:51.382415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.768 [2024-11-26 08:35:51.382525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.768 [2024-11-26 08:35:51.382555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.768 [2024-11-26 08:35:51.382570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.768 [2024-11-26 08:35:51.382582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.768 [2024-11-26 08:35:51.382610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.768 qpair failed and we were unable to recover it. 00:28:05.768 [2024-11-26 08:35:51.392455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.768 [2024-11-26 08:35:51.392557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.768 [2024-11-26 08:35:51.392583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.768 [2024-11-26 08:35:51.392597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.768 [2024-11-26 08:35:51.392609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.768 [2024-11-26 08:35:51.392637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.768 qpair failed and we were unable to recover it. 00:28:05.768 [2024-11-26 08:35:51.402451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.768 [2024-11-26 08:35:51.402584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.768 [2024-11-26 08:35:51.402609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.768 [2024-11-26 08:35:51.402623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.768 [2024-11-26 08:35:51.402635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x9d6cb0 00:28:05.768 [2024-11-26 08:35:51.402663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.768 qpair failed and we were unable to recover it. 00:28:05.768 [2024-11-26 08:35:51.402705] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:05.768 A controller has encountered a failure and is being reset. 00:28:05.768 Controller properly reset. 00:28:07.670 Initializing NVMe Controllers 00:28:07.670 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:07.670 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:07.670 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:07.670 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:07.670 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:07.671 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:07.671 Initialization complete. Launching workers. 00:28:07.671 Starting thread on core 1 00:28:07.671 Starting thread on core 2 00:28:07.671 Starting thread on core 3 00:28:07.671 Starting thread on core 0 00:28:07.671 08:35:53 -- host/target_disconnect.sh@59 -- # sync 00:28:07.671 00:28:07.671 real 0m11.487s 00:28:07.671 user 0m26.486s 00:28:07.671 sys 0m5.804s 00:28:07.671 08:35:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:07.671 08:35:53 -- common/autotest_common.sh@10 -- # set +x 00:28:07.671 ************************************ 00:28:07.671 END TEST nvmf_target_disconnect_tc2 00:28:07.671 ************************************ 00:28:07.929 08:35:53 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:07.929 08:35:53 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:07.929 08:35:53 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:07.929 08:35:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:07.929 08:35:53 -- nvmf/common.sh@116 -- # sync 00:28:07.929 08:35:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:07.929 08:35:53 -- nvmf/common.sh@119 -- # set +e 00:28:07.929 08:35:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:07.929 08:35:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:07.929 rmmod nvme_tcp 00:28:07.929 rmmod nvme_fabrics 00:28:07.929 rmmod nvme_keyring 00:28:07.929 08:35:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:07.929 08:35:53 -- nvmf/common.sh@123 -- # set -e 00:28:07.929 08:35:53 -- nvmf/common.sh@124 -- # return 0 00:28:07.929 08:35:53 -- nvmf/common.sh@477 -- # '[' -n 1083493 ']' 00:28:07.929 08:35:53 -- nvmf/common.sh@478 -- # killprocess 1083493 00:28:07.929 08:35:53 -- common/autotest_common.sh@936 -- # '[' -z 1083493 ']' 00:28:07.929 08:35:53 -- common/autotest_common.sh@940 -- # kill -0 1083493 00:28:07.929 08:35:53 -- common/autotest_common.sh@941 -- # uname 00:28:07.929 08:35:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:07.929 08:35:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1083493 00:28:07.929 08:35:53 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:07.929 08:35:53 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:07.929 08:35:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1083493' 00:28:07.929 killing process with pid 1083493 00:28:07.929 08:35:53 -- common/autotest_common.sh@955 -- # kill 1083493 00:28:07.929 08:35:53 -- common/autotest_common.sh@960 -- # wait 1083493 00:28:08.187 08:35:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:08.187 08:35:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:08.187 08:35:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:08.187 08:35:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:08.187 08:35:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:08.187 08:35:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:08.187 08:35:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:08.187 08:35:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:10.721 08:35:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:10.721 00:28:10.721 real 0m16.452s 00:28:10.721 user 0m52.724s 00:28:10.721 sys 0m8.019s 00:28:10.721 08:35:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:10.721 08:35:55 -- common/autotest_common.sh@10 -- # set +x 00:28:10.721 ************************************ 00:28:10.721 END TEST nvmf_target_disconnect 00:28:10.721 ************************************ 00:28:10.721 08:35:55 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:10.721 08:35:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:10.721 08:35:55 -- common/autotest_common.sh@10 -- # set +x 00:28:10.721 08:35:56 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:10.721 00:28:10.721 real 21m29.369s 00:28:10.721 user 62m11.915s 00:28:10.721 sys 5m6.251s 00:28:10.721 08:35:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:10.721 08:35:56 -- common/autotest_common.sh@10 -- # set +x 00:28:10.721 ************************************ 00:28:10.721 END TEST nvmf_tcp 00:28:10.721 ************************************ 00:28:10.721 08:35:56 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:10.721 08:35:56 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:10.721 08:35:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:10.721 08:35:56 -- common/autotest_common.sh@10 -- # set +x 00:28:10.721 ************************************ 00:28:10.721 START TEST spdkcli_nvmf_tcp 00:28:10.721 ************************************ 00:28:10.721 08:35:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:10.721 * Looking for test storage... 00:28:10.721 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:10.721 08:35:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:10.721 08:35:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:10.721 08:35:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:10.721 08:35:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:10.721 08:35:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:10.721 08:35:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:10.721 08:35:56 -- scripts/common.sh@335 -- # IFS=.-: 00:28:10.721 08:35:56 -- scripts/common.sh@335 -- # read -ra ver1 00:28:10.721 08:35:56 -- scripts/common.sh@336 -- # IFS=.-: 00:28:10.721 08:35:56 -- scripts/common.sh@336 -- # read -ra ver2 00:28:10.721 08:35:56 -- scripts/common.sh@337 -- # local 'op=<' 00:28:10.721 08:35:56 -- scripts/common.sh@339 -- # ver1_l=2 00:28:10.721 08:35:56 -- scripts/common.sh@340 -- # ver2_l=1 00:28:10.721 08:35:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:10.721 08:35:56 -- scripts/common.sh@343 -- # case "$op" in 00:28:10.721 08:35:56 -- scripts/common.sh@344 -- # : 1 00:28:10.721 08:35:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:10.721 08:35:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:10.721 08:35:56 -- scripts/common.sh@364 -- # decimal 1 00:28:10.721 08:35:56 -- scripts/common.sh@352 -- # local d=1 00:28:10.721 08:35:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:10.721 08:35:56 -- scripts/common.sh@354 -- # echo 1 00:28:10.721 08:35:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:10.721 08:35:56 -- scripts/common.sh@365 -- # decimal 2 00:28:10.721 08:35:56 -- scripts/common.sh@352 -- # local d=2 00:28:10.721 08:35:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:10.721 08:35:56 -- scripts/common.sh@354 -- # echo 2 00:28:10.721 08:35:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:10.721 08:35:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:10.721 08:35:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:10.721 08:35:56 -- scripts/common.sh@367 -- # return 0 00:28:10.721 08:35:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:10.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.721 --rc genhtml_branch_coverage=1 00:28:10.721 --rc genhtml_function_coverage=1 00:28:10.721 --rc genhtml_legend=1 00:28:10.721 --rc geninfo_all_blocks=1 00:28:10.721 --rc geninfo_unexecuted_blocks=1 00:28:10.721 00:28:10.721 ' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:10.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.721 --rc genhtml_branch_coverage=1 00:28:10.721 --rc genhtml_function_coverage=1 00:28:10.721 --rc genhtml_legend=1 00:28:10.721 --rc geninfo_all_blocks=1 00:28:10.721 --rc geninfo_unexecuted_blocks=1 00:28:10.721 00:28:10.721 ' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:10.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.721 --rc genhtml_branch_coverage=1 00:28:10.721 --rc genhtml_function_coverage=1 00:28:10.721 --rc genhtml_legend=1 00:28:10.721 --rc geninfo_all_blocks=1 00:28:10.721 --rc geninfo_unexecuted_blocks=1 00:28:10.721 00:28:10.721 ' 00:28:10.721 08:35:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:10.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.721 --rc genhtml_branch_coverage=1 00:28:10.721 --rc genhtml_function_coverage=1 00:28:10.721 --rc genhtml_legend=1 00:28:10.721 --rc geninfo_all_blocks=1 00:28:10.721 --rc geninfo_unexecuted_blocks=1 00:28:10.721 00:28:10.721 ' 00:28:10.721 08:35:56 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:10.721 08:35:56 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:10.721 08:35:56 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:10.721 08:35:56 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:10.721 08:35:56 -- nvmf/common.sh@7 -- # uname -s 00:28:10.721 08:35:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:10.721 08:35:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:10.721 08:35:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:10.721 08:35:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:10.721 08:35:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:10.721 08:35:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:10.721 08:35:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:10.721 08:35:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:10.721 08:35:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:10.721 08:35:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:10.721 08:35:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.721 08:35:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.721 08:35:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:10.721 08:35:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:10.721 08:35:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:10.721 08:35:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:10.722 08:35:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:10.722 08:35:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:10.722 08:35:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:10.722 08:35:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.722 08:35:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.722 08:35:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.722 08:35:56 -- paths/export.sh@5 -- # export PATH 00:28:10.722 08:35:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.722 08:35:56 -- nvmf/common.sh@46 -- # : 0 00:28:10.722 08:35:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:10.722 08:35:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:10.722 08:35:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:10.722 08:35:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:10.722 08:35:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:10.722 08:35:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:10.722 08:35:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:10.722 08:35:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:10.722 08:35:56 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:10.722 08:35:56 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:10.722 08:35:56 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:10.722 08:35:56 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:10.722 08:35:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:10.722 08:35:56 -- common/autotest_common.sh@10 -- # set +x 00:28:10.722 08:35:56 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:10.722 08:35:56 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1084724 00:28:10.722 08:35:56 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:10.722 08:35:56 -- spdkcli/common.sh@34 -- # waitforlisten 1084724 00:28:10.722 08:35:56 -- common/autotest_common.sh@829 -- # '[' -z 1084724 ']' 00:28:10.722 08:35:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:10.722 08:35:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:10.722 08:35:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:10.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:10.722 08:35:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:10.722 08:35:56 -- common/autotest_common.sh@10 -- # set +x 00:28:10.722 [2024-11-26 08:35:56.215805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:10.722 [2024-11-26 08:35:56.215902] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084724 ] 00:28:10.722 EAL: No free 2048 kB hugepages reported on node 1 00:28:10.722 [2024-11-26 08:35:56.272617] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:10.722 [2024-11-26 08:35:56.384086] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:10.722 [2024-11-26 08:35:56.384297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:10.722 [2024-11-26 08:35:56.384304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:11.656 08:35:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:11.656 08:35:57 -- common/autotest_common.sh@862 -- # return 0 00:28:11.656 08:35:57 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:11.656 08:35:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:11.656 08:35:57 -- common/autotest_common.sh@10 -- # set +x 00:28:11.656 08:35:57 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:11.656 08:35:57 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:11.656 08:35:57 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:11.656 08:35:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:11.656 08:35:57 -- common/autotest_common.sh@10 -- # set +x 00:28:11.656 08:35:57 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:11.656 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:11.656 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:11.656 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:11.656 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:11.656 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:11.656 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:11.656 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:11.656 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:11.656 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:11.656 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:11.656 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:11.656 ' 00:28:11.914 [2024-11-26 08:35:57.670298] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:14.445 [2024-11-26 08:35:59.876502] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:15.379 [2024-11-26 08:36:01.133046] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:17.910 [2024-11-26 08:36:03.436526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:19.811 [2024-11-26 08:36:05.438943] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:21.186 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:21.186 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:21.186 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:21.186 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:21.186 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:21.186 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:21.186 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:21.444 08:36:07 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:21.444 08:36:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:21.444 08:36:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.444 08:36:07 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:21.444 08:36:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:21.444 08:36:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.444 08:36:07 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:21.444 08:36:07 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:21.702 08:36:07 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:21.702 08:36:07 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:21.702 08:36:07 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:21.702 08:36:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:21.702 08:36:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.960 08:36:07 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:21.960 08:36:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:21.960 08:36:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.960 08:36:07 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:21.960 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:21.960 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:21.960 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:21.960 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:21.960 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:21.960 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:21.960 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:21.960 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:21.961 ' 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:27.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:27.229 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:27.229 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:27.229 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:27.229 08:36:12 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:27.229 08:36:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:27.229 08:36:12 -- common/autotest_common.sh@10 -- # set +x 00:28:27.229 08:36:12 -- spdkcli/nvmf.sh@90 -- # killprocess 1084724 00:28:27.229 08:36:12 -- common/autotest_common.sh@936 -- # '[' -z 1084724 ']' 00:28:27.229 08:36:12 -- common/autotest_common.sh@940 -- # kill -0 1084724 00:28:27.229 08:36:12 -- common/autotest_common.sh@941 -- # uname 00:28:27.229 08:36:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.229 08:36:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1084724 00:28:27.229 08:36:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:27.229 08:36:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:27.229 08:36:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1084724' 00:28:27.229 killing process with pid 1084724 00:28:27.229 08:36:12 -- common/autotest_common.sh@955 -- # kill 1084724 00:28:27.229 [2024-11-26 08:36:12.990237] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:27.229 08:36:12 -- common/autotest_common.sh@960 -- # wait 1084724 00:28:27.488 08:36:13 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:27.488 08:36:13 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:27.488 08:36:13 -- spdkcli/common.sh@13 -- # '[' -n 1084724 ']' 00:28:27.488 08:36:13 -- spdkcli/common.sh@14 -- # killprocess 1084724 00:28:27.488 08:36:13 -- common/autotest_common.sh@936 -- # '[' -z 1084724 ']' 00:28:27.488 08:36:13 -- common/autotest_common.sh@940 -- # kill -0 1084724 00:28:27.488 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1084724) - No such process 00:28:27.488 08:36:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1084724 is not found' 00:28:27.488 Process with pid 1084724 is not found 00:28:27.488 08:36:13 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:27.488 08:36:13 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:27.488 08:36:13 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:27.488 00:28:27.488 real 0m17.227s 00:28:27.488 user 0m36.874s 00:28:27.488 sys 0m0.822s 00:28:27.488 08:36:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:27.488 08:36:13 -- common/autotest_common.sh@10 -- # set +x 00:28:27.488 ************************************ 00:28:27.488 END TEST spdkcli_nvmf_tcp 00:28:27.488 ************************************ 00:28:27.488 08:36:13 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:27.488 08:36:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:27.488 08:36:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:27.488 08:36:13 -- common/autotest_common.sh@10 -- # set +x 00:28:27.488 ************************************ 00:28:27.488 START TEST nvmf_identify_passthru 00:28:27.488 ************************************ 00:28:27.488 08:36:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:27.488 * Looking for test storage... 00:28:27.488 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:27.488 08:36:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:27.488 08:36:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:27.488 08:36:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:27.747 08:36:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:27.747 08:36:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:27.747 08:36:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:27.747 08:36:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:27.747 08:36:13 -- scripts/common.sh@335 -- # IFS=.-: 00:28:27.747 08:36:13 -- scripts/common.sh@335 -- # read -ra ver1 00:28:27.747 08:36:13 -- scripts/common.sh@336 -- # IFS=.-: 00:28:27.747 08:36:13 -- scripts/common.sh@336 -- # read -ra ver2 00:28:27.747 08:36:13 -- scripts/common.sh@337 -- # local 'op=<' 00:28:27.747 08:36:13 -- scripts/common.sh@339 -- # ver1_l=2 00:28:27.747 08:36:13 -- scripts/common.sh@340 -- # ver2_l=1 00:28:27.747 08:36:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:27.747 08:36:13 -- scripts/common.sh@343 -- # case "$op" in 00:28:27.747 08:36:13 -- scripts/common.sh@344 -- # : 1 00:28:27.747 08:36:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:27.747 08:36:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:27.747 08:36:13 -- scripts/common.sh@364 -- # decimal 1 00:28:27.747 08:36:13 -- scripts/common.sh@352 -- # local d=1 00:28:27.747 08:36:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:27.747 08:36:13 -- scripts/common.sh@354 -- # echo 1 00:28:27.747 08:36:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:27.747 08:36:13 -- scripts/common.sh@365 -- # decimal 2 00:28:27.748 08:36:13 -- scripts/common.sh@352 -- # local d=2 00:28:27.748 08:36:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:27.748 08:36:13 -- scripts/common.sh@354 -- # echo 2 00:28:27.748 08:36:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:27.748 08:36:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:27.748 08:36:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:27.748 08:36:13 -- scripts/common.sh@367 -- # return 0 00:28:27.748 08:36:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:27.748 08:36:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:27.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.748 --rc genhtml_branch_coverage=1 00:28:27.748 --rc genhtml_function_coverage=1 00:28:27.748 --rc genhtml_legend=1 00:28:27.748 --rc geninfo_all_blocks=1 00:28:27.748 --rc geninfo_unexecuted_blocks=1 00:28:27.748 00:28:27.748 ' 00:28:27.748 08:36:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:27.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.748 --rc genhtml_branch_coverage=1 00:28:27.748 --rc genhtml_function_coverage=1 00:28:27.748 --rc genhtml_legend=1 00:28:27.748 --rc geninfo_all_blocks=1 00:28:27.748 --rc geninfo_unexecuted_blocks=1 00:28:27.748 00:28:27.748 ' 00:28:27.748 08:36:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:27.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.748 --rc genhtml_branch_coverage=1 00:28:27.748 --rc genhtml_function_coverage=1 00:28:27.748 --rc genhtml_legend=1 00:28:27.748 --rc geninfo_all_blocks=1 00:28:27.748 --rc geninfo_unexecuted_blocks=1 00:28:27.748 00:28:27.748 ' 00:28:27.748 08:36:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:27.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.748 --rc genhtml_branch_coverage=1 00:28:27.748 --rc genhtml_function_coverage=1 00:28:27.748 --rc genhtml_legend=1 00:28:27.748 --rc geninfo_all_blocks=1 00:28:27.748 --rc geninfo_unexecuted_blocks=1 00:28:27.748 00:28:27.748 ' 00:28:27.748 08:36:13 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:27.748 08:36:13 -- nvmf/common.sh@7 -- # uname -s 00:28:27.748 08:36:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:27.748 08:36:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:27.748 08:36:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:27.748 08:36:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:27.748 08:36:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:27.748 08:36:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:27.748 08:36:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:27.748 08:36:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:27.748 08:36:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:27.748 08:36:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:27.748 08:36:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:27.748 08:36:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:27.748 08:36:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:27.748 08:36:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:27.748 08:36:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:27.748 08:36:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:27.748 08:36:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:27.748 08:36:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:27.748 08:36:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:27.748 08:36:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@5 -- # export PATH 00:28:27.748 08:36:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- nvmf/common.sh@46 -- # : 0 00:28:27.748 08:36:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:27.748 08:36:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:27.748 08:36:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:27.748 08:36:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:27.748 08:36:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:27.748 08:36:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:27.748 08:36:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:27.748 08:36:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:27.748 08:36:13 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:27.748 08:36:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:27.748 08:36:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:27.748 08:36:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:27.748 08:36:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- paths/export.sh@5 -- # export PATH 00:28:27.748 08:36:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.748 08:36:13 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:27.749 08:36:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:27.749 08:36:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:27.749 08:36:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:27.749 08:36:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:27.749 08:36:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:27.749 08:36:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:27.749 08:36:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:27.749 08:36:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:27.749 08:36:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:27.749 08:36:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:27.749 08:36:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:27.749 08:36:13 -- common/autotest_common.sh@10 -- # set +x 00:28:29.685 08:36:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:29.685 08:36:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:29.685 08:36:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:29.685 08:36:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:29.685 08:36:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:29.685 08:36:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:29.685 08:36:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:29.685 08:36:15 -- nvmf/common.sh@294 -- # net_devs=() 00:28:29.685 08:36:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:29.685 08:36:15 -- nvmf/common.sh@295 -- # e810=() 00:28:29.685 08:36:15 -- nvmf/common.sh@295 -- # local -ga e810 00:28:29.685 08:36:15 -- nvmf/common.sh@296 -- # x722=() 00:28:29.685 08:36:15 -- nvmf/common.sh@296 -- # local -ga x722 00:28:29.685 08:36:15 -- nvmf/common.sh@297 -- # mlx=() 00:28:29.685 08:36:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:29.685 08:36:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:29.685 08:36:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:29.685 08:36:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:29.685 08:36:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:29.685 08:36:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.685 08:36:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:29.685 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:29.685 08:36:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.685 08:36:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:29.685 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:29.685 08:36:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.685 08:36:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:29.686 08:36:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.686 08:36:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.686 08:36:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.686 08:36:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.686 08:36:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:29.686 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:29.686 08:36:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.686 08:36:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.686 08:36:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.686 08:36:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.686 08:36:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.686 08:36:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:29.686 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:29.686 08:36:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.686 08:36:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:29.686 08:36:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:29.686 08:36:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:29.686 08:36:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:29.686 08:36:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:29.686 08:36:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:29.686 08:36:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:29.686 08:36:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:29.686 08:36:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:29.686 08:36:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:29.686 08:36:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:29.686 08:36:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:29.686 08:36:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:29.686 08:36:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:29.686 08:36:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:29.686 08:36:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:29.686 08:36:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:29.686 08:36:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:29.686 08:36:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:29.686 08:36:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:29.686 08:36:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:29.686 08:36:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:29.686 08:36:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:29.686 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:29.686 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:28:29.686 00:28:29.686 --- 10.0.0.2 ping statistics --- 00:28:29.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:29.686 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:28:29.686 08:36:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:29.686 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:29.686 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:28:29.686 00:28:29.686 --- 10.0.0.1 ping statistics --- 00:28:29.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:29.686 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:28:29.686 08:36:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:29.686 08:36:15 -- nvmf/common.sh@410 -- # return 0 00:28:29.686 08:36:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:29.686 08:36:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:29.686 08:36:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:29.686 08:36:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:29.686 08:36:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:29.686 08:36:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:29.686 08:36:15 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:29.686 08:36:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:29.686 08:36:15 -- common/autotest_common.sh@10 -- # set +x 00:28:29.686 08:36:15 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:29.686 08:36:15 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:29.686 08:36:15 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:29.686 08:36:15 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:29.686 08:36:15 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:29.686 08:36:15 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:29.686 08:36:15 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:29.686 08:36:15 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:29.686 08:36:15 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:29.686 08:36:15 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:29.686 08:36:15 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:29.686 08:36:15 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:29.686 08:36:15 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:29.686 08:36:15 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:29.686 08:36:15 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:29.686 08:36:15 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:29.686 08:36:15 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:29.686 08:36:15 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:29.968 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.153 08:36:19 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:34.153 08:36:19 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:34.153 08:36:19 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:34.153 08:36:19 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:34.153 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.336 08:36:23 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:38.337 08:36:23 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:38.337 08:36:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:38.337 08:36:23 -- common/autotest_common.sh@10 -- # set +x 00:28:38.337 08:36:23 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:38.337 08:36:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:38.337 08:36:23 -- common/autotest_common.sh@10 -- # set +x 00:28:38.337 08:36:23 -- target/identify_passthru.sh@31 -- # nvmfpid=1090206 00:28:38.337 08:36:23 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:38.337 08:36:23 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:38.337 08:36:23 -- target/identify_passthru.sh@35 -- # waitforlisten 1090206 00:28:38.337 08:36:23 -- common/autotest_common.sh@829 -- # '[' -z 1090206 ']' 00:28:38.337 08:36:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:38.337 08:36:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:38.337 08:36:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:38.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:38.337 08:36:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:38.337 08:36:23 -- common/autotest_common.sh@10 -- # set +x 00:28:38.337 [2024-11-26 08:36:23.982845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:38.337 [2024-11-26 08:36:23.982947] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:38.337 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.337 [2024-11-26 08:36:24.047477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:38.337 [2024-11-26 08:36:24.154088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:38.337 [2024-11-26 08:36:24.154247] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:38.337 [2024-11-26 08:36:24.154263] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:38.337 [2024-11-26 08:36:24.154277] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:38.337 [2024-11-26 08:36:24.154330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:38.337 [2024-11-26 08:36:24.154392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:38.337 [2024-11-26 08:36:24.154458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:38.337 [2024-11-26 08:36:24.154461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:38.595 08:36:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:38.595 08:36:24 -- common/autotest_common.sh@862 -- # return 0 00:28:38.595 08:36:24 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:38.595 08:36:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.595 08:36:24 -- common/autotest_common.sh@10 -- # set +x 00:28:38.595 INFO: Log level set to 20 00:28:38.595 INFO: Requests: 00:28:38.595 { 00:28:38.595 "jsonrpc": "2.0", 00:28:38.595 "method": "nvmf_set_config", 00:28:38.595 "id": 1, 00:28:38.595 "params": { 00:28:38.595 "admin_cmd_passthru": { 00:28:38.595 "identify_ctrlr": true 00:28:38.595 } 00:28:38.595 } 00:28:38.595 } 00:28:38.595 00:28:38.595 INFO: response: 00:28:38.595 { 00:28:38.595 "jsonrpc": "2.0", 00:28:38.595 "id": 1, 00:28:38.595 "result": true 00:28:38.595 } 00:28:38.595 00:28:38.595 08:36:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.595 08:36:24 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:38.595 08:36:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.595 08:36:24 -- common/autotest_common.sh@10 -- # set +x 00:28:38.595 INFO: Setting log level to 20 00:28:38.595 INFO: Setting log level to 20 00:28:38.595 INFO: Log level set to 20 00:28:38.595 INFO: Log level set to 20 00:28:38.595 INFO: Requests: 00:28:38.596 { 00:28:38.596 "jsonrpc": "2.0", 00:28:38.596 "method": "framework_start_init", 00:28:38.596 "id": 1 00:28:38.596 } 00:28:38.596 00:28:38.596 INFO: Requests: 00:28:38.596 { 00:28:38.596 "jsonrpc": "2.0", 00:28:38.596 "method": "framework_start_init", 00:28:38.596 "id": 1 00:28:38.596 } 00:28:38.596 00:28:38.596 [2024-11-26 08:36:24.316930] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:38.596 INFO: response: 00:28:38.596 { 00:28:38.596 "jsonrpc": "2.0", 00:28:38.596 "id": 1, 00:28:38.596 "result": true 00:28:38.596 } 00:28:38.596 00:28:38.596 INFO: response: 00:28:38.596 { 00:28:38.596 "jsonrpc": "2.0", 00:28:38.596 "id": 1, 00:28:38.596 "result": true 00:28:38.596 } 00:28:38.596 00:28:38.596 08:36:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.596 08:36:24 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:38.596 08:36:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.596 08:36:24 -- common/autotest_common.sh@10 -- # set +x 00:28:38.596 INFO: Setting log level to 40 00:28:38.596 INFO: Setting log level to 40 00:28:38.596 INFO: Setting log level to 40 00:28:38.596 [2024-11-26 08:36:24.326876] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:38.596 08:36:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.596 08:36:24 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:38.596 08:36:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:38.596 08:36:24 -- common/autotest_common.sh@10 -- # set +x 00:28:38.596 08:36:24 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:38.596 08:36:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.596 08:36:24 -- common/autotest_common.sh@10 -- # set +x 00:28:41.875 Nvme0n1 00:28:41.875 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.875 08:36:27 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:41.875 08:36:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.875 08:36:27 -- common/autotest_common.sh@10 -- # set +x 00:28:41.875 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.875 08:36:27 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:41.875 08:36:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.875 08:36:27 -- common/autotest_common.sh@10 -- # set +x 00:28:41.875 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.875 08:36:27 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:41.875 08:36:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.875 08:36:27 -- common/autotest_common.sh@10 -- # set +x 00:28:41.875 [2024-11-26 08:36:27.211822] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:41.875 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.875 08:36:27 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:41.875 08:36:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.875 08:36:27 -- common/autotest_common.sh@10 -- # set +x 00:28:41.875 [2024-11-26 08:36:27.219444] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:41.875 [ 00:28:41.875 { 00:28:41.875 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:41.875 "subtype": "Discovery", 00:28:41.875 "listen_addresses": [], 00:28:41.875 "allow_any_host": true, 00:28:41.875 "hosts": [] 00:28:41.875 }, 00:28:41.875 { 00:28:41.875 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:41.875 "subtype": "NVMe", 00:28:41.875 "listen_addresses": [ 00:28:41.875 { 00:28:41.875 "transport": "TCP", 00:28:41.875 "trtype": "TCP", 00:28:41.875 "adrfam": "IPv4", 00:28:41.875 "traddr": "10.0.0.2", 00:28:41.875 "trsvcid": "4420" 00:28:41.875 } 00:28:41.875 ], 00:28:41.875 "allow_any_host": true, 00:28:41.875 "hosts": [], 00:28:41.875 "serial_number": "SPDK00000000000001", 00:28:41.875 "model_number": "SPDK bdev Controller", 00:28:41.875 "max_namespaces": 1, 00:28:41.875 "min_cntlid": 1, 00:28:41.875 "max_cntlid": 65519, 00:28:41.875 "namespaces": [ 00:28:41.875 { 00:28:41.875 "nsid": 1, 00:28:41.875 "bdev_name": "Nvme0n1", 00:28:41.875 "name": "Nvme0n1", 00:28:41.875 "nguid": "506843FCE4B44E99BAABD6C49B4706A5", 00:28:41.875 "uuid": "506843fc-e4b4-4e99-baab-d6c49b4706a5" 00:28:41.875 } 00:28:41.875 ] 00:28:41.875 } 00:28:41.875 ] 00:28:41.875 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.875 08:36:27 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:41.875 08:36:27 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:41.875 08:36:27 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:41.875 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.875 08:36:27 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:41.875 08:36:27 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:41.875 08:36:27 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:41.875 08:36:27 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:41.876 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.876 08:36:27 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:41.876 08:36:27 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:41.876 08:36:27 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:41.876 08:36:27 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:41.876 08:36:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.876 08:36:27 -- common/autotest_common.sh@10 -- # set +x 00:28:41.876 08:36:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.876 08:36:27 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:41.876 08:36:27 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:41.876 08:36:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:41.876 08:36:27 -- nvmf/common.sh@116 -- # sync 00:28:41.876 08:36:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:41.876 08:36:27 -- nvmf/common.sh@119 -- # set +e 00:28:41.876 08:36:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:41.876 08:36:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:41.876 rmmod nvme_tcp 00:28:41.876 rmmod nvme_fabrics 00:28:41.876 rmmod nvme_keyring 00:28:41.876 08:36:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:41.876 08:36:27 -- nvmf/common.sh@123 -- # set -e 00:28:41.876 08:36:27 -- nvmf/common.sh@124 -- # return 0 00:28:41.876 08:36:27 -- nvmf/common.sh@477 -- # '[' -n 1090206 ']' 00:28:41.876 08:36:27 -- nvmf/common.sh@478 -- # killprocess 1090206 00:28:41.876 08:36:27 -- common/autotest_common.sh@936 -- # '[' -z 1090206 ']' 00:28:41.876 08:36:27 -- common/autotest_common.sh@940 -- # kill -0 1090206 00:28:41.876 08:36:27 -- common/autotest_common.sh@941 -- # uname 00:28:41.876 08:36:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:41.876 08:36:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1090206 00:28:42.132 08:36:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:42.133 08:36:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:42.133 08:36:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1090206' 00:28:42.133 killing process with pid 1090206 00:28:42.133 08:36:27 -- common/autotest_common.sh@955 -- # kill 1090206 00:28:42.133 [2024-11-26 08:36:27.743103] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:42.133 08:36:27 -- common/autotest_common.sh@960 -- # wait 1090206 00:28:44.031 08:36:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:44.031 08:36:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:44.031 08:36:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:44.031 08:36:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:44.031 08:36:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:44.031 08:36:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:44.031 08:36:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:44.031 08:36:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:45.937 08:36:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:45.937 00:28:45.937 real 0m18.141s 00:28:45.937 user 0m27.294s 00:28:45.937 sys 0m2.242s 00:28:45.937 08:36:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:45.937 08:36:31 -- common/autotest_common.sh@10 -- # set +x 00:28:45.937 ************************************ 00:28:45.937 END TEST nvmf_identify_passthru 00:28:45.937 ************************************ 00:28:45.937 08:36:31 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:45.937 08:36:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:45.937 08:36:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:45.937 08:36:31 -- common/autotest_common.sh@10 -- # set +x 00:28:45.937 ************************************ 00:28:45.937 START TEST nvmf_dif 00:28:45.937 ************************************ 00:28:45.937 08:36:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:45.937 * Looking for test storage... 00:28:45.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:45.937 08:36:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:45.937 08:36:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:45.937 08:36:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:45.938 08:36:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:45.938 08:36:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:45.938 08:36:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:45.938 08:36:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:45.938 08:36:31 -- scripts/common.sh@335 -- # IFS=.-: 00:28:45.938 08:36:31 -- scripts/common.sh@335 -- # read -ra ver1 00:28:45.938 08:36:31 -- scripts/common.sh@336 -- # IFS=.-: 00:28:45.938 08:36:31 -- scripts/common.sh@336 -- # read -ra ver2 00:28:45.938 08:36:31 -- scripts/common.sh@337 -- # local 'op=<' 00:28:45.938 08:36:31 -- scripts/common.sh@339 -- # ver1_l=2 00:28:45.938 08:36:31 -- scripts/common.sh@340 -- # ver2_l=1 00:28:45.938 08:36:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:45.938 08:36:31 -- scripts/common.sh@343 -- # case "$op" in 00:28:45.938 08:36:31 -- scripts/common.sh@344 -- # : 1 00:28:45.938 08:36:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:45.938 08:36:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:45.938 08:36:31 -- scripts/common.sh@364 -- # decimal 1 00:28:45.938 08:36:31 -- scripts/common.sh@352 -- # local d=1 00:28:45.938 08:36:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:45.938 08:36:31 -- scripts/common.sh@354 -- # echo 1 00:28:45.938 08:36:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:45.938 08:36:31 -- scripts/common.sh@365 -- # decimal 2 00:28:45.938 08:36:31 -- scripts/common.sh@352 -- # local d=2 00:28:45.938 08:36:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:45.938 08:36:31 -- scripts/common.sh@354 -- # echo 2 00:28:45.938 08:36:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:45.938 08:36:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:45.938 08:36:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:45.938 08:36:31 -- scripts/common.sh@367 -- # return 0 00:28:45.938 08:36:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:45.938 08:36:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:45.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.938 --rc genhtml_branch_coverage=1 00:28:45.938 --rc genhtml_function_coverage=1 00:28:45.938 --rc genhtml_legend=1 00:28:45.938 --rc geninfo_all_blocks=1 00:28:45.938 --rc geninfo_unexecuted_blocks=1 00:28:45.938 00:28:45.938 ' 00:28:45.938 08:36:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:45.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.938 --rc genhtml_branch_coverage=1 00:28:45.938 --rc genhtml_function_coverage=1 00:28:45.938 --rc genhtml_legend=1 00:28:45.938 --rc geninfo_all_blocks=1 00:28:45.938 --rc geninfo_unexecuted_blocks=1 00:28:45.938 00:28:45.938 ' 00:28:45.938 08:36:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:45.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.938 --rc genhtml_branch_coverage=1 00:28:45.938 --rc genhtml_function_coverage=1 00:28:45.938 --rc genhtml_legend=1 00:28:45.938 --rc geninfo_all_blocks=1 00:28:45.938 --rc geninfo_unexecuted_blocks=1 00:28:45.938 00:28:45.938 ' 00:28:45.938 08:36:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:45.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.938 --rc genhtml_branch_coverage=1 00:28:45.938 --rc genhtml_function_coverage=1 00:28:45.938 --rc genhtml_legend=1 00:28:45.938 --rc geninfo_all_blocks=1 00:28:45.938 --rc geninfo_unexecuted_blocks=1 00:28:45.938 00:28:45.938 ' 00:28:45.938 08:36:31 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:45.938 08:36:31 -- nvmf/common.sh@7 -- # uname -s 00:28:45.938 08:36:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:45.938 08:36:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:45.938 08:36:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:45.938 08:36:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:45.938 08:36:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:45.938 08:36:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:45.938 08:36:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:45.938 08:36:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:45.938 08:36:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:45.938 08:36:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:45.938 08:36:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:45.938 08:36:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:45.938 08:36:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:45.938 08:36:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:45.938 08:36:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:45.938 08:36:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:45.938 08:36:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:45.938 08:36:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:45.938 08:36:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:45.938 08:36:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.938 08:36:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.938 08:36:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.938 08:36:31 -- paths/export.sh@5 -- # export PATH 00:28:45.938 08:36:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.938 08:36:31 -- nvmf/common.sh@46 -- # : 0 00:28:45.938 08:36:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:45.938 08:36:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:45.938 08:36:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:45.938 08:36:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:45.938 08:36:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:45.938 08:36:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:45.938 08:36:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:45.938 08:36:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:45.938 08:36:31 -- target/dif.sh@15 -- # NULL_META=16 00:28:45.938 08:36:31 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:45.938 08:36:31 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:45.938 08:36:31 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:45.938 08:36:31 -- target/dif.sh@135 -- # nvmftestinit 00:28:45.938 08:36:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:45.938 08:36:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:45.938 08:36:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:45.938 08:36:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:45.938 08:36:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:45.938 08:36:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.938 08:36:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:45.938 08:36:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:45.938 08:36:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:45.938 08:36:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:45.938 08:36:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:45.938 08:36:31 -- common/autotest_common.sh@10 -- # set +x 00:28:47.840 08:36:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:47.840 08:36:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:47.840 08:36:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:47.840 08:36:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:47.840 08:36:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:47.840 08:36:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:47.840 08:36:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:47.840 08:36:33 -- nvmf/common.sh@294 -- # net_devs=() 00:28:47.840 08:36:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:47.840 08:36:33 -- nvmf/common.sh@295 -- # e810=() 00:28:47.840 08:36:33 -- nvmf/common.sh@295 -- # local -ga e810 00:28:47.840 08:36:33 -- nvmf/common.sh@296 -- # x722=() 00:28:47.840 08:36:33 -- nvmf/common.sh@296 -- # local -ga x722 00:28:47.840 08:36:33 -- nvmf/common.sh@297 -- # mlx=() 00:28:47.840 08:36:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:47.840 08:36:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:47.840 08:36:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:47.840 08:36:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:47.840 08:36:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:47.840 08:36:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:47.840 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:47.840 08:36:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:47.840 08:36:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:47.840 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:47.840 08:36:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:47.840 08:36:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:47.840 08:36:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:47.840 08:36:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:47.840 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:47.840 08:36:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:47.840 08:36:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:47.840 08:36:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:47.840 08:36:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:47.840 08:36:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:47.840 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:47.840 08:36:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:47.840 08:36:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:47.840 08:36:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:47.840 08:36:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:47.840 08:36:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:47.840 08:36:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:47.840 08:36:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:47.840 08:36:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:47.840 08:36:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:47.840 08:36:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:47.840 08:36:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:47.840 08:36:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:47.840 08:36:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:47.840 08:36:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:47.840 08:36:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:47.840 08:36:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:47.840 08:36:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:47.840 08:36:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:47.840 08:36:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:47.840 08:36:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:47.840 08:36:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:47.840 08:36:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:47.840 08:36:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:47.840 08:36:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:47.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:47.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:28:47.840 00:28:47.840 --- 10.0.0.2 ping statistics --- 00:28:47.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:47.840 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:28:47.840 08:36:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:47.840 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:47.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:28:47.841 00:28:47.841 --- 10.0.0.1 ping statistics --- 00:28:47.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:47.841 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:28:47.841 08:36:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:47.841 08:36:33 -- nvmf/common.sh@410 -- # return 0 00:28:47.841 08:36:33 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:47.841 08:36:33 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:49.216 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:49.216 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:49.216 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:49.216 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:49.216 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:49.216 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:49.216 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:49.216 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:49.216 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:49.216 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:49.216 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:49.216 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:49.216 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:49.216 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:49.216 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:49.216 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:49.216 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:49.216 08:36:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:49.216 08:36:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:49.216 08:36:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:49.216 08:36:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:49.216 08:36:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:49.216 08:36:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:49.216 08:36:34 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:49.216 08:36:34 -- target/dif.sh@137 -- # nvmfappstart 00:28:49.216 08:36:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:49.216 08:36:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:49.216 08:36:34 -- common/autotest_common.sh@10 -- # set +x 00:28:49.216 08:36:34 -- nvmf/common.sh@469 -- # nvmfpid=1093412 00:28:49.216 08:36:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:49.216 08:36:34 -- nvmf/common.sh@470 -- # waitforlisten 1093412 00:28:49.216 08:36:34 -- common/autotest_common.sh@829 -- # '[' -z 1093412 ']' 00:28:49.216 08:36:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:49.216 08:36:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:49.216 08:36:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:49.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:49.216 08:36:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:49.216 08:36:34 -- common/autotest_common.sh@10 -- # set +x 00:28:49.216 [2024-11-26 08:36:35.009922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:49.216 [2024-11-26 08:36:35.010012] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:49.216 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.475 [2024-11-26 08:36:35.078888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:49.475 [2024-11-26 08:36:35.193946] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:49.475 [2024-11-26 08:36:35.194114] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:49.475 [2024-11-26 08:36:35.194134] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:49.475 [2024-11-26 08:36:35.194148] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:49.475 [2024-11-26 08:36:35.194192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:50.409 08:36:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:50.409 08:36:35 -- common/autotest_common.sh@862 -- # return 0 00:28:50.409 08:36:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:50.409 08:36:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:50.409 08:36:35 -- common/autotest_common.sh@10 -- # set +x 00:28:50.409 08:36:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:50.409 08:36:35 -- target/dif.sh@139 -- # create_transport 00:28:50.409 08:36:35 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:50.409 08:36:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.409 08:36:35 -- common/autotest_common.sh@10 -- # set +x 00:28:50.409 [2024-11-26 08:36:35.994941] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:50.409 08:36:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.410 08:36:35 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:50.410 08:36:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:50.410 08:36:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:50.410 08:36:35 -- common/autotest_common.sh@10 -- # set +x 00:28:50.410 ************************************ 00:28:50.410 START TEST fio_dif_1_default 00:28:50.410 ************************************ 00:28:50.410 08:36:36 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:50.410 08:36:36 -- target/dif.sh@86 -- # create_subsystems 0 00:28:50.410 08:36:36 -- target/dif.sh@28 -- # local sub 00:28:50.410 08:36:36 -- target/dif.sh@30 -- # for sub in "$@" 00:28:50.410 08:36:36 -- target/dif.sh@31 -- # create_subsystem 0 00:28:50.410 08:36:36 -- target/dif.sh@18 -- # local sub_id=0 00:28:50.410 08:36:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:50.410 08:36:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.410 08:36:36 -- common/autotest_common.sh@10 -- # set +x 00:28:50.410 bdev_null0 00:28:50.410 08:36:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.410 08:36:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:50.410 08:36:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.410 08:36:36 -- common/autotest_common.sh@10 -- # set +x 00:28:50.410 08:36:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.410 08:36:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:50.410 08:36:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.410 08:36:36 -- common/autotest_common.sh@10 -- # set +x 00:28:50.410 08:36:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.410 08:36:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:50.410 08:36:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.410 08:36:36 -- common/autotest_common.sh@10 -- # set +x 00:28:50.410 [2024-11-26 08:36:36.031204] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:50.410 08:36:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.410 08:36:36 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:50.410 08:36:36 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:50.410 08:36:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:50.410 08:36:36 -- nvmf/common.sh@520 -- # config=() 00:28:50.410 08:36:36 -- nvmf/common.sh@520 -- # local subsystem config 00:28:50.410 08:36:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:50.410 08:36:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.410 08:36:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:50.410 { 00:28:50.410 "params": { 00:28:50.410 "name": "Nvme$subsystem", 00:28:50.410 "trtype": "$TEST_TRANSPORT", 00:28:50.410 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:50.410 "adrfam": "ipv4", 00:28:50.410 "trsvcid": "$NVMF_PORT", 00:28:50.410 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:50.410 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:50.410 "hdgst": ${hdgst:-false}, 00:28:50.410 "ddgst": ${ddgst:-false} 00:28:50.410 }, 00:28:50.410 "method": "bdev_nvme_attach_controller" 00:28:50.410 } 00:28:50.410 EOF 00:28:50.410 )") 00:28:50.410 08:36:36 -- target/dif.sh@82 -- # gen_fio_conf 00:28:50.410 08:36:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.410 08:36:36 -- target/dif.sh@54 -- # local file 00:28:50.410 08:36:36 -- target/dif.sh@56 -- # cat 00:28:50.410 08:36:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:50.410 08:36:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:50.410 08:36:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:50.410 08:36:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.410 08:36:36 -- common/autotest_common.sh@1330 -- # shift 00:28:50.410 08:36:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:50.410 08:36:36 -- nvmf/common.sh@542 -- # cat 00:28:50.410 08:36:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:50.410 08:36:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:50.410 08:36:36 -- target/dif.sh@72 -- # (( file <= files )) 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:50.410 08:36:36 -- nvmf/common.sh@544 -- # jq . 00:28:50.410 08:36:36 -- nvmf/common.sh@545 -- # IFS=, 00:28:50.410 08:36:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:50.410 "params": { 00:28:50.410 "name": "Nvme0", 00:28:50.410 "trtype": "tcp", 00:28:50.410 "traddr": "10.0.0.2", 00:28:50.410 "adrfam": "ipv4", 00:28:50.410 "trsvcid": "4420", 00:28:50.410 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:50.410 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:50.410 "hdgst": false, 00:28:50.410 "ddgst": false 00:28:50.410 }, 00:28:50.410 "method": "bdev_nvme_attach_controller" 00:28:50.410 }' 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:50.410 08:36:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:50.410 08:36:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:50.410 08:36:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:50.410 08:36:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:50.410 08:36:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:50.410 08:36:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.668 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:50.668 fio-3.35 00:28:50.668 Starting 1 thread 00:28:50.668 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.927 [2024-11-26 08:36:36.714084] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:50.927 [2024-11-26 08:36:36.714183] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:03.126 00:29:03.126 filename0: (groupid=0, jobs=1): err= 0: pid=1093774: Tue Nov 26 08:36:46 2024 00:29:03.126 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:29:03.126 slat (nsec): min=6555, max=67233, avg=8628.18, stdev=3743.89 00:29:03.126 clat (usec): min=40776, max=45179, avg=40989.67, stdev=268.99 00:29:03.126 lat (usec): min=40783, max=45240, avg=40998.29, stdev=269.80 00:29:03.126 clat percentiles (usec): 00:29:03.126 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:03.126 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:03.126 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:03.126 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45351], 99.95th=[45351], 00:29:03.126 | 99.99th=[45351] 00:29:03.126 bw ( KiB/s): min= 384, max= 416, per=99.47%, avg=388.80, stdev=11.72, samples=20 00:29:03.126 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:03.126 lat (msec) : 50=100.00% 00:29:03.126 cpu : usr=91.50%, sys=8.21%, ctx=22, majf=0, minf=308 00:29:03.126 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:03.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:03.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:03.126 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:03.126 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:03.126 00:29:03.126 Run status group 0 (all jobs): 00:29:03.126 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10009-10009msec 00:29:03.126 08:36:47 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:03.126 08:36:47 -- target/dif.sh@43 -- # local sub 00:29:03.126 08:36:47 -- target/dif.sh@45 -- # for sub in "$@" 00:29:03.126 08:36:47 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:03.126 08:36:47 -- target/dif.sh@36 -- # local sub_id=0 00:29:03.126 08:36:47 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:03.126 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.126 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.126 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.126 08:36:47 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:03.126 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.126 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.126 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.126 00:29:03.126 real 0m11.091s 00:29:03.126 user 0m10.172s 00:29:03.126 sys 0m1.080s 00:29:03.126 08:36:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:03.126 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.126 ************************************ 00:29:03.126 END TEST fio_dif_1_default 00:29:03.126 ************************************ 00:29:03.126 08:36:47 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:03.126 08:36:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:03.126 08:36:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:03.126 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.126 ************************************ 00:29:03.126 START TEST fio_dif_1_multi_subsystems 00:29:03.126 ************************************ 00:29:03.126 08:36:47 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:03.126 08:36:47 -- target/dif.sh@92 -- # local files=1 00:29:03.126 08:36:47 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:03.126 08:36:47 -- target/dif.sh@28 -- # local sub 00:29:03.126 08:36:47 -- target/dif.sh@30 -- # for sub in "$@" 00:29:03.126 08:36:47 -- target/dif.sh@31 -- # create_subsystem 0 00:29:03.126 08:36:47 -- target/dif.sh@18 -- # local sub_id=0 00:29:03.126 08:36:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 bdev_null0 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 [2024-11-26 08:36:47.153494] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@30 -- # for sub in "$@" 00:29:03.127 08:36:47 -- target/dif.sh@31 -- # create_subsystem 1 00:29:03.127 08:36:47 -- target/dif.sh@18 -- # local sub_id=1 00:29:03.127 08:36:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 bdev_null1 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:03.127 08:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.127 08:36:47 -- common/autotest_common.sh@10 -- # set +x 00:29:03.127 08:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.127 08:36:47 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:03.127 08:36:47 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:03.127 08:36:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:03.127 08:36:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:03.127 08:36:47 -- nvmf/common.sh@520 -- # config=() 00:29:03.127 08:36:47 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:03.127 08:36:47 -- target/dif.sh@82 -- # gen_fio_conf 00:29:03.127 08:36:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:03.127 08:36:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:03.127 08:36:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:03.127 08:36:47 -- target/dif.sh@54 -- # local file 00:29:03.127 08:36:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:03.127 08:36:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:03.127 { 00:29:03.127 "params": { 00:29:03.127 "name": "Nvme$subsystem", 00:29:03.127 "trtype": "$TEST_TRANSPORT", 00:29:03.127 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:03.127 "adrfam": "ipv4", 00:29:03.127 "trsvcid": "$NVMF_PORT", 00:29:03.127 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:03.127 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:03.127 "hdgst": ${hdgst:-false}, 00:29:03.127 "ddgst": ${ddgst:-false} 00:29:03.127 }, 00:29:03.127 "method": "bdev_nvme_attach_controller" 00:29:03.127 } 00:29:03.127 EOF 00:29:03.127 )") 00:29:03.127 08:36:47 -- target/dif.sh@56 -- # cat 00:29:03.127 08:36:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:03.127 08:36:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:03.127 08:36:47 -- common/autotest_common.sh@1330 -- # shift 00:29:03.127 08:36:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:03.127 08:36:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:03.127 08:36:47 -- nvmf/common.sh@542 -- # cat 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:03.127 08:36:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:03.127 08:36:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:03.127 08:36:47 -- target/dif.sh@73 -- # cat 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:03.127 08:36:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:03.127 08:36:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:03.127 { 00:29:03.127 "params": { 00:29:03.127 "name": "Nvme$subsystem", 00:29:03.127 "trtype": "$TEST_TRANSPORT", 00:29:03.127 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:03.127 "adrfam": "ipv4", 00:29:03.127 "trsvcid": "$NVMF_PORT", 00:29:03.127 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:03.127 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:03.127 "hdgst": ${hdgst:-false}, 00:29:03.127 "ddgst": ${ddgst:-false} 00:29:03.127 }, 00:29:03.127 "method": "bdev_nvme_attach_controller" 00:29:03.127 } 00:29:03.127 EOF 00:29:03.127 )") 00:29:03.127 08:36:47 -- target/dif.sh@72 -- # (( file++ )) 00:29:03.127 08:36:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:03.127 08:36:47 -- nvmf/common.sh@542 -- # cat 00:29:03.127 08:36:47 -- nvmf/common.sh@544 -- # jq . 00:29:03.127 08:36:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:03.127 08:36:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:03.127 "params": { 00:29:03.127 "name": "Nvme0", 00:29:03.127 "trtype": "tcp", 00:29:03.127 "traddr": "10.0.0.2", 00:29:03.127 "adrfam": "ipv4", 00:29:03.127 "trsvcid": "4420", 00:29:03.127 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:03.127 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:03.127 "hdgst": false, 00:29:03.127 "ddgst": false 00:29:03.127 }, 00:29:03.127 "method": "bdev_nvme_attach_controller" 00:29:03.127 },{ 00:29:03.127 "params": { 00:29:03.127 "name": "Nvme1", 00:29:03.127 "trtype": "tcp", 00:29:03.127 "traddr": "10.0.0.2", 00:29:03.127 "adrfam": "ipv4", 00:29:03.127 "trsvcid": "4420", 00:29:03.127 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:03.127 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:03.127 "hdgst": false, 00:29:03.127 "ddgst": false 00:29:03.127 }, 00:29:03.127 "method": "bdev_nvme_attach_controller" 00:29:03.127 }' 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:03.127 08:36:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:03.127 08:36:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:03.127 08:36:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:03.127 08:36:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:03.127 08:36:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:03.127 08:36:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:03.127 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:03.127 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:03.127 fio-3.35 00:29:03.127 Starting 2 threads 00:29:03.127 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.127 [2024-11-26 08:36:48.097176] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:03.127 [2024-11-26 08:36:48.097265] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:13.094 00:29:13.094 filename0: (groupid=0, jobs=1): err= 0: pid=1095221: Tue Nov 26 08:36:58 2024 00:29:13.094 read: IOPS=188, BW=755KiB/s (774kB/s)(7584KiB/10039msec) 00:29:13.094 slat (nsec): min=6806, max=74941, avg=8584.33, stdev=2862.95 00:29:13.094 clat (usec): min=593, max=44790, avg=21152.12, stdev=20351.18 00:29:13.094 lat (usec): min=601, max=44809, avg=21160.71, stdev=20350.93 00:29:13.094 clat percentiles (usec): 00:29:13.094 | 1.00th=[ 603], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 619], 00:29:13.094 | 30.00th=[ 627], 40.00th=[ 635], 50.00th=[41157], 60.00th=[41157], 00:29:13.094 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:13.094 | 99.00th=[41157], 99.50th=[41157], 99.90th=[44827], 99.95th=[44827], 00:29:13.094 | 99.99th=[44827] 00:29:13.094 bw ( KiB/s): min= 672, max= 768, per=66.44%, avg=756.80, stdev=28.00, samples=20 00:29:13.094 iops : min= 168, max= 192, avg=189.20, stdev= 7.00, samples=20 00:29:13.094 lat (usec) : 750=48.31%, 1000=0.69% 00:29:13.094 lat (msec) : 2=0.58%, 50=50.42% 00:29:13.094 cpu : usr=95.60%, sys=4.09%, ctx=20, majf=0, minf=184 00:29:13.094 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.094 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.094 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.094 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:13.094 filename1: (groupid=0, jobs=1): err= 0: pid=1095222: Tue Nov 26 08:36:58 2024 00:29:13.094 read: IOPS=95, BW=382KiB/s (392kB/s)(3840KiB/10040msec) 00:29:13.094 slat (nsec): min=6842, max=34250, avg=8483.60, stdev=2384.54 00:29:13.094 clat (usec): min=40908, max=44840, avg=41806.06, stdev=429.71 00:29:13.094 lat (usec): min=40915, max=44874, avg=41814.54, stdev=429.97 00:29:13.094 clat percentiles (usec): 00:29:13.094 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41681], 00:29:13.095 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:29:13.095 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:29:13.095 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:29:13.095 | 99.99th=[44827] 00:29:13.095 bw ( KiB/s): min= 352, max= 416, per=33.57%, avg=382.40, stdev=12.61, samples=20 00:29:13.095 iops : min= 88, max= 104, avg=95.60, stdev= 3.15, samples=20 00:29:13.095 lat (msec) : 50=100.00% 00:29:13.095 cpu : usr=95.30%, sys=4.40%, ctx=15, majf=0, minf=160 00:29:13.095 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.095 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.095 issued rwts: total=960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.095 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:13.095 00:29:13.095 Run status group 0 (all jobs): 00:29:13.095 READ: bw=1138KiB/s (1165kB/s), 382KiB/s-755KiB/s (392kB/s-774kB/s), io=11.2MiB (11.7MB), run=10039-10040msec 00:29:13.095 08:36:58 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:13.095 08:36:58 -- target/dif.sh@43 -- # local sub 00:29:13.095 08:36:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.095 08:36:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:13.095 08:36:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:13.095 08:36:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.095 08:36:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:13.095 08:36:58 -- target/dif.sh@36 -- # local sub_id=1 00:29:13.095 08:36:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 00:29:13.095 real 0m11.498s 00:29:13.095 user 0m20.635s 00:29:13.095 sys 0m1.133s 00:29:13.095 08:36:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 ************************************ 00:29:13.095 END TEST fio_dif_1_multi_subsystems 00:29:13.095 ************************************ 00:29:13.095 08:36:58 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:13.095 08:36:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:13.095 08:36:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 ************************************ 00:29:13.095 START TEST fio_dif_rand_params 00:29:13.095 ************************************ 00:29:13.095 08:36:58 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:13.095 08:36:58 -- target/dif.sh@100 -- # local NULL_DIF 00:29:13.095 08:36:58 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:13.095 08:36:58 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:13.095 08:36:58 -- target/dif.sh@103 -- # bs=128k 00:29:13.095 08:36:58 -- target/dif.sh@103 -- # numjobs=3 00:29:13.095 08:36:58 -- target/dif.sh@103 -- # iodepth=3 00:29:13.095 08:36:58 -- target/dif.sh@103 -- # runtime=5 00:29:13.095 08:36:58 -- target/dif.sh@105 -- # create_subsystems 0 00:29:13.095 08:36:58 -- target/dif.sh@28 -- # local sub 00:29:13.095 08:36:58 -- target/dif.sh@30 -- # for sub in "$@" 00:29:13.095 08:36:58 -- target/dif.sh@31 -- # create_subsystem 0 00:29:13.095 08:36:58 -- target/dif.sh@18 -- # local sub_id=0 00:29:13.095 08:36:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 bdev_null0 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:13.095 08:36:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.095 08:36:58 -- common/autotest_common.sh@10 -- # set +x 00:29:13.095 [2024-11-26 08:36:58.678014] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:13.095 08:36:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.095 08:36:58 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:13.095 08:36:58 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:13.095 08:36:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:13.095 08:36:58 -- nvmf/common.sh@520 -- # config=() 00:29:13.095 08:36:58 -- nvmf/common.sh@520 -- # local subsystem config 00:29:13.095 08:36:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.095 08:36:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:13.095 08:36:58 -- target/dif.sh@82 -- # gen_fio_conf 00:29:13.095 08:36:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.095 08:36:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:13.095 { 00:29:13.095 "params": { 00:29:13.095 "name": "Nvme$subsystem", 00:29:13.095 "trtype": "$TEST_TRANSPORT", 00:29:13.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:13.095 "adrfam": "ipv4", 00:29:13.095 "trsvcid": "$NVMF_PORT", 00:29:13.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:13.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:13.095 "hdgst": ${hdgst:-false}, 00:29:13.095 "ddgst": ${ddgst:-false} 00:29:13.095 }, 00:29:13.095 "method": "bdev_nvme_attach_controller" 00:29:13.095 } 00:29:13.095 EOF 00:29:13.095 )") 00:29:13.095 08:36:58 -- target/dif.sh@54 -- # local file 00:29:13.095 08:36:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:13.095 08:36:58 -- target/dif.sh@56 -- # cat 00:29:13.095 08:36:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:13.095 08:36:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:13.095 08:36:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.095 08:36:58 -- common/autotest_common.sh@1330 -- # shift 00:29:13.095 08:36:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:13.095 08:36:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.095 08:36:58 -- nvmf/common.sh@542 -- # cat 00:29:13.095 08:36:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:13.095 08:36:58 -- target/dif.sh@72 -- # (( file <= files )) 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.095 08:36:58 -- nvmf/common.sh@544 -- # jq . 00:29:13.095 08:36:58 -- nvmf/common.sh@545 -- # IFS=, 00:29:13.095 08:36:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:13.095 "params": { 00:29:13.095 "name": "Nvme0", 00:29:13.095 "trtype": "tcp", 00:29:13.095 "traddr": "10.0.0.2", 00:29:13.095 "adrfam": "ipv4", 00:29:13.095 "trsvcid": "4420", 00:29:13.095 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:13.095 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:13.095 "hdgst": false, 00:29:13.095 "ddgst": false 00:29:13.095 }, 00:29:13.095 "method": "bdev_nvme_attach_controller" 00:29:13.095 }' 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.095 08:36:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.095 08:36:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.095 08:36:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.095 08:36:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.095 08:36:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:13.095 08:36:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.095 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:13.095 ... 00:29:13.095 fio-3.35 00:29:13.095 Starting 3 threads 00:29:13.353 EAL: No free 2048 kB hugepages reported on node 1 00:29:13.918 [2024-11-26 08:36:59.495812] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:13.918 [2024-11-26 08:36:59.495864] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:19.181 00:29:19.181 filename0: (groupid=0, jobs=1): err= 0: pid=1096656: Tue Nov 26 08:37:04 2024 00:29:19.181 read: IOPS=231, BW=28.9MiB/s (30.3MB/s)(145MiB/5007msec) 00:29:19.181 slat (nsec): min=5823, max=63078, avg=14532.01, stdev=5048.25 00:29:19.181 clat (usec): min=4504, max=54090, avg=12961.78, stdev=7457.81 00:29:19.181 lat (usec): min=4517, max=54104, avg=12976.31, stdev=7457.75 00:29:19.181 clat percentiles (usec): 00:29:19.181 | 1.00th=[ 5014], 5.00th=[ 6718], 10.00th=[ 7767], 20.00th=[ 9241], 00:29:19.181 | 30.00th=[10421], 40.00th=[11338], 50.00th=[11994], 60.00th=[12649], 00:29:19.181 | 70.00th=[13435], 80.00th=[14222], 90.00th=[15795], 95.00th=[17171], 00:29:19.181 | 99.00th=[51119], 99.50th=[53216], 99.90th=[53740], 99.95th=[54264], 00:29:19.181 | 99.99th=[54264] 00:29:19.181 bw ( KiB/s): min=24576, max=37376, per=35.98%, avg=29542.40, stdev=3801.31, samples=10 00:29:19.181 iops : min= 192, max= 292, avg=230.80, stdev=29.70, samples=10 00:29:19.181 lat (msec) : 10=26.36%, 20=70.18%, 50=1.47%, 100=1.99% 00:29:19.181 cpu : usr=91.45%, sys=8.07%, ctx=11, majf=0, minf=149 00:29:19.181 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:19.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 issued rwts: total=1157,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.181 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:19.181 filename0: (groupid=0, jobs=1): err= 0: pid=1096657: Tue Nov 26 08:37:04 2024 00:29:19.181 read: IOPS=216, BW=27.0MiB/s (28.3MB/s)(135MiB/5004msec) 00:29:19.181 slat (nsec): min=7500, max=60548, avg=17015.52, stdev=7082.90 00:29:19.181 clat (usec): min=4507, max=90336, avg=13864.53, stdev=8597.08 00:29:19.181 lat (usec): min=4519, max=90348, avg=13881.54, stdev=8597.00 00:29:19.181 clat percentiles (usec): 00:29:19.181 | 1.00th=[ 5473], 5.00th=[ 7701], 10.00th=[ 8455], 20.00th=[ 9372], 00:29:19.181 | 30.00th=[10814], 40.00th=[11731], 50.00th=[12518], 60.00th=[13173], 00:29:19.181 | 70.00th=[13960], 80.00th=[15008], 90.00th=[16909], 95.00th=[19006], 00:29:19.181 | 99.00th=[53740], 99.50th=[54789], 99.90th=[55313], 99.95th=[90702], 00:29:19.181 | 99.99th=[90702] 00:29:19.181 bw ( KiB/s): min=14080, max=31232, per=33.61%, avg=27602.30, stdev=4927.01, samples=10 00:29:19.181 iops : min= 110, max= 244, avg=215.60, stdev=38.49, samples=10 00:29:19.181 lat (msec) : 10=23.77%, 20=71.79%, 50=1.20%, 100=3.24% 00:29:19.181 cpu : usr=89.89%, sys=7.98%, ctx=376, majf=0, minf=103 00:29:19.181 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:19.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 issued rwts: total=1081,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.181 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:19.181 filename0: (groupid=0, jobs=1): err= 0: pid=1096658: Tue Nov 26 08:37:04 2024 00:29:19.181 read: IOPS=194, BW=24.3MiB/s (25.5MB/s)(122MiB/5005msec) 00:29:19.181 slat (nsec): min=6834, max=56253, avg=13991.68, stdev=4957.94 00:29:19.181 clat (usec): min=5026, max=56980, avg=15394.47, stdev=10719.79 00:29:19.181 lat (usec): min=5037, max=56992, avg=15408.46, stdev=10719.65 00:29:19.181 clat percentiles (usec): 00:29:19.181 | 1.00th=[ 5800], 5.00th=[ 7177], 10.00th=[ 8848], 20.00th=[10552], 00:29:19.181 | 30.00th=[11338], 40.00th=[11994], 50.00th=[12780], 60.00th=[13435], 00:29:19.181 | 70.00th=[14484], 80.00th=[15664], 90.00th=[17957], 95.00th=[51119], 00:29:19.181 | 99.00th=[55313], 99.50th=[56361], 99.90th=[56886], 99.95th=[56886], 00:29:19.181 | 99.99th=[56886] 00:29:19.181 bw ( KiB/s): min=17152, max=30720, per=30.27%, avg=24857.60, stdev=3922.46, samples=10 00:29:19.181 iops : min= 134, max= 240, avg=194.20, stdev=30.64, samples=10 00:29:19.181 lat (msec) : 10=16.43%, 20=76.18%, 50=1.54%, 100=5.85% 00:29:19.181 cpu : usr=92.57%, sys=6.95%, ctx=10, majf=0, minf=49 00:29:19.181 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:19.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.181 issued rwts: total=974,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.181 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:19.181 00:29:19.181 Run status group 0 (all jobs): 00:29:19.181 READ: bw=80.2MiB/s (84.1MB/s), 24.3MiB/s-28.9MiB/s (25.5MB/s-30.3MB/s), io=402MiB (421MB), run=5004-5007msec 00:29:19.181 08:37:04 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:19.181 08:37:04 -- target/dif.sh@43 -- # local sub 00:29:19.181 08:37:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:19.181 08:37:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:19.181 08:37:04 -- target/dif.sh@36 -- # local sub_id=0 00:29:19.181 08:37:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:19.181 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.181 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.181 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.181 08:37:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:19.181 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.181 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.181 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # bs=4k 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # numjobs=8 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # iodepth=16 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # runtime= 00:29:19.181 08:37:04 -- target/dif.sh@109 -- # files=2 00:29:19.181 08:37:04 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:19.181 08:37:04 -- target/dif.sh@28 -- # local sub 00:29:19.181 08:37:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:19.181 08:37:04 -- target/dif.sh@31 -- # create_subsystem 0 00:29:19.181 08:37:04 -- target/dif.sh@18 -- # local sub_id=0 00:29:19.181 08:37:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:19.182 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 bdev_null0 00:29:19.182 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:19.182 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:19.182 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:19.182 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 [2024-11-26 08:37:04.988385] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:19.182 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:19.182 08:37:04 -- target/dif.sh@31 -- # create_subsystem 1 00:29:19.182 08:37:04 -- target/dif.sh@18 -- # local sub_id=1 00:29:19.182 08:37:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:19.182 08:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 bdev_null1 00:29:19.182 08:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:19.182 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:19.182 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:19.182 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:05 -- target/dif.sh@30 -- # for sub in "$@" 00:29:19.182 08:37:05 -- target/dif.sh@31 -- # create_subsystem 2 00:29:19.182 08:37:05 -- target/dif.sh@18 -- # local sub_id=2 00:29:19.182 08:37:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:19.182 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.182 bdev_null2 00:29:19.182 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.182 08:37:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:19.182 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.182 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.442 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.442 08:37:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:19.442 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.442 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.442 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.442 08:37:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:19.442 08:37:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.442 08:37:05 -- common/autotest_common.sh@10 -- # set +x 00:29:19.442 08:37:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.442 08:37:05 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:19.442 08:37:05 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:19.442 08:37:05 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.442 08:37:05 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:19.442 08:37:05 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.442 08:37:05 -- target/dif.sh@82 -- # gen_fio_conf 00:29:19.442 08:37:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:19.442 08:37:05 -- nvmf/common.sh@520 -- # config=() 00:29:19.442 08:37:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:19.442 08:37:05 -- nvmf/common.sh@520 -- # local subsystem config 00:29:19.442 08:37:05 -- target/dif.sh@54 -- # local file 00:29:19.442 08:37:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:19.442 08:37:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:19.442 08:37:05 -- target/dif.sh@56 -- # cat 00:29:19.442 08:37:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:19.442 { 00:29:19.442 "params": { 00:29:19.442 "name": "Nvme$subsystem", 00:29:19.442 "trtype": "$TEST_TRANSPORT", 00:29:19.442 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:19.442 "adrfam": "ipv4", 00:29:19.442 "trsvcid": "$NVMF_PORT", 00:29:19.442 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:19.442 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:19.442 "hdgst": ${hdgst:-false}, 00:29:19.442 "ddgst": ${ddgst:-false} 00:29:19.442 }, 00:29:19.442 "method": "bdev_nvme_attach_controller" 00:29:19.442 } 00:29:19.442 EOF 00:29:19.442 )") 00:29:19.442 08:37:05 -- common/autotest_common.sh@1330 -- # shift 00:29:19.442 08:37:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:19.442 08:37:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # cat 00:29:19.442 08:37:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.442 08:37:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:19.442 08:37:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:19.442 08:37:05 -- target/dif.sh@73 -- # cat 00:29:19.442 08:37:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:19.442 { 00:29:19.442 "params": { 00:29:19.442 "name": "Nvme$subsystem", 00:29:19.442 "trtype": "$TEST_TRANSPORT", 00:29:19.442 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:19.442 "adrfam": "ipv4", 00:29:19.442 "trsvcid": "$NVMF_PORT", 00:29:19.442 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:19.442 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:19.442 "hdgst": ${hdgst:-false}, 00:29:19.442 "ddgst": ${ddgst:-false} 00:29:19.442 }, 00:29:19.442 "method": "bdev_nvme_attach_controller" 00:29:19.442 } 00:29:19.442 EOF 00:29:19.442 )") 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file++ )) 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:19.442 08:37:05 -- target/dif.sh@73 -- # cat 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # cat 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file++ )) 00:29:19.442 08:37:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:19.442 08:37:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:19.442 { 00:29:19.442 "params": { 00:29:19.442 "name": "Nvme$subsystem", 00:29:19.442 "trtype": "$TEST_TRANSPORT", 00:29:19.442 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:19.442 "adrfam": "ipv4", 00:29:19.442 "trsvcid": "$NVMF_PORT", 00:29:19.442 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:19.442 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:19.442 "hdgst": ${hdgst:-false}, 00:29:19.442 "ddgst": ${ddgst:-false} 00:29:19.442 }, 00:29:19.442 "method": "bdev_nvme_attach_controller" 00:29:19.442 } 00:29:19.442 EOF 00:29:19.442 )") 00:29:19.442 08:37:05 -- nvmf/common.sh@542 -- # cat 00:29:19.442 08:37:05 -- nvmf/common.sh@544 -- # jq . 00:29:19.442 08:37:05 -- nvmf/common.sh@545 -- # IFS=, 00:29:19.442 08:37:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:19.442 "params": { 00:29:19.442 "name": "Nvme0", 00:29:19.442 "trtype": "tcp", 00:29:19.442 "traddr": "10.0.0.2", 00:29:19.442 "adrfam": "ipv4", 00:29:19.442 "trsvcid": "4420", 00:29:19.442 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:19.442 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:19.442 "hdgst": false, 00:29:19.442 "ddgst": false 00:29:19.442 }, 00:29:19.442 "method": "bdev_nvme_attach_controller" 00:29:19.442 },{ 00:29:19.442 "params": { 00:29:19.442 "name": "Nvme1", 00:29:19.442 "trtype": "tcp", 00:29:19.442 "traddr": "10.0.0.2", 00:29:19.442 "adrfam": "ipv4", 00:29:19.442 "trsvcid": "4420", 00:29:19.442 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:19.443 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:19.443 "hdgst": false, 00:29:19.443 "ddgst": false 00:29:19.443 }, 00:29:19.443 "method": "bdev_nvme_attach_controller" 00:29:19.443 },{ 00:29:19.443 "params": { 00:29:19.443 "name": "Nvme2", 00:29:19.443 "trtype": "tcp", 00:29:19.443 "traddr": "10.0.0.2", 00:29:19.443 "adrfam": "ipv4", 00:29:19.443 "trsvcid": "4420", 00:29:19.443 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:19.443 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:19.443 "hdgst": false, 00:29:19.443 "ddgst": false 00:29:19.443 }, 00:29:19.443 "method": "bdev_nvme_attach_controller" 00:29:19.443 }' 00:29:19.443 08:37:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:19.443 08:37:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:19.443 08:37:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:19.443 08:37:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.443 08:37:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:19.443 08:37:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:19.443 08:37:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:19.443 08:37:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:19.443 08:37:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:19.443 08:37:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.701 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:19.701 ... 00:29:19.701 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:19.701 ... 00:29:19.701 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:19.701 ... 00:29:19.701 fio-3.35 00:29:19.701 Starting 24 threads 00:29:19.701 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.634 [2024-11-26 08:37:06.157996] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:20.634 [2024-11-26 08:37:06.158050] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:30.612 00:29:30.612 filename0: (groupid=0, jobs=1): err= 0: pid=1097538: Tue Nov 26 08:37:16 2024 00:29:30.612 read: IOPS=485, BW=1943KiB/s (1989kB/s)(19.2MiB/10129msec) 00:29:30.612 slat (usec): min=4, max=102, avg=36.92, stdev=13.50 00:29:30.612 clat (msec): min=8, max=128, avg=32.36, stdev= 4.09 00:29:30.612 lat (msec): min=8, max=128, avg=32.40, stdev= 4.09 00:29:30.612 clat percentiles (msec): 00:29:30.612 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.612 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.612 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 35], 00:29:30.612 | 99.00th=[ 37], 99.50th=[ 39], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.612 | 99.99th=[ 129] 00:29:30.612 bw ( KiB/s): min= 1792, max= 2048, per=4.24%, avg=1964.15, stdev=74.45, samples=20 00:29:30.612 iops : min= 448, max= 512, avg=491.00, stdev=18.58, samples=20 00:29:30.612 lat (msec) : 10=0.33%, 20=0.33%, 50=99.21%, 250=0.14% 00:29:30.612 cpu : usr=98.57%, sys=1.00%, ctx=32, majf=0, minf=49 00:29:30.612 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.612 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.612 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.612 issued rwts: total=4919,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.612 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.612 filename0: (groupid=0, jobs=1): err= 0: pid=1097539: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=491, BW=1964KiB/s (2011kB/s)(19.2MiB/10004msec) 00:29:30.613 slat (nsec): min=7939, max=78728, avg=23510.49, stdev=13806.40 00:29:30.613 clat (usec): min=11283, max=38789, avg=32392.66, stdev=1724.72 00:29:30.613 lat (usec): min=11293, max=38805, avg=32416.17, stdev=1726.67 00:29:30.613 clat percentiles (usec): 00:29:30.613 | 1.00th=[31065], 5.00th=[31589], 10.00th=[31851], 20.00th=[31851], 00:29:30.613 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:30.613 | 70.00th=[32637], 80.00th=[32637], 90.00th=[33162], 95.00th=[34866], 00:29:30.613 | 99.00th=[36439], 99.50th=[36963], 99.90th=[38536], 99.95th=[38536], 00:29:30.613 | 99.99th=[38536] 00:29:30.613 bw ( KiB/s): min= 1792, max= 2048, per=4.23%, avg=1960.42, stdev=74.55, samples=19 00:29:30.613 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:30.613 lat (msec) : 20=0.61%, 50=99.39% 00:29:30.613 cpu : usr=97.60%, sys=1.45%, ctx=101, majf=0, minf=69 00:29:30.613 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097540: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=482, BW=1931KiB/s (1978kB/s)(19.1MiB/10107msec) 00:29:30.613 slat (usec): min=7, max=130, avg=33.79, stdev=21.37 00:29:30.613 clat (msec): min=14, max=134, avg=32.64, stdev= 4.16 00:29:30.613 lat (msec): min=14, max=134, avg=32.68, stdev= 4.16 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 16], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.613 | 99.00th=[ 50], 99.50th=[ 51], 99.90th=[ 68], 99.95th=[ 68], 00:29:30.613 | 99.99th=[ 136] 00:29:30.613 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.45, stdev=97.11, samples=20 00:29:30.613 iops : min= 416, max= 512, avg=485.85, stdev=24.30, samples=20 00:29:30.613 lat (msec) : 20=1.31%, 50=98.16%, 100=0.49%, 250=0.04% 00:29:30.613 cpu : usr=98.47%, sys=1.13%, ctx=16, majf=0, minf=82 00:29:30.613 IO depths : 1=1.7%, 2=8.0%, 4=25.0%, 8=54.5%, 16=10.8%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097541: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=483, BW=1935KiB/s (1981kB/s)(19.1MiB/10089msec) 00:29:30.613 slat (usec): min=8, max=117, avg=39.66, stdev=14.17 00:29:30.613 clat (msec): min=29, max=128, avg=32.73, stdev= 5.68 00:29:30.613 lat (msec): min=29, max=128, avg=32.77, stdev= 5.68 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.613 | 99.00th=[ 37], 99.50th=[ 51], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.613 | 99.99th=[ 129] 00:29:30.613 bw ( KiB/s): min= 1664, max= 2048, per=4.21%, avg=1953.68, stdev=93.89, samples=19 00:29:30.613 iops : min= 416, max= 512, avg=488.42, stdev=23.47, samples=19 00:29:30.613 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.613 cpu : usr=96.43%, sys=2.08%, ctx=118, majf=0, minf=45 00:29:30.613 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097542: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10125msec) 00:29:30.613 slat (nsec): min=10012, max=80753, avg=36558.14, stdev=9894.17 00:29:30.613 clat (msec): min=24, max=128, avg=32.77, stdev= 5.76 00:29:30.613 lat (msec): min=24, max=128, avg=32.80, stdev= 5.76 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.613 | 99.00th=[ 40], 99.50th=[ 55], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.613 | 99.99th=[ 129] 00:29:30.613 bw ( KiB/s): min= 1667, max= 2048, per=4.21%, avg=1952.15, stdev=100.21, samples=20 00:29:30.613 iops : min= 416, max= 512, avg=488.00, stdev=25.16, samples=20 00:29:30.613 lat (msec) : 50=99.35%, 100=0.33%, 250=0.33% 00:29:30.613 cpu : usr=98.12%, sys=1.46%, ctx=25, majf=0, minf=58 00:29:30.613 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097543: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=487, BW=1949KiB/s (1996kB/s)(19.2MiB/10087msec) 00:29:30.613 slat (usec): min=7, max=279, avg=46.24, stdev=37.57 00:29:30.613 clat (msec): min=11, max=134, avg=32.54, stdev= 7.54 00:29:30.613 lat (msec): min=11, max=135, avg=32.58, stdev= 7.54 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 13], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 30], 00:29:30.613 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 35], 90.00th=[ 40], 95.00th=[ 42], 00:29:30.613 | 99.00th=[ 51], 99.50th=[ 55], 99.90th=[ 131], 99.95th=[ 136], 00:29:30.613 | 99.99th=[ 136] 00:29:30.613 bw ( KiB/s): min= 1811, max= 2192, per=4.26%, avg=1974.89, stdev=89.78, samples=19 00:29:30.613 iops : min= 452, max= 548, avg=493.68, stdev=22.52, samples=19 00:29:30.613 lat (msec) : 20=3.40%, 50=95.63%, 100=0.77%, 250=0.20% 00:29:30.613 cpu : usr=98.18%, sys=1.32%, ctx=36, majf=0, minf=65 00:29:30.613 IO depths : 1=0.1%, 2=0.2%, 4=2.0%, 8=80.7%, 16=17.1%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=89.3%, 8=9.4%, 16=1.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4916,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097544: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=483, BW=1933KiB/s (1979kB/s)(19.1MiB/10099msec) 00:29:30.613 slat (usec): min=8, max=113, avg=39.60, stdev=18.45 00:29:30.613 clat (msec): min=30, max=135, avg=32.76, stdev= 6.05 00:29:30.613 lat (msec): min=30, max=135, avg=32.80, stdev= 6.05 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.613 | 99.00th=[ 37], 99.50th=[ 54], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.613 | 99.99th=[ 136] 00:29:30.613 bw ( KiB/s): min= 1664, max= 2048, per=4.20%, avg=1945.05, stdev=107.55, samples=20 00:29:30.613 iops : min= 416, max= 512, avg=486.25, stdev=26.91, samples=20 00:29:30.613 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.613 cpu : usr=98.67%, sys=0.93%, ctx=15, majf=0, minf=51 00:29:30.613 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename0: (groupid=0, jobs=1): err= 0: pid=1097545: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=482, BW=1931KiB/s (1978kB/s)(19.1MiB/10107msec) 00:29:30.613 slat (nsec): min=6248, max=65850, avg=27926.66, stdev=11252.44 00:29:30.613 clat (msec): min=25, max=134, avg=32.90, stdev= 6.20 00:29:30.613 lat (msec): min=26, max=134, avg=32.93, stdev= 6.20 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.613 | 99.00th=[ 40], 99.50th=[ 64], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.613 | 99.99th=[ 136] 00:29:30.613 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.35, stdev=99.40, samples=20 00:29:30.613 iops : min= 416, max= 512, avg=485.80, stdev=24.88, samples=20 00:29:30.613 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.613 cpu : usr=98.21%, sys=1.37%, ctx=19, majf=0, minf=66 00:29:30.613 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:30.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.613 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.613 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.613 filename1: (groupid=0, jobs=1): err= 0: pid=1097546: Tue Nov 26 08:37:16 2024 00:29:30.613 read: IOPS=482, BW=1931KiB/s (1978kB/s)(19.1MiB/10107msec) 00:29:30.613 slat (usec): min=9, max=120, avg=28.93, stdev= 7.89 00:29:30.613 clat (msec): min=31, max=134, avg=32.88, stdev= 6.18 00:29:30.613 lat (msec): min=31, max=134, avg=32.91, stdev= 6.18 00:29:30.613 clat percentiles (msec): 00:29:30.613 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.613 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.613 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 37], 99.50th=[ 64], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.614 | 99.99th=[ 136] 00:29:30.614 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.35, stdev=99.40, samples=20 00:29:30.614 iops : min= 416, max= 512, avg=485.80, stdev=24.88, samples=20 00:29:30.614 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.614 cpu : usr=95.77%, sys=2.37%, ctx=488, majf=0, minf=57 00:29:30.614 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097547: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=482, BW=1931KiB/s (1977kB/s)(19.0MiB/10089msec) 00:29:30.614 slat (usec): min=8, max=115, avg=40.49, stdev=17.64 00:29:30.614 clat (msec): min=24, max=135, avg=32.68, stdev= 5.01 00:29:30.614 lat (msec): min=24, max=135, avg=32.72, stdev= 5.01 00:29:30.614 clat percentiles (msec): 00:29:30.614 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.614 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.614 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 40], 99.50th=[ 53], 99.90th=[ 131], 99.95th=[ 136], 00:29:30.614 | 99.99th=[ 136] 00:29:30.614 bw ( KiB/s): min= 1664, max= 2048, per=4.21%, avg=1953.68, stdev=93.89, samples=19 00:29:30.614 iops : min= 416, max= 512, avg=488.42, stdev=23.47, samples=19 00:29:30.614 lat (msec) : 50=99.34%, 100=0.45%, 250=0.21% 00:29:30.614 cpu : usr=98.25%, sys=1.05%, ctx=131, majf=0, minf=36 00:29:30.614 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4870,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097548: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=483, BW=1935KiB/s (1981kB/s)(19.1MiB/10089msec) 00:29:30.614 slat (nsec): min=7409, max=82279, avg=33548.60, stdev=8427.63 00:29:30.614 clat (msec): min=30, max=128, avg=32.77, stdev= 5.67 00:29:30.614 lat (msec): min=30, max=128, avg=32.80, stdev= 5.67 00:29:30.614 clat percentiles (msec): 00:29:30.614 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.614 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.614 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 37], 99.50th=[ 50], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.614 | 99.99th=[ 129] 00:29:30.614 bw ( KiB/s): min= 1667, max= 2048, per=4.21%, avg=1953.84, stdev=93.37, samples=19 00:29:30.614 iops : min= 416, max= 512, avg=488.42, stdev=23.47, samples=19 00:29:30.614 lat (msec) : 50=99.67%, 250=0.33% 00:29:30.614 cpu : usr=98.65%, sys=0.93%, ctx=15, majf=0, minf=43 00:29:30.614 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097549: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10091msec) 00:29:30.614 slat (usec): min=9, max=128, avg=50.99, stdev=26.01 00:29:30.614 clat (msec): min=23, max=128, avg=32.64, stdev= 5.73 00:29:30.614 lat (msec): min=23, max=128, avg=32.69, stdev= 5.72 00:29:30.614 clat percentiles (msec): 00:29:30.614 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.614 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.614 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 43], 99.50th=[ 46], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.614 | 99.99th=[ 129] 00:29:30.614 bw ( KiB/s): min= 1667, max= 2052, per=4.20%, avg=1946.10, stdev=88.77, samples=20 00:29:30.614 iops : min= 416, max= 513, avg=486.45, stdev=22.33, samples=20 00:29:30.614 lat (msec) : 50=99.63%, 100=0.04%, 250=0.33% 00:29:30.614 cpu : usr=98.50%, sys=1.09%, ctx=14, majf=0, minf=39 00:29:30.614 IO depths : 1=5.7%, 2=11.9%, 4=24.9%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097550: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=487, BW=1950KiB/s (1997kB/s)(19.1MiB/10042msec) 00:29:30.614 slat (nsec): min=7685, max=65197, avg=26212.61, stdev=10496.12 00:29:30.614 clat (usec): min=24987, max=67612, avg=32580.40, stdev=2282.14 00:29:30.614 lat (usec): min=25031, max=67648, avg=32606.61, stdev=2283.83 00:29:30.614 clat percentiles (usec): 00:29:30.614 | 1.00th=[31327], 5.00th=[31589], 10.00th=[31851], 20.00th=[31851], 00:29:30.614 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:30.614 | 70.00th=[32375], 80.00th=[32637], 90.00th=[33162], 95.00th=[35390], 00:29:30.614 | 99.00th=[36963], 99.50th=[39584], 99.90th=[67634], 99.95th=[67634], 00:29:30.614 | 99.99th=[67634] 00:29:30.614 bw ( KiB/s): min= 1792, max= 2048, per=4.21%, avg=1952.00, stdev=81.75, samples=20 00:29:30.614 iops : min= 448, max= 512, avg=488.00, stdev=20.44, samples=20 00:29:30.614 lat (msec) : 50=99.67%, 100=0.33% 00:29:30.614 cpu : usr=95.17%, sys=2.69%, ctx=235, majf=0, minf=43 00:29:30.614 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097551: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10092msec) 00:29:30.614 slat (usec): min=6, max=134, avg=47.91, stdev=26.74 00:29:30.614 clat (msec): min=27, max=134, avg=32.66, stdev= 6.03 00:29:30.614 lat (msec): min=27, max=134, avg=32.71, stdev= 6.02 00:29:30.614 clat percentiles (msec): 00:29:30.614 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.614 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.614 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.614 | 99.99th=[ 136] 00:29:30.614 bw ( KiB/s): min= 1660, max= 2052, per=4.20%, avg=1945.75, stdev=99.06, samples=20 00:29:30.614 iops : min= 415, max= 513, avg=486.40, stdev=24.78, samples=20 00:29:30.614 lat (msec) : 50=99.63%, 100=0.04%, 250=0.33% 00:29:30.614 cpu : usr=97.13%, sys=1.66%, ctx=94, majf=0, minf=55 00:29:30.614 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097552: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=491, BW=1964KiB/s (2011kB/s)(19.2MiB/10004msec) 00:29:30.614 slat (usec): min=8, max=146, avg=45.43, stdev=31.40 00:29:30.614 clat (usec): min=11560, max=40090, avg=32202.14, stdev=1803.52 00:29:30.614 lat (usec): min=11570, max=40142, avg=32247.57, stdev=1798.50 00:29:30.614 clat percentiles (usec): 00:29:30.614 | 1.00th=[30278], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:29:30.614 | 30.00th=[31851], 40.00th=[32113], 50.00th=[32113], 60.00th=[32113], 00:29:30.614 | 70.00th=[32375], 80.00th=[32637], 90.00th=[33162], 95.00th=[34866], 00:29:30.614 | 99.00th=[36439], 99.50th=[36963], 99.90th=[39060], 99.95th=[39060], 00:29:30.614 | 99.99th=[40109] 00:29:30.614 bw ( KiB/s): min= 1792, max= 2048, per=4.23%, avg=1960.42, stdev=74.55, samples=19 00:29:30.614 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:30.614 lat (msec) : 20=0.65%, 50=99.35% 00:29:30.614 cpu : usr=98.52%, sys=1.07%, ctx=15, majf=0, minf=38 00:29:30.614 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.614 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.614 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.614 filename1: (groupid=0, jobs=1): err= 0: pid=1097553: Tue Nov 26 08:37:16 2024 00:29:30.614 read: IOPS=482, BW=1931KiB/s (1978kB/s)(19.1MiB/10107msec) 00:29:30.614 slat (usec): min=8, max=144, avg=39.11, stdev=29.40 00:29:30.614 clat (msec): min=17, max=134, avg=32.54, stdev= 3.21 00:29:30.614 lat (msec): min=17, max=134, avg=32.58, stdev= 3.21 00:29:30.614 clat percentiles (msec): 00:29:30.614 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.614 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.614 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.614 | 99.00th=[ 39], 99.50th=[ 47], 99.90th=[ 68], 99.95th=[ 68], 00:29:30.614 | 99.99th=[ 136] 00:29:30.614 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.50, stdev=102.10, samples=20 00:29:30.614 iops : min= 416, max= 512, avg=485.85, stdev=25.58, samples=20 00:29:30.614 lat (msec) : 20=0.04%, 50=99.55%, 100=0.37%, 250=0.04% 00:29:30.614 cpu : usr=98.70%, sys=0.88%, ctx=20, majf=0, minf=55 00:29:30.614 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097554: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=483, BW=1935KiB/s (1981kB/s)(19.1MiB/10088msec) 00:29:30.615 slat (usec): min=8, max=105, avg=36.62, stdev=12.79 00:29:30.615 clat (msec): min=30, max=128, avg=32.72, stdev= 5.68 00:29:30.615 lat (msec): min=30, max=128, avg=32.76, stdev= 5.68 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.615 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.615 | 99.00th=[ 37], 99.50th=[ 51], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.615 | 99.99th=[ 129] 00:29:30.615 bw ( KiB/s): min= 1664, max= 2048, per=4.21%, avg=1953.68, stdev=93.89, samples=19 00:29:30.615 iops : min= 416, max= 512, avg=488.42, stdev=23.47, samples=19 00:29:30.615 lat (msec) : 50=99.45%, 100=0.23%, 250=0.33% 00:29:30.615 cpu : usr=98.63%, sys=0.96%, ctx=18, majf=0, minf=52 00:29:30.615 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097555: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=486, BW=1947KiB/s (1994kB/s)(19.1MiB/10024msec) 00:29:30.615 slat (nsec): min=7938, max=91230, avg=25418.48, stdev=9574.35 00:29:30.615 clat (usec): min=17207, max=68101, avg=32622.52, stdev=2542.19 00:29:30.615 lat (usec): min=17233, max=68119, avg=32647.94, stdev=2542.00 00:29:30.615 clat percentiles (usec): 00:29:30.615 | 1.00th=[31327], 5.00th=[31589], 10.00th=[31851], 20.00th=[31851], 00:29:30.615 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:30.615 | 70.00th=[32375], 80.00th=[32637], 90.00th=[33162], 95.00th=[35390], 00:29:30.615 | 99.00th=[38011], 99.50th=[47449], 99.90th=[67634], 99.95th=[67634], 00:29:30.615 | 99.99th=[67634] 00:29:30.615 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.50, stdev=102.10, samples=20 00:29:30.615 iops : min= 416, max= 512, avg=485.85, stdev=25.58, samples=20 00:29:30.615 lat (msec) : 20=0.08%, 50=99.51%, 100=0.41% 00:29:30.615 cpu : usr=97.76%, sys=1.41%, ctx=60, majf=0, minf=49 00:29:30.615 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097556: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=482, BW=1931KiB/s (1978kB/s)(19.1MiB/10107msec) 00:29:30.615 slat (usec): min=8, max=135, avg=32.16, stdev=17.28 00:29:30.615 clat (msec): min=26, max=134, avg=32.86, stdev= 6.20 00:29:30.615 lat (msec): min=26, max=134, avg=32.89, stdev= 6.19 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.615 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.615 | 99.00th=[ 39], 99.50th=[ 64], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.615 | 99.99th=[ 136] 00:29:30.615 bw ( KiB/s): min= 1664, max= 2048, per=4.19%, avg=1943.35, stdev=99.40, samples=20 00:29:30.615 iops : min= 416, max= 512, avg=485.80, stdev=24.88, samples=20 00:29:30.615 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.615 cpu : usr=96.72%, sys=1.86%, ctx=144, majf=0, minf=60 00:29:30.615 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097557: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10088msec) 00:29:30.615 slat (usec): min=10, max=164, avg=66.73, stdev=35.26 00:29:30.615 clat (msec): min=22, max=128, avg=32.52, stdev= 6.08 00:29:30.615 lat (msec): min=22, max=128, avg=32.58, stdev= 6.08 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:29:30.615 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 36], 00:29:30.615 | 99.00th=[ 50], 99.50th=[ 59], 99.90th=[ 128], 99.95th=[ 128], 00:29:30.615 | 99.99th=[ 129] 00:29:30.615 bw ( KiB/s): min= 1635, max= 2048, per=4.21%, avg=1953.00, stdev=98.74, samples=19 00:29:30.615 iops : min= 408, max= 512, avg=488.21, stdev=24.82, samples=19 00:29:30.615 lat (msec) : 50=99.06%, 100=0.62%, 250=0.33% 00:29:30.615 cpu : usr=95.97%, sys=2.15%, ctx=220, majf=0, minf=55 00:29:30.615 IO depths : 1=5.7%, 2=11.5%, 4=23.5%, 8=52.2%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=93.8%, 8=0.6%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4878,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097558: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=491, BW=1964KiB/s (2011kB/s)(19.2MiB/10004msec) 00:29:30.615 slat (usec): min=6, max=148, avg=33.87, stdev=19.59 00:29:30.615 clat (usec): min=11552, max=40831, avg=32298.85, stdev=1793.28 00:29:30.615 lat (usec): min=11560, max=40880, avg=32332.72, stdev=1791.60 00:29:30.615 clat percentiles (usec): 00:29:30.615 | 1.00th=[30278], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:30.615 | 30.00th=[31851], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:30.615 | 70.00th=[32375], 80.00th=[32637], 90.00th=[33162], 95.00th=[34866], 00:29:30.615 | 99.00th=[36439], 99.50th=[36963], 99.90th=[39060], 99.95th=[39584], 00:29:30.615 | 99.99th=[40633] 00:29:30.615 bw ( KiB/s): min= 1792, max= 2048, per=4.23%, avg=1960.42, stdev=74.55, samples=19 00:29:30.615 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:30.615 lat (msec) : 20=0.65%, 50=99.35% 00:29:30.615 cpu : usr=97.88%, sys=1.45%, ctx=90, majf=0, minf=68 00:29:30.615 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097559: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10125msec) 00:29:30.615 slat (nsec): min=8498, max=74919, avg=35442.53, stdev=9597.29 00:29:30.615 clat (msec): min=23, max=128, avg=32.78, stdev= 5.74 00:29:30.615 lat (msec): min=23, max=128, avg=32.81, stdev= 5.74 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.615 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.615 | 99.00th=[ 37], 99.50th=[ 55], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.615 | 99.99th=[ 129] 00:29:30.615 bw ( KiB/s): min= 1667, max= 2048, per=4.21%, avg=1952.15, stdev=100.21, samples=20 00:29:30.615 iops : min= 416, max= 512, avg=488.00, stdev=25.16, samples=20 00:29:30.615 lat (msec) : 50=99.35%, 100=0.33%, 250=0.33% 00:29:30.615 cpu : usr=95.71%, sys=2.46%, ctx=229, majf=0, minf=50 00:29:30.615 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097560: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=483, BW=1934KiB/s (1981kB/s)(19.1MiB/10125msec) 00:29:30.615 slat (nsec): min=11132, max=80250, avg=35258.51, stdev=9517.31 00:29:30.615 clat (msec): min=25, max=128, avg=32.77, stdev= 5.72 00:29:30.615 lat (msec): min=25, max=128, avg=32.81, stdev= 5.72 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.615 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.615 | 99.00th=[ 39], 99.50th=[ 55], 99.90th=[ 129], 99.95th=[ 129], 00:29:30.615 | 99.99th=[ 129] 00:29:30.615 bw ( KiB/s): min= 1667, max= 2048, per=4.21%, avg=1952.15, stdev=100.21, samples=20 00:29:30.615 iops : min= 416, max= 512, avg=488.00, stdev=25.16, samples=20 00:29:30.615 lat (msec) : 50=99.35%, 100=0.33%, 250=0.33% 00:29:30.615 cpu : usr=94.58%, sys=2.86%, ctx=248, majf=0, minf=63 00:29:30.615 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:30.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.615 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.615 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.615 filename2: (groupid=0, jobs=1): err= 0: pid=1097561: Tue Nov 26 08:37:16 2024 00:29:30.615 read: IOPS=483, BW=1934KiB/s (1980kB/s)(19.1MiB/10095msec) 00:29:30.615 slat (nsec): min=8319, max=61570, avg=29455.41, stdev=10177.23 00:29:30.615 clat (msec): min=31, max=134, avg=32.83, stdev= 6.02 00:29:30.615 lat (msec): min=31, max=134, avg=32.86, stdev= 6.02 00:29:30.615 clat percentiles (msec): 00:29:30.615 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:30.615 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:29:30.616 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:30.616 | 99.00th=[ 37], 99.50th=[ 51], 99.90th=[ 136], 99.95th=[ 136], 00:29:30.616 | 99.99th=[ 136] 00:29:30.616 bw ( KiB/s): min= 1664, max= 2048, per=4.20%, avg=1945.60, stdev=98.27, samples=20 00:29:30.616 iops : min= 416, max= 512, avg=486.40, stdev=24.57, samples=20 00:29:30.616 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:30.616 cpu : usr=98.74%, sys=0.85%, ctx=21, majf=0, minf=41 00:29:30.616 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:30.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.616 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:30.616 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:30.616 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:30.616 00:29:30.616 Run status group 0 (all jobs): 00:29:30.616 READ: bw=45.3MiB/s (47.5MB/s), 1931KiB/s-1964KiB/s (1977kB/s-2011kB/s), io=458MiB (481MB), run=10004-10129msec 00:29:31.183 08:37:16 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:31.183 08:37:16 -- target/dif.sh@43 -- # local sub 00:29:31.183 08:37:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.183 08:37:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:31.183 08:37:16 -- target/dif.sh@36 -- # local sub_id=0 00:29:31.183 08:37:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:31.183 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.183 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.183 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.184 08:37:16 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:31.184 08:37:16 -- target/dif.sh@36 -- # local sub_id=1 00:29:31.184 08:37:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.184 08:37:16 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:31.184 08:37:16 -- target/dif.sh@36 -- # local sub_id=2 00:29:31.184 08:37:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # numjobs=2 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # iodepth=8 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # runtime=5 00:29:31.184 08:37:16 -- target/dif.sh@115 -- # files=1 00:29:31.184 08:37:16 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:31.184 08:37:16 -- target/dif.sh@28 -- # local sub 00:29:31.184 08:37:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:31.184 08:37:16 -- target/dif.sh@31 -- # create_subsystem 0 00:29:31.184 08:37:16 -- target/dif.sh@18 -- # local sub_id=0 00:29:31.184 08:37:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 bdev_null0 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 [2024-11-26 08:37:16.817517] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:31.184 08:37:16 -- target/dif.sh@31 -- # create_subsystem 1 00:29:31.184 08:37:16 -- target/dif.sh@18 -- # local sub_id=1 00:29:31.184 08:37:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 bdev_null1 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:31.184 08:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.184 08:37:16 -- common/autotest_common.sh@10 -- # set +x 00:29:31.184 08:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.184 08:37:16 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:31.184 08:37:16 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:31.184 08:37:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:31.184 08:37:16 -- nvmf/common.sh@520 -- # config=() 00:29:31.184 08:37:16 -- nvmf/common.sh@520 -- # local subsystem config 00:29:31.184 08:37:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:31.184 08:37:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:31.184 { 00:29:31.184 "params": { 00:29:31.184 "name": "Nvme$subsystem", 00:29:31.184 "trtype": "$TEST_TRANSPORT", 00:29:31.184 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:31.184 "adrfam": "ipv4", 00:29:31.184 "trsvcid": "$NVMF_PORT", 00:29:31.184 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:31.184 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:31.184 "hdgst": ${hdgst:-false}, 00:29:31.184 "ddgst": ${ddgst:-false} 00:29:31.184 }, 00:29:31.184 "method": "bdev_nvme_attach_controller" 00:29:31.184 } 00:29:31.184 EOF 00:29:31.184 )") 00:29:31.184 08:37:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.184 08:37:16 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.184 08:37:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:31.184 08:37:16 -- target/dif.sh@82 -- # gen_fio_conf 00:29:31.184 08:37:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:31.184 08:37:16 -- target/dif.sh@54 -- # local file 00:29:31.184 08:37:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:31.184 08:37:16 -- target/dif.sh@56 -- # cat 00:29:31.184 08:37:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.184 08:37:16 -- common/autotest_common.sh@1330 -- # shift 00:29:31.184 08:37:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:31.184 08:37:16 -- nvmf/common.sh@542 -- # cat 00:29:31.184 08:37:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.184 08:37:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:31.184 08:37:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:31.184 08:37:16 -- target/dif.sh@73 -- # cat 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.184 08:37:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:31.184 08:37:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:31.184 { 00:29:31.184 "params": { 00:29:31.184 "name": "Nvme$subsystem", 00:29:31.184 "trtype": "$TEST_TRANSPORT", 00:29:31.184 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:31.184 "adrfam": "ipv4", 00:29:31.184 "trsvcid": "$NVMF_PORT", 00:29:31.184 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:31.184 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:31.184 "hdgst": ${hdgst:-false}, 00:29:31.184 "ddgst": ${ddgst:-false} 00:29:31.184 }, 00:29:31.184 "method": "bdev_nvme_attach_controller" 00:29:31.184 } 00:29:31.184 EOF 00:29:31.184 )") 00:29:31.184 08:37:16 -- nvmf/common.sh@542 -- # cat 00:29:31.184 08:37:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:31.184 08:37:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:31.184 08:37:16 -- nvmf/common.sh@544 -- # jq . 00:29:31.184 08:37:16 -- nvmf/common.sh@545 -- # IFS=, 00:29:31.184 08:37:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:31.184 "params": { 00:29:31.184 "name": "Nvme0", 00:29:31.184 "trtype": "tcp", 00:29:31.184 "traddr": "10.0.0.2", 00:29:31.184 "adrfam": "ipv4", 00:29:31.184 "trsvcid": "4420", 00:29:31.184 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:31.184 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:31.184 "hdgst": false, 00:29:31.184 "ddgst": false 00:29:31.184 }, 00:29:31.184 "method": "bdev_nvme_attach_controller" 00:29:31.184 },{ 00:29:31.184 "params": { 00:29:31.184 "name": "Nvme1", 00:29:31.184 "trtype": "tcp", 00:29:31.184 "traddr": "10.0.0.2", 00:29:31.184 "adrfam": "ipv4", 00:29:31.184 "trsvcid": "4420", 00:29:31.184 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:31.184 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:31.184 "hdgst": false, 00:29:31.184 "ddgst": false 00:29:31.184 }, 00:29:31.184 "method": "bdev_nvme_attach_controller" 00:29:31.184 }' 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.184 08:37:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.184 08:37:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:31.184 08:37:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.185 08:37:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.185 08:37:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.185 08:37:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:31.185 08:37:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.443 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:31.443 ... 00:29:31.443 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:31.443 ... 00:29:31.443 fio-3.35 00:29:31.443 Starting 4 threads 00:29:31.443 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.010 [2024-11-26 08:37:17.674434] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:32.010 [2024-11-26 08:37:17.674510] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:37.351 00:29:37.351 filename0: (groupid=0, jobs=1): err= 0: pid=1098989: Tue Nov 26 08:37:22 2024 00:29:37.351 read: IOPS=1883, BW=14.7MiB/s (15.4MB/s)(73.6MiB/5003msec) 00:29:37.351 slat (nsec): min=6296, max=61758, avg=17307.97, stdev=8401.51 00:29:37.351 clat (usec): min=688, max=7664, avg=4188.27, stdev=595.54 00:29:37.351 lat (usec): min=700, max=7671, avg=4205.58, stdev=595.71 00:29:37.351 clat percentiles (usec): 00:29:37.351 | 1.00th=[ 2737], 5.00th=[ 3392], 10.00th=[ 3654], 20.00th=[ 3884], 00:29:37.351 | 30.00th=[ 3982], 40.00th=[ 4080], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:37.351 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4686], 95.00th=[ 5276], 00:29:37.351 | 99.00th=[ 6390], 99.50th=[ 6587], 99.90th=[ 7242], 99.95th=[ 7504], 00:29:37.351 | 99.99th=[ 7635] 00:29:37.351 bw ( KiB/s): min=14736, max=15456, per=25.00%, avg=15070.20, stdev=229.20, samples=10 00:29:37.351 iops : min= 1842, max= 1932, avg=1883.70, stdev=28.56, samples=10 00:29:37.351 lat (usec) : 750=0.02%, 1000=0.02% 00:29:37.351 lat (msec) : 2=0.39%, 4=31.13%, 10=68.43% 00:29:37.351 cpu : usr=95.40%, sys=3.94%, ctx=11, majf=0, minf=0 00:29:37.351 IO depths : 1=0.1%, 2=10.2%, 4=62.1%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.351 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.351 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 issued rwts: total=9424,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.352 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.352 filename0: (groupid=0, jobs=1): err= 0: pid=1098990: Tue Nov 26 08:37:22 2024 00:29:37.352 read: IOPS=1851, BW=14.5MiB/s (15.2MB/s)(72.3MiB/5001msec) 00:29:37.352 slat (nsec): min=6193, max=67493, avg=15079.60, stdev=8400.38 00:29:37.352 clat (usec): min=597, max=7841, avg=4270.34, stdev=639.50 00:29:37.352 lat (usec): min=609, max=7849, avg=4285.42, stdev=638.91 00:29:37.352 clat percentiles (usec): 00:29:37.352 | 1.00th=[ 2671], 5.00th=[ 3523], 10.00th=[ 3785], 20.00th=[ 3949], 00:29:37.352 | 30.00th=[ 4047], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:37.352 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4883], 95.00th=[ 5538], 00:29:37.352 | 99.00th=[ 6652], 99.50th=[ 6915], 99.90th=[ 7635], 99.95th=[ 7701], 00:29:37.352 | 99.99th=[ 7832] 00:29:37.352 bw ( KiB/s): min=14240, max=15823, per=24.51%, avg=14778.56, stdev=487.80, samples=9 00:29:37.352 iops : min= 1780, max= 1977, avg=1847.22, stdev=60.74, samples=9 00:29:37.352 lat (usec) : 750=0.01%, 1000=0.08% 00:29:37.352 lat (msec) : 2=0.32%, 4=25.21%, 10=74.38% 00:29:37.352 cpu : usr=95.16%, sys=4.22%, ctx=16, majf=0, minf=9 00:29:37.352 IO depths : 1=0.1%, 2=8.9%, 4=63.5%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 issued rwts: total=9259,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.352 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.352 filename1: (groupid=0, jobs=1): err= 0: pid=1098991: Tue Nov 26 08:37:22 2024 00:29:37.352 read: IOPS=1880, BW=14.7MiB/s (15.4MB/s)(73.5MiB/5001msec) 00:29:37.352 slat (nsec): min=6349, max=57913, avg=15310.15, stdev=8492.02 00:29:37.352 clat (usec): min=723, max=7644, avg=4204.63, stdev=651.54 00:29:37.352 lat (usec): min=735, max=7657, avg=4219.94, stdev=651.32 00:29:37.352 clat percentiles (usec): 00:29:37.352 | 1.00th=[ 2606], 5.00th=[ 3294], 10.00th=[ 3589], 20.00th=[ 3851], 00:29:37.352 | 30.00th=[ 3982], 40.00th=[ 4080], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:37.352 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4817], 95.00th=[ 5473], 00:29:37.352 | 99.00th=[ 6521], 99.50th=[ 6849], 99.90th=[ 7242], 99.95th=[ 7504], 00:29:37.352 | 99.99th=[ 7635] 00:29:37.352 bw ( KiB/s): min=14592, max=15632, per=24.96%, avg=15048.89, stdev=332.76, samples=9 00:29:37.352 iops : min= 1824, max= 1954, avg=1881.11, stdev=41.59, samples=9 00:29:37.352 lat (usec) : 750=0.01%, 1000=0.04% 00:29:37.352 lat (msec) : 2=0.28%, 4=30.94%, 10=68.73% 00:29:37.352 cpu : usr=95.46%, sys=3.98%, ctx=13, majf=0, minf=0 00:29:37.352 IO depths : 1=0.1%, 2=9.6%, 4=62.4%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 issued rwts: total=9402,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.352 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.352 filename1: (groupid=0, jobs=1): err= 0: pid=1098992: Tue Nov 26 08:37:22 2024 00:29:37.352 read: IOPS=1922, BW=15.0MiB/s (15.7MB/s)(75.1MiB/5002msec) 00:29:37.352 slat (nsec): min=6108, max=60357, avg=12602.42, stdev=6703.30 00:29:37.352 clat (usec): min=871, max=10677, avg=4119.85, stdev=575.80 00:29:37.352 lat (usec): min=884, max=10712, avg=4132.45, stdev=576.06 00:29:37.352 clat percentiles (usec): 00:29:37.352 | 1.00th=[ 2704], 5.00th=[ 3228], 10.00th=[ 3490], 20.00th=[ 3818], 00:29:37.352 | 30.00th=[ 3949], 40.00th=[ 4047], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:37.352 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 5014], 00:29:37.352 | 99.00th=[ 6063], 99.50th=[ 6456], 99.90th=[ 7504], 99.95th=[ 8979], 00:29:37.352 | 99.99th=[10683] 00:29:37.352 bw ( KiB/s): min=14848, max=16304, per=25.58%, avg=15424.00, stdev=501.01, samples=9 00:29:37.352 iops : min= 1856, max= 2038, avg=1928.00, stdev=62.63, samples=9 00:29:37.352 lat (usec) : 1000=0.02% 00:29:37.352 lat (msec) : 2=0.18%, 4=35.78%, 10=64.01%, 20=0.01% 00:29:37.352 cpu : usr=95.00%, sys=4.38%, ctx=11, majf=0, minf=9 00:29:37.352 IO depths : 1=0.1%, 2=8.6%, 4=63.0%, 8=28.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 complete : 0=0.0%, 4=92.8%, 8=7.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.352 issued rwts: total=9616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.352 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.352 00:29:37.352 Run status group 0 (all jobs): 00:29:37.352 READ: bw=58.9MiB/s (61.7MB/s), 14.5MiB/s-15.0MiB/s (15.2MB/s-15.7MB/s), io=295MiB (309MB), run=5001-5003msec 00:29:37.352 08:37:23 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:37.352 08:37:23 -- target/dif.sh@43 -- # local sub 00:29:37.352 08:37:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.352 08:37:23 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:37.352 08:37:23 -- target/dif.sh@36 -- # local sub_id=0 00:29:37.352 08:37:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:37.352 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.352 08:37:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:37.352 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.352 08:37:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.352 08:37:23 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:37.352 08:37:23 -- target/dif.sh@36 -- # local sub_id=1 00:29:37.352 08:37:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:37.352 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.352 08:37:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:37.352 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.352 00:29:37.352 real 0m24.404s 00:29:37.352 user 4m33.683s 00:29:37.352 sys 0m6.616s 00:29:37.352 08:37:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 ************************************ 00:29:37.352 END TEST fio_dif_rand_params 00:29:37.352 ************************************ 00:29:37.352 08:37:23 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:37.352 08:37:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:37.352 08:37:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:37.352 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.352 ************************************ 00:29:37.352 START TEST fio_dif_digest 00:29:37.352 ************************************ 00:29:37.352 08:37:23 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:37.352 08:37:23 -- target/dif.sh@123 -- # local NULL_DIF 00:29:37.352 08:37:23 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:37.352 08:37:23 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:37.352 08:37:23 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:37.352 08:37:23 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:37.352 08:37:23 -- target/dif.sh@127 -- # numjobs=3 00:29:37.352 08:37:23 -- target/dif.sh@127 -- # iodepth=3 00:29:37.352 08:37:23 -- target/dif.sh@127 -- # runtime=10 00:29:37.352 08:37:23 -- target/dif.sh@128 -- # hdgst=true 00:29:37.352 08:37:23 -- target/dif.sh@128 -- # ddgst=true 00:29:37.352 08:37:23 -- target/dif.sh@130 -- # create_subsystems 0 00:29:37.352 08:37:23 -- target/dif.sh@28 -- # local sub 00:29:37.352 08:37:23 -- target/dif.sh@30 -- # for sub in "$@" 00:29:37.353 08:37:23 -- target/dif.sh@31 -- # create_subsystem 0 00:29:37.353 08:37:23 -- target/dif.sh@18 -- # local sub_id=0 00:29:37.353 08:37:23 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:37.353 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.353 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.353 bdev_null0 00:29:37.353 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.353 08:37:23 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:37.353 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.353 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.353 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.353 08:37:23 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:37.353 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.353 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.353 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.353 08:37:23 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:37.353 08:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.353 08:37:23 -- common/autotest_common.sh@10 -- # set +x 00:29:37.353 [2024-11-26 08:37:23.112236] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:37.353 08:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.353 08:37:23 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:37.353 08:37:23 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:37.353 08:37:23 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:37.353 08:37:23 -- nvmf/common.sh@520 -- # config=() 00:29:37.353 08:37:23 -- nvmf/common.sh@520 -- # local subsystem config 00:29:37.353 08:37:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:37.353 08:37:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:37.353 { 00:29:37.353 "params": { 00:29:37.353 "name": "Nvme$subsystem", 00:29:37.353 "trtype": "$TEST_TRANSPORT", 00:29:37.353 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:37.353 "adrfam": "ipv4", 00:29:37.353 "trsvcid": "$NVMF_PORT", 00:29:37.353 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:37.353 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:37.353 "hdgst": ${hdgst:-false}, 00:29:37.353 "ddgst": ${ddgst:-false} 00:29:37.353 }, 00:29:37.353 "method": "bdev_nvme_attach_controller" 00:29:37.353 } 00:29:37.353 EOF 00:29:37.353 )") 00:29:37.353 08:37:23 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.353 08:37:23 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.353 08:37:23 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:37.353 08:37:23 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:37.353 08:37:23 -- target/dif.sh@82 -- # gen_fio_conf 00:29:37.353 08:37:23 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:37.353 08:37:23 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.353 08:37:23 -- target/dif.sh@54 -- # local file 00:29:37.353 08:37:23 -- common/autotest_common.sh@1330 -- # shift 00:29:37.353 08:37:23 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:37.353 08:37:23 -- target/dif.sh@56 -- # cat 00:29:37.353 08:37:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:37.353 08:37:23 -- nvmf/common.sh@542 -- # cat 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:37.353 08:37:23 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:37.353 08:37:23 -- target/dif.sh@72 -- # (( file <= files )) 00:29:37.353 08:37:23 -- nvmf/common.sh@544 -- # jq . 00:29:37.353 08:37:23 -- nvmf/common.sh@545 -- # IFS=, 00:29:37.353 08:37:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:37.353 "params": { 00:29:37.353 "name": "Nvme0", 00:29:37.353 "trtype": "tcp", 00:29:37.353 "traddr": "10.0.0.2", 00:29:37.353 "adrfam": "ipv4", 00:29:37.353 "trsvcid": "4420", 00:29:37.353 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:37.353 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:37.353 "hdgst": true, 00:29:37.353 "ddgst": true 00:29:37.353 }, 00:29:37.353 "method": "bdev_nvme_attach_controller" 00:29:37.353 }' 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:37.353 08:37:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:37.353 08:37:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:37.353 08:37:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:37.353 08:37:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:37.353 08:37:23 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:37.353 08:37:23 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.612 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:37.612 ... 00:29:37.612 fio-3.35 00:29:37.612 Starting 3 threads 00:29:37.612 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.178 [2024-11-26 08:37:23.755750] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:38.178 [2024-11-26 08:37:23.755816] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:48.147 00:29:48.147 filename0: (groupid=0, jobs=1): err= 0: pid=1099769: Tue Nov 26 08:37:33 2024 00:29:48.147 read: IOPS=210, BW=26.3MiB/s (27.6MB/s)(264MiB/10047msec) 00:29:48.147 slat (nsec): min=6957, max=72200, avg=12412.12, stdev=2334.30 00:29:48.147 clat (usec): min=10192, max=51525, avg=14228.60, stdev=1562.85 00:29:48.147 lat (usec): min=10204, max=51536, avg=14241.01, stdev=1562.87 00:29:48.147 clat percentiles (usec): 00:29:48.147 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12780], 20.00th=[13304], 00:29:48.147 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14484], 00:29:48.147 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15533], 95.00th=[16057], 00:29:48.147 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19530], 99.95th=[48497], 00:29:48.147 | 99.99th=[51643] 00:29:48.147 bw ( KiB/s): min=25856, max=28928, per=34.31%, avg=27008.00, stdev=861.16, samples=20 00:29:48.147 iops : min= 202, max= 226, avg=211.00, stdev= 6.73, samples=20 00:29:48.147 lat (msec) : 20=99.91%, 50=0.05%, 100=0.05% 00:29:48.147 cpu : usr=92.04%, sys=7.51%, ctx=20, majf=0, minf=163 00:29:48.147 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:48.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 issued rwts: total=2113,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:48.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:48.147 filename0: (groupid=0, jobs=1): err= 0: pid=1099770: Tue Nov 26 08:37:33 2024 00:29:48.147 read: IOPS=199, BW=25.0MiB/s (26.2MB/s)(251MiB/10046msec) 00:29:48.147 slat (nsec): min=7449, max=29896, avg=12652.92, stdev=1669.98 00:29:48.147 clat (usec): min=11781, max=50349, avg=14986.83, stdev=1551.49 00:29:48.147 lat (usec): min=11793, max=50361, avg=14999.48, stdev=1551.47 00:29:48.147 clat percentiles (usec): 00:29:48.147 | 1.00th=[12649], 5.00th=[13304], 10.00th=[13566], 20.00th=[13960], 00:29:48.147 | 30.00th=[14222], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:29:48.147 | 70.00th=[15533], 80.00th=[15795], 90.00th=[16450], 95.00th=[16909], 00:29:48.147 | 99.00th=[17957], 99.50th=[18220], 99.90th=[20841], 99.95th=[47449], 00:29:48.147 | 99.99th=[50594] 00:29:48.147 bw ( KiB/s): min=24320, max=26880, per=32.58%, avg=25648.65, stdev=769.61, samples=20 00:29:48.147 iops : min= 190, max= 210, avg=200.35, stdev= 6.03, samples=20 00:29:48.147 lat (msec) : 20=99.85%, 50=0.10%, 100=0.05% 00:29:48.147 cpu : usr=92.72%, sys=6.80%, ctx=29, majf=0, minf=129 00:29:48.147 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:48.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 issued rwts: total=2006,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:48.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:48.147 filename0: (groupid=0, jobs=1): err= 0: pid=1099771: Tue Nov 26 08:37:33 2024 00:29:48.147 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10047msec) 00:29:48.147 slat (nsec): min=7191, max=36047, avg=12497.58, stdev=1772.72 00:29:48.147 clat (usec): min=11175, max=54399, avg=14593.93, stdev=1588.60 00:29:48.147 lat (usec): min=11190, max=54411, avg=14606.43, stdev=1588.60 00:29:48.147 clat percentiles (usec): 00:29:48.147 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13698], 00:29:48.147 | 30.00th=[13960], 40.00th=[14353], 50.00th=[14484], 60.00th=[14877], 00:29:48.147 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:29:48.147 | 99.00th=[17171], 99.50th=[17433], 99.90th=[21627], 99.95th=[49021], 00:29:48.147 | 99.99th=[54264] 00:29:48.147 bw ( KiB/s): min=25138, max=27904, per=33.45%, avg=26332.10, stdev=802.46, samples=20 00:29:48.147 iops : min= 196, max= 218, avg=205.70, stdev= 6.30, samples=20 00:29:48.147 lat (msec) : 20=99.85%, 50=0.10%, 100=0.05% 00:29:48.147 cpu : usr=91.91%, sys=7.61%, ctx=28, majf=0, minf=158 00:29:48.147 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:48.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.147 issued rwts: total=2060,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:48.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:48.147 00:29:48.147 Run status group 0 (all jobs): 00:29:48.147 READ: bw=76.9MiB/s (80.6MB/s), 25.0MiB/s-26.3MiB/s (26.2MB/s-27.6MB/s), io=772MiB (810MB), run=10046-10047msec 00:29:48.405 08:37:34 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:48.405 08:37:34 -- target/dif.sh@43 -- # local sub 00:29:48.405 08:37:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:48.405 08:37:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:48.405 08:37:34 -- target/dif.sh@36 -- # local sub_id=0 00:29:48.405 08:37:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:48.405 08:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.405 08:37:34 -- common/autotest_common.sh@10 -- # set +x 00:29:48.405 08:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.405 08:37:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:48.405 08:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:48.405 08:37:34 -- common/autotest_common.sh@10 -- # set +x 00:29:48.405 08:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.405 00:29:48.405 real 0m11.074s 00:29:48.405 user 0m28.899s 00:29:48.405 sys 0m2.468s 00:29:48.405 08:37:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:48.405 08:37:34 -- common/autotest_common.sh@10 -- # set +x 00:29:48.405 ************************************ 00:29:48.405 END TEST fio_dif_digest 00:29:48.405 ************************************ 00:29:48.405 08:37:34 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:48.405 08:37:34 -- target/dif.sh@147 -- # nvmftestfini 00:29:48.405 08:37:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:48.405 08:37:34 -- nvmf/common.sh@116 -- # sync 00:29:48.405 08:37:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:48.405 08:37:34 -- nvmf/common.sh@119 -- # set +e 00:29:48.405 08:37:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:48.405 08:37:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:48.405 rmmod nvme_tcp 00:29:48.406 rmmod nvme_fabrics 00:29:48.406 rmmod nvme_keyring 00:29:48.406 08:37:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:48.406 08:37:34 -- nvmf/common.sh@123 -- # set -e 00:29:48.406 08:37:34 -- nvmf/common.sh@124 -- # return 0 00:29:48.406 08:37:34 -- nvmf/common.sh@477 -- # '[' -n 1093412 ']' 00:29:48.406 08:37:34 -- nvmf/common.sh@478 -- # killprocess 1093412 00:29:48.406 08:37:34 -- common/autotest_common.sh@936 -- # '[' -z 1093412 ']' 00:29:48.406 08:37:34 -- common/autotest_common.sh@940 -- # kill -0 1093412 00:29:48.406 08:37:34 -- common/autotest_common.sh@941 -- # uname 00:29:48.406 08:37:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.406 08:37:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1093412 00:29:48.664 08:37:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:48.664 08:37:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:48.664 08:37:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1093412' 00:29:48.664 killing process with pid 1093412 00:29:48.664 08:37:34 -- common/autotest_common.sh@955 -- # kill 1093412 00:29:48.664 08:37:34 -- common/autotest_common.sh@960 -- # wait 1093412 00:29:48.923 08:37:34 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:48.923 08:37:34 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:49.859 Waiting for block devices as requested 00:29:49.859 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:50.117 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:50.117 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:50.376 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:50.376 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:50.376 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:50.376 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:50.635 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:50.635 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:50.635 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:50.635 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:50.893 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:50.893 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:50.893 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:50.893 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:51.150 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:51.150 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:51.150 08:37:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:51.150 08:37:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:51.150 08:37:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:51.150 08:37:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:51.150 08:37:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:51.150 08:37:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:51.151 08:37:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:53.684 08:37:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:53.684 00:29:53.684 real 1m7.568s 00:29:53.684 user 6m30.974s 00:29:53.685 sys 0m18.094s 00:29:53.685 08:37:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:53.685 08:37:39 -- common/autotest_common.sh@10 -- # set +x 00:29:53.685 ************************************ 00:29:53.685 END TEST nvmf_dif 00:29:53.685 ************************************ 00:29:53.685 08:37:39 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:53.685 08:37:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:53.685 08:37:39 -- common/autotest_common.sh@10 -- # set +x 00:29:53.685 ************************************ 00:29:53.685 START TEST nvmf_abort_qd_sizes 00:29:53.685 ************************************ 00:29:53.685 08:37:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:53.685 * Looking for test storage... 00:29:53.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:53.685 08:37:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:53.685 08:37:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:53.685 08:37:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:53.685 08:37:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:53.685 08:37:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:53.685 08:37:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:53.685 08:37:39 -- scripts/common.sh@335 -- # IFS=.-: 00:29:53.685 08:37:39 -- scripts/common.sh@335 -- # read -ra ver1 00:29:53.685 08:37:39 -- scripts/common.sh@336 -- # IFS=.-: 00:29:53.685 08:37:39 -- scripts/common.sh@336 -- # read -ra ver2 00:29:53.685 08:37:39 -- scripts/common.sh@337 -- # local 'op=<' 00:29:53.685 08:37:39 -- scripts/common.sh@339 -- # ver1_l=2 00:29:53.685 08:37:39 -- scripts/common.sh@340 -- # ver2_l=1 00:29:53.685 08:37:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:53.685 08:37:39 -- scripts/common.sh@343 -- # case "$op" in 00:29:53.685 08:37:39 -- scripts/common.sh@344 -- # : 1 00:29:53.685 08:37:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:53.685 08:37:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:53.685 08:37:39 -- scripts/common.sh@364 -- # decimal 1 00:29:53.685 08:37:39 -- scripts/common.sh@352 -- # local d=1 00:29:53.685 08:37:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:53.685 08:37:39 -- scripts/common.sh@354 -- # echo 1 00:29:53.685 08:37:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:53.685 08:37:39 -- scripts/common.sh@365 -- # decimal 2 00:29:53.685 08:37:39 -- scripts/common.sh@352 -- # local d=2 00:29:53.685 08:37:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:53.685 08:37:39 -- scripts/common.sh@354 -- # echo 2 00:29:53.685 08:37:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:53.685 08:37:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:53.685 08:37:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:53.685 08:37:39 -- scripts/common.sh@367 -- # return 0 00:29:53.685 08:37:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:53.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:53.685 --rc genhtml_branch_coverage=1 00:29:53.685 --rc genhtml_function_coverage=1 00:29:53.685 --rc genhtml_legend=1 00:29:53.685 --rc geninfo_all_blocks=1 00:29:53.685 --rc geninfo_unexecuted_blocks=1 00:29:53.685 00:29:53.685 ' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:53.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:53.685 --rc genhtml_branch_coverage=1 00:29:53.685 --rc genhtml_function_coverage=1 00:29:53.685 --rc genhtml_legend=1 00:29:53.685 --rc geninfo_all_blocks=1 00:29:53.685 --rc geninfo_unexecuted_blocks=1 00:29:53.685 00:29:53.685 ' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:53.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:53.685 --rc genhtml_branch_coverage=1 00:29:53.685 --rc genhtml_function_coverage=1 00:29:53.685 --rc genhtml_legend=1 00:29:53.685 --rc geninfo_all_blocks=1 00:29:53.685 --rc geninfo_unexecuted_blocks=1 00:29:53.685 00:29:53.685 ' 00:29:53.685 08:37:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:53.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:53.685 --rc genhtml_branch_coverage=1 00:29:53.685 --rc genhtml_function_coverage=1 00:29:53.685 --rc genhtml_legend=1 00:29:53.685 --rc geninfo_all_blocks=1 00:29:53.685 --rc geninfo_unexecuted_blocks=1 00:29:53.685 00:29:53.685 ' 00:29:53.685 08:37:39 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:53.685 08:37:39 -- nvmf/common.sh@7 -- # uname -s 00:29:53.685 08:37:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:53.685 08:37:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:53.685 08:37:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:53.685 08:37:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:53.685 08:37:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:53.685 08:37:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:53.685 08:37:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:53.685 08:37:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:53.685 08:37:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:53.685 08:37:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:53.685 08:37:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:53.685 08:37:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:53.685 08:37:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:53.685 08:37:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:53.685 08:37:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:53.685 08:37:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:53.685 08:37:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:53.685 08:37:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:53.685 08:37:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:53.685 08:37:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:53.685 08:37:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:53.685 08:37:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:53.685 08:37:39 -- paths/export.sh@5 -- # export PATH 00:29:53.685 08:37:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:53.685 08:37:39 -- nvmf/common.sh@46 -- # : 0 00:29:53.685 08:37:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:53.685 08:37:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:53.685 08:37:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:53.685 08:37:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:53.685 08:37:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:53.685 08:37:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:53.685 08:37:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:53.685 08:37:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:53.685 08:37:39 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:53.685 08:37:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:53.685 08:37:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:53.685 08:37:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:53.685 08:37:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:53.685 08:37:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:53.685 08:37:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:53.685 08:37:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:53.685 08:37:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:53.685 08:37:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:53.685 08:37:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:53.685 08:37:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:53.685 08:37:39 -- common/autotest_common.sh@10 -- # set +x 00:29:55.619 08:37:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:55.619 08:37:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:55.619 08:37:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:55.619 08:37:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:55.619 08:37:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:55.619 08:37:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:55.619 08:37:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:55.619 08:37:41 -- nvmf/common.sh@294 -- # net_devs=() 00:29:55.619 08:37:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:55.619 08:37:41 -- nvmf/common.sh@295 -- # e810=() 00:29:55.620 08:37:41 -- nvmf/common.sh@295 -- # local -ga e810 00:29:55.620 08:37:41 -- nvmf/common.sh@296 -- # x722=() 00:29:55.620 08:37:41 -- nvmf/common.sh@296 -- # local -ga x722 00:29:55.620 08:37:41 -- nvmf/common.sh@297 -- # mlx=() 00:29:55.620 08:37:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:55.620 08:37:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:55.620 08:37:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:55.620 08:37:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:55.620 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:55.620 08:37:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:55.620 08:37:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:55.620 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:55.620 08:37:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:55.620 08:37:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:55.620 08:37:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:55.620 08:37:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:55.620 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:55.620 08:37:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:55.620 08:37:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:55.620 08:37:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:55.620 08:37:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:55.620 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:55.620 08:37:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:55.620 08:37:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:55.620 08:37:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:55.620 08:37:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:55.620 08:37:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:55.620 08:37:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:55.620 08:37:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:55.620 08:37:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:55.620 08:37:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:55.620 08:37:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:55.620 08:37:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:55.620 08:37:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:55.620 08:37:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:55.620 08:37:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:55.620 08:37:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:55.620 08:37:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:55.620 08:37:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:55.620 08:37:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:55.620 08:37:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:55.620 08:37:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:55.620 08:37:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:55.620 08:37:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:55.620 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:55.620 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:29:55.620 00:29:55.620 --- 10.0.0.2 ping statistics --- 00:29:55.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:55.620 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:29:55.620 08:37:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:55.620 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:55.620 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:29:55.620 00:29:55.620 --- 10.0.0.1 ping statistics --- 00:29:55.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:55.620 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:29:55.620 08:37:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:55.620 08:37:41 -- nvmf/common.sh@410 -- # return 0 00:29:55.620 08:37:41 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:55.620 08:37:41 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:56.995 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:56.995 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:56.995 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:57.927 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:57.927 08:37:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:57.927 08:37:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:57.927 08:37:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:57.927 08:37:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:57.927 08:37:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:57.927 08:37:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:57.927 08:37:43 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:57.927 08:37:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:57.927 08:37:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:57.927 08:37:43 -- common/autotest_common.sh@10 -- # set +x 00:29:57.927 08:37:43 -- nvmf/common.sh@469 -- # nvmfpid=1104783 00:29:57.927 08:37:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:57.927 08:37:43 -- nvmf/common.sh@470 -- # waitforlisten 1104783 00:29:57.928 08:37:43 -- common/autotest_common.sh@829 -- # '[' -z 1104783 ']' 00:29:57.928 08:37:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:57.928 08:37:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:57.928 08:37:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:57.928 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:57.928 08:37:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:57.928 08:37:43 -- common/autotest_common.sh@10 -- # set +x 00:29:58.186 [2024-11-26 08:37:43.800938] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:58.186 [2024-11-26 08:37:43.801013] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:58.186 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.186 [2024-11-26 08:37:43.865171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:58.186 [2024-11-26 08:37:43.975285] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:58.186 [2024-11-26 08:37:43.975433] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:58.186 [2024-11-26 08:37:43.975449] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:58.186 [2024-11-26 08:37:43.975460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:58.186 [2024-11-26 08:37:43.975649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:58.186 [2024-11-26 08:37:43.975711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:58.186 [2024-11-26 08:37:43.975776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:58.186 [2024-11-26 08:37:43.975779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:59.119 08:37:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:59.119 08:37:44 -- common/autotest_common.sh@862 -- # return 0 00:29:59.119 08:37:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:59.119 08:37:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:59.119 08:37:44 -- common/autotest_common.sh@10 -- # set +x 00:29:59.119 08:37:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:59.119 08:37:44 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:59.119 08:37:44 -- scripts/common.sh@312 -- # local nvmes 00:29:59.119 08:37:44 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:59.119 08:37:44 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:59.119 08:37:44 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:59.119 08:37:44 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:59.119 08:37:44 -- scripts/common.sh@322 -- # uname -s 00:29:59.119 08:37:44 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:59.119 08:37:44 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:59.119 08:37:44 -- scripts/common.sh@327 -- # (( 1 )) 00:29:59.119 08:37:44 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:59.119 08:37:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:59.119 08:37:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:59.119 08:37:44 -- common/autotest_common.sh@10 -- # set +x 00:29:59.119 ************************************ 00:29:59.119 START TEST spdk_target_abort 00:29:59.119 ************************************ 00:29:59.119 08:37:44 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:59.119 08:37:44 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:59.119 08:37:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.119 08:37:44 -- common/autotest_common.sh@10 -- # set +x 00:30:02.400 spdk_targetn1 00:30:02.400 08:37:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:02.400 08:37:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.400 08:37:47 -- common/autotest_common.sh@10 -- # set +x 00:30:02.400 [2024-11-26 08:37:47.647414] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:02.400 08:37:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:02.400 08:37:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.400 08:37:47 -- common/autotest_common.sh@10 -- # set +x 00:30:02.400 08:37:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:02.400 08:37:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.400 08:37:47 -- common/autotest_common.sh@10 -- # set +x 00:30:02.400 08:37:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:02.400 08:37:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.400 08:37:47 -- common/autotest_common.sh@10 -- # set +x 00:30:02.400 [2024-11-26 08:37:47.679788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:02.400 08:37:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:02.400 08:37:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:02.400 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.680 Initializing NVMe Controllers 00:30:05.680 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:05.680 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:05.681 Initialization complete. Launching workers. 00:30:05.681 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11185, failed: 0 00:30:05.681 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1211, failed to submit 9974 00:30:05.681 success 751, unsuccess 460, failed 0 00:30:05.681 08:37:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:05.681 08:37:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:05.681 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.962 Initializing NVMe Controllers 00:30:08.962 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:08.962 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:08.962 Initialization complete. Launching workers. 00:30:08.962 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8696, failed: 0 00:30:08.962 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1229, failed to submit 7467 00:30:08.962 success 323, unsuccess 906, failed 0 00:30:08.962 08:37:54 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:08.962 08:37:54 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:08.962 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.244 Initializing NVMe Controllers 00:30:12.244 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:12.244 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:12.244 Initialization complete. Launching workers. 00:30:12.244 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32457, failed: 0 00:30:12.244 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2666, failed to submit 29791 00:30:12.244 success 575, unsuccess 2091, failed 0 00:30:12.244 08:37:57 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:12.244 08:37:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.244 08:37:57 -- common/autotest_common.sh@10 -- # set +x 00:30:12.244 08:37:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.244 08:37:57 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:12.244 08:37:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.244 08:37:57 -- common/autotest_common.sh@10 -- # set +x 00:30:13.178 08:37:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:13.178 08:37:58 -- target/abort_qd_sizes.sh@62 -- # killprocess 1104783 00:30:13.178 08:37:58 -- common/autotest_common.sh@936 -- # '[' -z 1104783 ']' 00:30:13.178 08:37:58 -- common/autotest_common.sh@940 -- # kill -0 1104783 00:30:13.178 08:37:58 -- common/autotest_common.sh@941 -- # uname 00:30:13.178 08:37:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:13.178 08:37:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1104783 00:30:13.178 08:37:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:13.178 08:37:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:13.178 08:37:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1104783' 00:30:13.178 killing process with pid 1104783 00:30:13.178 08:37:58 -- common/autotest_common.sh@955 -- # kill 1104783 00:30:13.178 08:37:58 -- common/autotest_common.sh@960 -- # wait 1104783 00:30:13.437 00:30:13.437 real 0m14.360s 00:30:13.437 user 0m57.008s 00:30:13.437 sys 0m2.463s 00:30:13.437 08:37:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:13.437 08:37:59 -- common/autotest_common.sh@10 -- # set +x 00:30:13.437 ************************************ 00:30:13.437 END TEST spdk_target_abort 00:30:13.437 ************************************ 00:30:13.437 08:37:59 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:13.437 08:37:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:13.437 08:37:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:13.437 08:37:59 -- common/autotest_common.sh@10 -- # set +x 00:30:13.437 ************************************ 00:30:13.437 START TEST kernel_target_abort 00:30:13.437 ************************************ 00:30:13.437 08:37:59 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:13.437 08:37:59 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:13.437 08:37:59 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:13.437 08:37:59 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:13.437 08:37:59 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:13.437 08:37:59 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:13.437 08:37:59 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:13.437 08:37:59 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:13.437 08:37:59 -- nvmf/common.sh@627 -- # local block nvme 00:30:13.437 08:37:59 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:13.437 08:37:59 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:13.437 08:37:59 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:13.437 08:37:59 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:14.811 Waiting for block devices as requested 00:30:14.811 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:14.811 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:14.811 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:15.070 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:15.070 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:15.070 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:15.070 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:15.329 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:15.329 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:15.329 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:15.329 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:15.587 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:15.587 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:15.587 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:15.588 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:15.846 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:15.846 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:15.846 08:38:01 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:15.846 08:38:01 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:15.846 08:38:01 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:15.846 08:38:01 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:15.846 08:38:01 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:16.104 No valid GPT data, bailing 00:30:16.104 08:38:01 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:16.104 08:38:01 -- scripts/common.sh@393 -- # pt= 00:30:16.104 08:38:01 -- scripts/common.sh@394 -- # return 1 00:30:16.104 08:38:01 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:16.104 08:38:01 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:16.104 08:38:01 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:16.104 08:38:01 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:16.104 08:38:01 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:16.104 08:38:01 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:16.104 08:38:01 -- nvmf/common.sh@654 -- # echo 1 00:30:16.104 08:38:01 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:16.104 08:38:01 -- nvmf/common.sh@656 -- # echo 1 00:30:16.104 08:38:01 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:16.104 08:38:01 -- nvmf/common.sh@663 -- # echo tcp 00:30:16.104 08:38:01 -- nvmf/common.sh@664 -- # echo 4420 00:30:16.104 08:38:01 -- nvmf/common.sh@665 -- # echo ipv4 00:30:16.104 08:38:01 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:16.104 08:38:01 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:16.104 00:30:16.104 Discovery Log Number of Records 2, Generation counter 2 00:30:16.104 =====Discovery Log Entry 0====== 00:30:16.104 trtype: tcp 00:30:16.104 adrfam: ipv4 00:30:16.104 subtype: current discovery subsystem 00:30:16.104 treq: not specified, sq flow control disable supported 00:30:16.104 portid: 1 00:30:16.104 trsvcid: 4420 00:30:16.104 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:16.104 traddr: 10.0.0.1 00:30:16.104 eflags: none 00:30:16.104 sectype: none 00:30:16.104 =====Discovery Log Entry 1====== 00:30:16.104 trtype: tcp 00:30:16.104 adrfam: ipv4 00:30:16.104 subtype: nvme subsystem 00:30:16.104 treq: not specified, sq flow control disable supported 00:30:16.104 portid: 1 00:30:16.104 trsvcid: 4420 00:30:16.104 subnqn: kernel_target 00:30:16.104 traddr: 10.0.0.1 00:30:16.104 eflags: none 00:30:16.104 sectype: none 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:16.105 08:38:01 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:16.105 EAL: No free 2048 kB hugepages reported on node 1 00:30:19.394 Initializing NVMe Controllers 00:30:19.394 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:19.394 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:19.394 Initialization complete. Launching workers. 00:30:19.394 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 40813, failed: 0 00:30:19.394 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 40813, failed to submit 0 00:30:19.394 success 0, unsuccess 40813, failed 0 00:30:19.394 08:38:04 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:19.394 08:38:04 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:19.394 EAL: No free 2048 kB hugepages reported on node 1 00:30:22.736 Initializing NVMe Controllers 00:30:22.736 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:22.736 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:22.736 Initialization complete. Launching workers. 00:30:22.736 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 74590, failed: 0 00:30:22.736 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18806, failed to submit 55784 00:30:22.736 success 0, unsuccess 18806, failed 0 00:30:22.736 08:38:08 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:22.736 08:38:08 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:22.736 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.017 Initializing NVMe Controllers 00:30:26.017 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:26.017 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:26.017 Initialization complete. Launching workers. 00:30:26.017 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 71985, failed: 0 00:30:26.017 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 17982, failed to submit 54003 00:30:26.017 success 0, unsuccess 17982, failed 0 00:30:26.017 08:38:11 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:26.017 08:38:11 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:26.017 08:38:11 -- nvmf/common.sh@677 -- # echo 0 00:30:26.017 08:38:11 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:26.017 08:38:11 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:26.017 08:38:11 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:26.017 08:38:11 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:26.017 08:38:11 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:26.017 08:38:11 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:26.017 00:30:26.017 real 0m12.026s 00:30:26.017 user 0m5.368s 00:30:26.017 sys 0m2.523s 00:30:26.017 08:38:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.017 08:38:11 -- common/autotest_common.sh@10 -- # set +x 00:30:26.017 ************************************ 00:30:26.017 END TEST kernel_target_abort 00:30:26.017 ************************************ 00:30:26.017 08:38:11 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:26.017 08:38:11 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:26.017 08:38:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:26.017 08:38:11 -- nvmf/common.sh@116 -- # sync 00:30:26.017 08:38:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:26.017 08:38:11 -- nvmf/common.sh@119 -- # set +e 00:30:26.017 08:38:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:26.017 08:38:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:26.017 rmmod nvme_tcp 00:30:26.017 rmmod nvme_fabrics 00:30:26.017 rmmod nvme_keyring 00:30:26.017 08:38:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:26.017 08:38:11 -- nvmf/common.sh@123 -- # set -e 00:30:26.017 08:38:11 -- nvmf/common.sh@124 -- # return 0 00:30:26.017 08:38:11 -- nvmf/common.sh@477 -- # '[' -n 1104783 ']' 00:30:26.017 08:38:11 -- nvmf/common.sh@478 -- # killprocess 1104783 00:30:26.017 08:38:11 -- common/autotest_common.sh@936 -- # '[' -z 1104783 ']' 00:30:26.017 08:38:11 -- common/autotest_common.sh@940 -- # kill -0 1104783 00:30:26.017 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1104783) - No such process 00:30:26.017 08:38:11 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1104783 is not found' 00:30:26.017 Process with pid 1104783 is not found 00:30:26.017 08:38:11 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:26.017 08:38:11 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:26.585 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:26.585 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.585 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.585 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.585 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.844 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.844 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.844 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.844 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:26.844 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.844 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.844 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.844 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.844 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.844 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.844 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.844 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:26.844 08:38:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.844 08:38:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.844 08:38:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.844 08:38:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.844 08:38:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.844 08:38:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:26.844 08:38:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:29.380 08:38:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:29.380 00:30:29.380 real 0m35.677s 00:30:29.380 user 1m4.761s 00:30:29.380 sys 0m8.401s 00:30:29.380 08:38:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:29.380 08:38:14 -- common/autotest_common.sh@10 -- # set +x 00:30:29.380 ************************************ 00:30:29.380 END TEST nvmf_abort_qd_sizes 00:30:29.380 ************************************ 00:30:29.380 08:38:14 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:29.380 08:38:14 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:29.380 08:38:14 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:29.380 08:38:14 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:29.380 08:38:14 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:29.380 08:38:14 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:29.380 08:38:14 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:29.380 08:38:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:29.380 08:38:14 -- common/autotest_common.sh@10 -- # set +x 00:30:29.380 08:38:14 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:29.380 08:38:14 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:29.380 08:38:14 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:29.380 08:38:14 -- common/autotest_common.sh@10 -- # set +x 00:30:30.759 INFO: APP EXITING 00:30:30.759 INFO: killing all VMs 00:30:30.759 INFO: killing vhost app 00:30:30.759 INFO: EXIT DONE 00:30:32.137 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:32.137 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:32.137 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:32.137 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:32.137 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:32.137 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:32.137 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:32.137 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:32.137 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:32.137 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:32.137 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:32.137 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:32.137 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:32.137 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:32.137 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:32.137 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:32.137 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:33.512 Cleaning 00:30:33.512 Removing: /var/run/dpdk/spdk0/config 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:33.512 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:33.512 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:33.512 Removing: /var/run/dpdk/spdk1/config 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:33.512 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:33.512 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:33.512 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:33.512 Removing: /var/run/dpdk/spdk2/config 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:33.512 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:33.512 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:33.512 Removing: /var/run/dpdk/spdk3/config 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:33.512 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:33.512 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:33.512 Removing: /var/run/dpdk/spdk4/config 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:33.512 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:33.512 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:33.513 Removing: /dev/shm/bdev_svc_trace.1 00:30:33.513 Removing: /dev/shm/nvmf_trace.0 00:30:33.513 Removing: /dev/shm/spdk_tgt_trace.pid834682 00:30:33.513 Removing: /var/run/dpdk/spdk0 00:30:33.513 Removing: /var/run/dpdk/spdk1 00:30:33.513 Removing: /var/run/dpdk/spdk2 00:30:33.513 Removing: /var/run/dpdk/spdk3 00:30:33.513 Removing: /var/run/dpdk/spdk4 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1018361 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1021318 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1025670 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1026769 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1027959 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1030599 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1033127 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1037540 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1037542 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1040490 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1040752 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1040890 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1041161 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1041173 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1042274 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1043501 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1044712 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1045998 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1047265 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1048490 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1052376 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1052797 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1054272 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1055552 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1059435 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1061508 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1065132 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1068764 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1072439 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1072930 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1073408 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1073829 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1074423 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1074978 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1075533 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1076083 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1078756 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1078923 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1082890 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1083070 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1084724 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1090634 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1090639 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1093597 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1095035 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1096593 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1097354 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1098807 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1099701 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1105224 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1105625 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1106037 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1107590 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1107922 00:30:33.513 Removing: /var/run/dpdk/spdk_pid1108350 00:30:33.513 Removing: /var/run/dpdk/spdk_pid832894 00:30:33.513 Removing: /var/run/dpdk/spdk_pid833662 00:30:33.513 Removing: /var/run/dpdk/spdk_pid834682 00:30:33.513 Removing: /var/run/dpdk/spdk_pid835229 00:30:33.513 Removing: /var/run/dpdk/spdk_pid837079 00:30:33.513 Removing: /var/run/dpdk/spdk_pid838032 00:30:33.513 Removing: /var/run/dpdk/spdk_pid838360 00:30:33.513 Removing: /var/run/dpdk/spdk_pid838685 00:30:33.513 Removing: /var/run/dpdk/spdk_pid838910 00:30:33.513 Removing: /var/run/dpdk/spdk_pid839242 00:30:33.513 Removing: /var/run/dpdk/spdk_pid839401 00:30:33.513 Removing: /var/run/dpdk/spdk_pid839558 00:30:33.513 Removing: /var/run/dpdk/spdk_pid839876 00:30:33.513 Removing: /var/run/dpdk/spdk_pid840481 00:30:33.513 Removing: /var/run/dpdk/spdk_pid843037 00:30:33.513 Removing: /var/run/dpdk/spdk_pid843335 00:30:33.513 Removing: /var/run/dpdk/spdk_pid843507 00:30:33.513 Removing: /var/run/dpdk/spdk_pid843649 00:30:33.513 Removing: /var/run/dpdk/spdk_pid844083 00:30:33.513 Removing: /var/run/dpdk/spdk_pid844225 00:30:33.513 Removing: /var/run/dpdk/spdk_pid844630 00:30:33.513 Removing: /var/run/dpdk/spdk_pid844696 00:30:33.513 Removing: /var/run/dpdk/spdk_pid844991 00:30:33.513 Removing: /var/run/dpdk/spdk_pid845133 00:30:33.771 Removing: /var/run/dpdk/spdk_pid845298 00:30:33.771 Removing: /var/run/dpdk/spdk_pid845441 00:30:33.771 Removing: /var/run/dpdk/spdk_pid845822 00:30:33.771 Removing: /var/run/dpdk/spdk_pid845979 00:30:33.771 Removing: /var/run/dpdk/spdk_pid846303 00:30:33.771 Removing: /var/run/dpdk/spdk_pid846484 00:30:33.771 Removing: /var/run/dpdk/spdk_pid846570 00:30:33.771 Removing: /var/run/dpdk/spdk_pid846691 00:30:33.771 Removing: /var/run/dpdk/spdk_pid846839 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847119 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847264 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847423 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847687 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847851 00:30:33.771 Removing: /var/run/dpdk/spdk_pid847991 00:30:33.771 Removing: /var/run/dpdk/spdk_pid848262 00:30:33.771 Removing: /var/run/dpdk/spdk_pid848418 00:30:33.771 Removing: /var/run/dpdk/spdk_pid848578 00:30:33.771 Removing: /var/run/dpdk/spdk_pid848729 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849002 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849146 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849305 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849568 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849727 00:30:33.771 Removing: /var/run/dpdk/spdk_pid849873 00:30:33.771 Removing: /var/run/dpdk/spdk_pid850147 00:30:33.771 Removing: /var/run/dpdk/spdk_pid850296 00:30:33.771 Removing: /var/run/dpdk/spdk_pid850454 00:30:33.771 Removing: /var/run/dpdk/spdk_pid850722 00:30:33.771 Removing: /var/run/dpdk/spdk_pid850880 00:30:33.771 Removing: /var/run/dpdk/spdk_pid851030 00:30:33.771 Removing: /var/run/dpdk/spdk_pid851289 00:30:33.771 Removing: /var/run/dpdk/spdk_pid851453 00:30:33.771 Removing: /var/run/dpdk/spdk_pid851607 00:30:33.771 Removing: /var/run/dpdk/spdk_pid851806 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852031 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852182 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852408 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852605 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852763 00:30:33.771 Removing: /var/run/dpdk/spdk_pid852949 00:30:33.771 Removing: /var/run/dpdk/spdk_pid853191 00:30:33.771 Removing: /var/run/dpdk/spdk_pid853345 00:30:33.771 Removing: /var/run/dpdk/spdk_pid853541 00:30:33.771 Removing: /var/run/dpdk/spdk_pid853767 00:30:33.771 Removing: /var/run/dpdk/spdk_pid853928 00:30:33.771 Removing: /var/run/dpdk/spdk_pid854094 00:30:33.771 Removing: /var/run/dpdk/spdk_pid854350 00:30:33.771 Removing: /var/run/dpdk/spdk_pid854514 00:30:33.771 Removing: /var/run/dpdk/spdk_pid854768 00:30:33.771 Removing: /var/run/dpdk/spdk_pid856991 00:30:33.771 Removing: /var/run/dpdk/spdk_pid914577 00:30:33.771 Removing: /var/run/dpdk/spdk_pid917242 00:30:33.771 Removing: /var/run/dpdk/spdk_pid924993 00:30:33.771 Removing: /var/run/dpdk/spdk_pid928470 00:30:33.771 Removing: /var/run/dpdk/spdk_pid930850 00:30:33.771 Removing: /var/run/dpdk/spdk_pid931337 00:30:33.771 Removing: /var/run/dpdk/spdk_pid936487 00:30:33.771 Removing: /var/run/dpdk/spdk_pid936774 00:30:33.771 Removing: /var/run/dpdk/spdk_pid939405 00:30:33.771 Removing: /var/run/dpdk/spdk_pid943238 00:30:33.771 Removing: /var/run/dpdk/spdk_pid945472 00:30:33.771 Removing: /var/run/dpdk/spdk_pid952171 00:30:33.771 Removing: /var/run/dpdk/spdk_pid957670 00:30:33.771 Removing: /var/run/dpdk/spdk_pid959068 00:30:33.771 Removing: /var/run/dpdk/spdk_pid959826 00:30:33.771 Removing: /var/run/dpdk/spdk_pid971105 00:30:33.771 Removing: /var/run/dpdk/spdk_pid973354 00:30:33.771 Removing: /var/run/dpdk/spdk_pid976187 00:30:33.771 Removing: /var/run/dpdk/spdk_pid977404 00:30:33.771 Removing: /var/run/dpdk/spdk_pid978896 00:30:33.771 Removing: /var/run/dpdk/spdk_pid979054 00:30:33.771 Removing: /var/run/dpdk/spdk_pid979324 00:30:33.771 Removing: /var/run/dpdk/spdk_pid979478 00:30:33.771 Removing: /var/run/dpdk/spdk_pid980070 00:30:33.771 Removing: /var/run/dpdk/spdk_pid981458 00:30:33.771 Removing: /var/run/dpdk/spdk_pid982457 00:30:33.771 Removing: /var/run/dpdk/spdk_pid983035 00:30:33.771 Removing: /var/run/dpdk/spdk_pid986545 00:30:33.771 Removing: /var/run/dpdk/spdk_pid990122 00:30:33.771 Removing: /var/run/dpdk/spdk_pid994394 00:30:33.771 Clean 00:30:34.029 killing process with pid 805086 00:30:42.137 killing process with pid 805083 00:30:42.137 killing process with pid 805085 00:30:42.394 killing process with pid 805084 00:30:42.394 08:38:28 -- common/autotest_common.sh@1446 -- # return 0 00:30:42.394 08:38:28 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:42.394 08:38:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:42.394 08:38:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.394 08:38:28 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:42.394 08:38:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:42.394 08:38:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.394 08:38:28 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:42.394 08:38:28 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:42.394 08:38:28 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:42.394 08:38:28 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:42.394 08:38:28 -- spdk/autotest.sh@383 -- # hostname 00:30:42.394 08:38:28 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:42.651 geninfo: WARNING: invalid characters removed from testname! 00:31:09.177 08:38:54 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:12.459 08:38:58 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:15.741 08:39:01 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:18.273 08:39:03 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:20.806 08:39:06 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:23.338 08:39:09 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:25.871 08:39:11 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:25.871 08:39:11 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:25.871 08:39:11 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:25.871 08:39:11 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:26.133 08:39:11 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:26.133 08:39:11 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:26.133 08:39:11 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:26.133 08:39:11 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:26.133 08:39:11 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:26.133 08:39:11 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:26.133 08:39:11 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:26.133 08:39:11 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:26.133 08:39:11 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:26.133 08:39:11 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:26.133 08:39:11 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:26.133 08:39:11 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:26.133 08:39:11 -- scripts/common.sh@343 -- $ case "$op" in 00:31:26.133 08:39:11 -- scripts/common.sh@344 -- $ : 1 00:31:26.133 08:39:11 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:26.133 08:39:11 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:26.133 08:39:11 -- scripts/common.sh@364 -- $ decimal 1 00:31:26.133 08:39:11 -- scripts/common.sh@352 -- $ local d=1 00:31:26.133 08:39:11 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:26.133 08:39:11 -- scripts/common.sh@354 -- $ echo 1 00:31:26.133 08:39:11 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:26.133 08:39:11 -- scripts/common.sh@365 -- $ decimal 2 00:31:26.133 08:39:11 -- scripts/common.sh@352 -- $ local d=2 00:31:26.133 08:39:11 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:26.133 08:39:11 -- scripts/common.sh@354 -- $ echo 2 00:31:26.133 08:39:11 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:26.133 08:39:11 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:26.133 08:39:11 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:26.133 08:39:11 -- scripts/common.sh@367 -- $ return 0 00:31:26.133 08:39:11 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:26.133 08:39:11 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:26.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.133 --rc genhtml_branch_coverage=1 00:31:26.133 --rc genhtml_function_coverage=1 00:31:26.133 --rc genhtml_legend=1 00:31:26.133 --rc geninfo_all_blocks=1 00:31:26.133 --rc geninfo_unexecuted_blocks=1 00:31:26.133 00:31:26.133 ' 00:31:26.133 08:39:11 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:26.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.133 --rc genhtml_branch_coverage=1 00:31:26.133 --rc genhtml_function_coverage=1 00:31:26.133 --rc genhtml_legend=1 00:31:26.133 --rc geninfo_all_blocks=1 00:31:26.133 --rc geninfo_unexecuted_blocks=1 00:31:26.133 00:31:26.133 ' 00:31:26.133 08:39:11 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:26.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.133 --rc genhtml_branch_coverage=1 00:31:26.133 --rc genhtml_function_coverage=1 00:31:26.133 --rc genhtml_legend=1 00:31:26.133 --rc geninfo_all_blocks=1 00:31:26.133 --rc geninfo_unexecuted_blocks=1 00:31:26.133 00:31:26.133 ' 00:31:26.133 08:39:11 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:26.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.133 --rc genhtml_branch_coverage=1 00:31:26.133 --rc genhtml_function_coverage=1 00:31:26.133 --rc genhtml_legend=1 00:31:26.133 --rc geninfo_all_blocks=1 00:31:26.133 --rc geninfo_unexecuted_blocks=1 00:31:26.133 00:31:26.133 ' 00:31:26.133 08:39:11 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:26.133 08:39:11 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:26.133 08:39:11 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:26.133 08:39:11 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:26.133 08:39:11 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.133 08:39:11 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.133 08:39:11 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.133 08:39:11 -- paths/export.sh@5 -- $ export PATH 00:31:26.133 08:39:11 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.133 08:39:11 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:26.133 08:39:11 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:26.133 08:39:11 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732606751.XXXXXX 00:31:26.133 08:39:11 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732606751.eSrW3o 00:31:26.133 08:39:11 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:26.133 08:39:11 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:26.133 08:39:11 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:26.133 08:39:11 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:26.133 08:39:11 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:26.133 08:39:11 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:26.133 08:39:11 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:26.133 08:39:11 -- common/autotest_common.sh@10 -- $ set +x 00:31:26.133 08:39:11 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:26.133 08:39:11 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:26.133 08:39:11 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.133 08:39:11 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:26.133 08:39:11 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:26.133 08:39:11 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:26.133 08:39:11 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:26.133 08:39:11 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:26.133 08:39:11 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:26.134 08:39:11 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:26.134 08:39:11 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:26.134 + [[ -n 762783 ]] 00:31:26.134 + sudo kill 762783 00:31:26.144 [Pipeline] } 00:31:26.161 [Pipeline] // stage 00:31:26.168 [Pipeline] } 00:31:26.186 [Pipeline] // timeout 00:31:26.191 [Pipeline] } 00:31:26.209 [Pipeline] // catchError 00:31:26.214 [Pipeline] } 00:31:26.232 [Pipeline] // wrap 00:31:26.238 [Pipeline] } 00:31:26.254 [Pipeline] // catchError 00:31:26.263 [Pipeline] stage 00:31:26.266 [Pipeline] { (Epilogue) 00:31:26.279 [Pipeline] catchError 00:31:26.281 [Pipeline] { 00:31:26.294 [Pipeline] echo 00:31:26.296 Cleanup processes 00:31:26.302 [Pipeline] sh 00:31:26.586 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.586 1120959 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.600 [Pipeline] sh 00:31:26.989 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.989 ++ grep -v 'sudo pgrep' 00:31:26.989 ++ awk '{print $1}' 00:31:26.989 + sudo kill -9 00:31:26.989 + true 00:31:27.001 [Pipeline] sh 00:31:27.281 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:37.263 [Pipeline] sh 00:31:37.544 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:37.544 Artifacts sizes are good 00:31:37.554 [Pipeline] archiveArtifacts 00:31:37.560 Archiving artifacts 00:31:37.695 [Pipeline] sh 00:31:37.977 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:37.990 [Pipeline] cleanWs 00:31:38.000 [WS-CLEANUP] Deleting project workspace... 00:31:38.000 [WS-CLEANUP] Deferred wipeout is used... 00:31:38.006 [WS-CLEANUP] done 00:31:38.008 [Pipeline] } 00:31:38.023 [Pipeline] // catchError 00:31:38.034 [Pipeline] sh 00:31:38.315 + logger -p user.info -t JENKINS-CI 00:31:38.325 [Pipeline] } 00:31:38.339 [Pipeline] // stage 00:31:38.345 [Pipeline] } 00:31:38.358 [Pipeline] // node 00:31:38.363 [Pipeline] End of Pipeline 00:31:38.400 Finished: SUCCESS